Wiki source code of 3. Evaluation Methods

Version 32.1 by William OGrady on 2024/03/25 14:34

Hide last authors
Rixt Hellinga 24.1 1 To ground the design rationale in practice, the prototype of the NAO for the PwD will be evaluated in a formative evaluation with the PwD and their caregivers. The evaluation will investigate the process of how interaction with the NAO can alleviate potential symptoms caused by early-stage dementia in PwD.  Three methods of evaluation will be applied to have reliable and accurate results, as Bethel. et al (2020)[1] suggests.
Jean-Paul Smit 3.2 2
Rixt Hellinga 24.1 3 The study will focus on the prototype's potential effects, which are based on the desired value of autonomy as a part of self-direction. Before the study, possible confounding variables need to be examined such as the PwD's attitude towards robots and the **autonomy, relatedness** and **competence**.
Rixt Hellinga 18.1 4
William OGrady 31.1 5 ==== ====
Jean-Paul Smit 4.4 6
William OGrady 31.1 7 == //**Study design claims**// ==
8
Jean-Paul Smit 3.2 9 The study will investigate the claims on the following questions:
10
Rixt Hellinga 24.1 11 ~1. **Autonomy. **Does the design increase the sense of //autonomy //in a PwD?
Jean-Paul Smit 3.3 12
Rixt Hellinga 24.1 13 2. **Relatedness. **Does the design positively affect the PwD's //affective //state? Do PwDs //like// the system?
Jean-Paul Smit 3.3 14
Jean-Paul Smit 27.1 15 3. **Competence. **Is the design //dependable//; is the design accessible enough for the PwD to rely on it? Does it feel natural?
Jean-Paul Smit 3.3 16
Jean-Paul Smit 29.1 17 4. **Memory self-efficacy** and **Recall**.(pre-study) How good are participants at remembering information? (post-study) Can the participant accurately retrieve information through the robot?
Jean-Paul Smit 3.3 18
Jean-Paul Smit 30.1 19 5. **Attitude towards Technology**. How do people think about using technology? Are they biased towards the robot before the study?
Jean-Paul Smit 26.1 20
Jean-Paul Smit 30.1 21
Rixt Hellinga 24.1 22 For a sample size as small as 20 participants, it is most adequate to apply a within-subjects design (they require fewer participants) [1]. That means there is an approach where every PwD is experiencing all of the conditions examined. A within-subjects design might be prone to confounds such as pre-existing notions in the environment. That is why the attitude towards robots and the pre-study sense of affect and autonomy should be examined and evaluated as such. Another confounder variable to look into is the study location and environment.
Jean-Paul Smit 5.1 23
Jean-Paul Smit 3.12 24 [[image:Socio-Cognitive Engineering - Frame 1.jpg]]
Jean-Paul Smit 3.7 25
26
William OGrady 32.1 27 == //**References**// ==
Jean-Paul Smit 3.10 28
Rixt Hellinga 23.1 29 [1] Bethel, C.L., Henkel, Z., Baugus, K. (2020). Conducting Studies in Human-Robot Interaction. In: Jost, C., //et al.// Human-Robot Interaction. Springer Series on Bio- and Neurosystems, vol 12. Springer, Cham. https:~/~/doi.org/10.1007/978-3-030-42307-0_4