Wiki source code of 3. Evaluation Methods

Version 14.1 by Jean-Paul Smit on 2024/03/01 11:36

Hide last authors
Jean-Paul Smit 13.1 1 To ground the design rationale in practice, the prototype of the NAO for PwD will be evaluated in a formative evaluation with the PwD (subject) and their caregivers. The evaluation will investigate the process of how interaction with the NAO can alleviate potential symptoms caused by early-stage dementia in PwD.  Three methods of evaluation will be applied to have reliable and accurate results, as Bethel. et al (2020)[1] suggests. The study will focus on the prototype's potential effects, which are based on the desired value of autonomy as a part of self-direction. Before the study, possible confounding variables need to be examined such as the subject's attitude towards robots and the **autonomy, relatedness** and **security**.
Jean-Paul Smit 3.2 2
Jean-Paul Smit 4.4 3 ==== Study design claims ====
4
Jean-Paul Smit 3.2 5 The study will investigate the claims on the following questions:
6
Jean-Paul Smit 14.1 7 ~1. **Autonomy. **Does the design increase the sense of //autonomy //in PwD?
Jean-Paul Smit 3.3 8
Jean-Paul Smit 14.1 9 2. **Relatedness. **Does the design positively affect PwD's //affective //state? Do subjects //like// the system?
Jean-Paul Smit 3.3 10
Jean-Paul Smit 14.1 11 3. **Security. **Is the design //dependable//; is the design accessible enough for PwD to rely on it? Does it feel natural?
Jean-Paul Smit 3.3 12
13
Jean-Paul Smit 8.1 14 For a sample size as small as 20 participants, it is most adequate to apply a within-subjects design (they require fewer participants)[1]. That means there is an approach where every subject is experiencing all of the conditions examined. A within-subjects design might be prone to confounds such as pre-existing notions in the environment. That is why the attitude towards robots and the pre-study sense of affect and autonomy should be examined and evaluated as such. Another confounder variable to look into is the study location and environment. The evaluation method will be self-assessment, which can only be included in the study when it is validated.
Jean-Paul Smit 5.1 15
16
Jean-Paul Smit 3.12 17 [[image:Socio-Cognitive Engineering - Frame 1.jpg]]
Jean-Paul Smit 3.7 18
Jean-Paul Smit 9.1 19 /
Jean-Paul Smit 3.7 20
Jean-Paul Smit 9.1 21
Jean-Paul Smit 3.10 22 == References ==
23
Jean-Paul Smit 3.9 24 (1) Bethel, C.L., Henkel, Z., Baugus, K. (2020). Conducting Studies in Human-Robot Interaction. In: Jost, C., //et al.// Human-Robot Interaction. Springer Series on Bio- and Neurosystems, vol 12. Springer, Cham. https:~/~/doi.org/10.1007/978-3-030-42307-0_4