3. Evaluation Methods

To ground the design rationale in practice, the prototype of the NAO for PwD will be evaluated in a formative evaluation with the PwD (subject) and their caregivers. The evaluation will investigate the process of how interaction with the NAO can alleviate potential symptoms caused by early-stage dementia in PwD.  The study will be conducted focused on the prototype's potential effects, which are based on desired values of self-direction, security and conformity.

The study will investigate the claims on the following questions:

1. Does the design increase the sense of autonomy in PwD?

2. Does the design have a positive effect on PwD's emotional/affective state?

3. Is the design dependable; do PwD sense that they can rely on it?

Positive effects:

Measuring sense of autonomy:

Have the PwD rate themselves on a scale 1-5.

Have the relatives rate the PwD on a scale 1-5.

Evaluate how often PwD asks for clarification in a conversation with relatives in #Questions asked.

Measuring the prevention of negative emotions such as stress:

Have the PwD rate themselves on a scale 1-5.

How often a PwD has a stressed/upset moment according to NAO.

Measuring trust in the PwD:

How many times a relative calls PwD to check in.

Negative effects:

Causing negative emotions with upsetting information:

Have the PwD rate themselves on a scale 1-5.

How often a PwD has a stressed/upset moment according to NAO.

Overloading the PwD with information:

Percentage of information re-asked by the PwD.