Skip to Content

Wiki source code of Test

Version 21.1 by Veikko Saikkonen on 2022/03/31 11:50
Show last authors
1 = Problem statement and research questions =
2
3 People with dementia often forget to eat and drink, leading to dehydration, malnutrition and decreased wellbeing in general. Our prototype engages in discourses to remind PwD to have lunch and drink water, using the Nao robot platform. The discourse aims to reming the PwD without causing any anxiety or embarrassment which a traditional "alarm" system could cause, and keep them company throughout these activities.
4
5 RQ1: "Does the robot cause PwD to eat more regularly?"
6 RQ2: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
7 RQ3: "Does the robot remind the PwD of their hunger?"
8 RQ4: "Does the music make the eating more enjoyable for the PwD?"
9
10 = Method =
11
12 The prototype is evaluated with an in-person experiment with multiple participants. In the experiment, the participants will be asked to pretend to be PwD and act accordingly with/without the prototype.
13
14 == Participants ==
15
16 As there are practical difficulties with conducting the experiment with actual people with dementia due to both time constraints and COVID, our participants' group will consist of peers from other groups and friends, who will act as if they are older people with dementia. We plan to gather around 20 people for our experiments.
17
18 == Experimental design ==
19
20 We will be using a within-subject design. In the experiment all of the participants will interact with both versions of the robot, with half of the participants interacting with the version 1 first and then version 2, and the other half in reverse order, to counter-balance the carryover effects. Snacks will be made available for the participants, in case they're prompted and they're hungry. The participants will be unaware of the possibility of eating snacks, to prevent disturbing the interaction with the robot. Otherwise the subjects could be primed for eating, which would bias the results and hide the effect of the robotic interaction.
21
22 == Tasks ==
23
24 The participant will have to interact with the robot, which is programmed to engage in a lunch discourse. Two versions will be implemented: the first version will ask basic questions about mealtime, mostly acting as a reminder for the PwD to have lunch (alarm clock). The second will be our original implementation of it with the more sophisticated discourse and music.
25
26 == Measures ==
27
28 We plan on measuring the effectiveness of the discourse, both physically and emotionally. Our quantitative measure is whether the person ate the lunch they were supposed to have eaten, and the qualitative measure is the emotions that the PwD experienced before, during, and after the interaction. The qualitative measures will be recorded with a simple questionnaire. Depending on the time of the experiments, we assume that people might also not be hungry enough to be prompted to have something to eat, which might disturb the results. We do plan however to measure whether the robot will remind someone of their hunger and have them eat.
29
30 == Procedure ==
31
32 * Welcome Participants and explain what they are going to be doing.
33 * Have them sign the permission form.
34 * Participants complete a questionnaire(A) regarding their emotional state (control).
35 * Have version A of interaction with the robot.
36 * Complete questionnaire(extended version).
37 * Have a short interview during downtime (prepared questions).
38 * Have version B of interaction with the robot.
39 * Complete questionnaire(extended version).
40 * Have a short interview during downtime (prepared questions).
41
42 == Material ==
43
44 For the experiments, we'll be using the NAO robot platform, as well as a laptop for the participants to complete the questionnaires on. The questionnaire will be a combination of questions regarding the emotional state of the participants, their interaction with the robot, and the music included in the interaction. Food will be made available to see and measure how much people will eat.
45
46 Questionnaires:
47 Consent Form and Disclaimers
48 8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire
49 4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire
50 3 food-related questions of our own (5-point Likert scale)
51 2 music-related questions of our own (5-point Likert scale)
52
53 == Practicalities ==
54
55 Beforehand:
56
57 * Do a practice round by ourselves
58 ** Film this
59 * Contact other groups and decide on a time slot
60 ** Might be better to reserve in 10 min slots, so that people don't have to wait so much
61 ** If possible, this could be done in parallel with another groups testing
62 * Reserve lab
63 * Buy snacks
64
65 During:
66
67 1. Give starting questionnare to fill while people are waiting for the previous participant
68 2. Guide the participant to the testing spot
69 3. Inform the participant where the snacks are
70 4. Run the first version
71 5. Give the mid-questionnare
72 6. Run the other test
73 7. Conduct the questionnare for the participant
74 8. Give the participant the end-questionnare
75
76 Other practicalities during:
77
78 * We will use the "Wizard of Oz" method for recognizing agreement and disagreement, to make sure that the whole process does not depend on voice recegnition being good enough
79 ** Someone will press eg. "y" and "n" on the keyboard according to the participants answers
80 * We will change the order in which the smart and basic versions are for each participant
81 ** this way if someone doesn't show up, we don't get skewed amounts
82
83 After:
84
85 * Analyze results
86
87 = Results =
88
89 - TODO: Add median emotion changes bar chart for smart and dumb (try out a difference graph as well)
90 - TODO: Add Wilcox test results for emotion changes
91 - TODO: Add "I liked the music" and "I thought the music was calming" figures
92 - TODO: Add "I thought the robot was pleasant." and "I thought the robot was friendly" figures
93
94 = Discussion =
95
96
97
98 = Conclusions =
99
100 = Appendix =
101
102 == Experiment introduction for participants ==
103
104
105
106 Hi, we are <NAME> and <NAME> from the TU Delft Socio-Cognitive Engeering course Group 1, thank you for participating in our prototype evaluation experiment. The experiment is being conducted as a part of the TU Delft course on Socio-Cognitive Engineering and aims to evaluate the prototype designed as a part of the course. The evaluated prototype is based on the Nao robot-platform and is intended to improve the wellbeing of people suffering of dementia.
107
108 Consuming food and/or water can be a consequence of the interaction between you and the robot. Therefore, we would like to ask you if you have any allergies. If you have a form of Diabetes, please let us know before we start the first part of the experiment. You are strongly encouraged to share any other health conditions that can possibly be relevant to take into account when doing an experiment with robots and food with us.
109
110 The link between the stimuli of the Nao-robot and the triggering of epileptic seizures is yet unknown. If you have ever experienced epileptic seizures, please let us know. Then, we could see if any special precautions are needed.
111
112 The experiment will last for approximately 15-20 minutes, and consists of two interaction sections with the Nao robot, as well as questionnaires before, between and after the sections. We kindly ask you to act naturally during the experiment and fill the questionnaires truthfully and intuitively. Remember that we are evaluating the prototypes performance, not yours. You can stop the experiment at any time.
113
114 We will be collecting data of the questionnaires and recording some experiments, do you agree with your experiment being recorded? All data excluding the recordings will be anonymised before analysis and storage. The recordings will not be shared with third parties. After the experiment you have the right to ask for information about the collected data and revoke the right to use it. We kindly ask you not to share any information about the experiment with other participants.
115 
Do you have any questions?
116
117 == After research interview ==
118
119 Setup:
120 The test subject has finished both parts of the experiment. Before leaving the test conductor(s) sit down with them and ask the following questions in a discussion about the experiment. Discussion can flow freely, but the following topics should be discussed.
121
122 Topics:
123 - Emotions before / during / after the interaction with the robot
124 - Agitation due to the robot suggesting eating
125 - Effect of music on the general feeling of the situation
126 - Feeling of company during eating
127 - Effectiveness of eating/drinking suggestions
128
129 Questions:
130 - Did you eat or drink anything during the experiment?
131 - Were you feeling hungry/thirsty beforehand and did the discourse change this?
132 - On a scale of 1-10, how likely would you have eaten/drank without the robot suggesting it?
133 - What did the interaction with the robot feel like?
134 - With the more intelligent version?
135 - With the less intelligent version?
136 - What did you feel like when the robot suggested you should eat/drink?