Changes for page Test

Last modified by Sofia Kostakonti on 2022/04/05 14:08

From version Icon 58.1 Icon
edited by Veikko Saikkonen
on 2022/04/01 14:35
Change comment: There is no comment for this version
To version Icon 69.1 Icon
edited by Veikko Saikkonen
on 2022/04/01 15:23
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -2,11 +2,13 @@
2 2  
3 3  People with dementia often forget to eat and drink, leading to dehydration, malnutrition and decreased wellbeing in general. Our prototype engages in discourses to remind PwD to have lunch and drink water, using the Nao robot platform. The discourse aims to reming the PwD without causing any anxiety or embarrassment which a traditional "alarm" system could cause, and keep them company throughout these activities.
4 4  
5 -RQ1: "Does the robot cause PwD to eat more regularly?"
6 -RQ2: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
7 -RQ3: "Does the robot remind the PwD of their hunger?"
8 -RQ4: "Does the music make the eating more enjoyable for the PwD?"
5 +RQ1: "Does the robot cause PwD to eat more regularly?"*
6 +RQ2: "Does the robot remind the PwD of their hunger?"
7 +RQ3: "Does the music make the eating more enjoyable for the PwD?"
8 +RQ4: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
9 9  
10 +'*' This research question is difficult due to the practical limitations in designing the experimental setup and as such is left to lesser importance.
11 +
10 10  = Method =
11 11  
12 12  The prototype is evaluated with an in-person experiment with multiple participants. In the experiment, the participants will be asked to pretend to be PwD and act accordingly with/without the prototype.
... ... @@ -95,8 +95,28 @@
95 95  {{/html}}
96 96  
97 97  (% style="text-align:center" %)
98 -Figure: Results on the eating of the test personas during the experiment
100 +Figure 1: Results on the eating of the test personas during the experiment
99 99  
102 +Simple robot:
103 +
104 +* 16% ate
105 +* 33% of those would not have eaten without the robot
106 +
107 +Advanced robot:
108 +
109 +* 32% ate
110 +* 67% of those would not have eaten without the robot
111 +
112 +== Music ==
113 +
114 +{{html}}
115 +<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
116 +{{/html}}
117 +
118 +(% style="text-align:center" %)
119 +Figure 2: Answers of the test personas regarding music
120 +
121 +
100 100  == EVEA (Mood) ==
101 101  
102 102  {{html}}
... ... @@ -104,7 +104,7 @@
104 104  {{/html}}
105 105  
106 106  (% style="text-align:center" %)
107 -Figure: Median measured moods for the simple version of the robot
129 +Figure 3: Median measured moods for the simple version of the robot
108 108  
109 109  {{html}}
110 110  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeSmart.png?rev=1.1" alt="Measured moods and changes for the advanced version of the robot" style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -111,10 +111,10 @@
111 111  {{/html}}
112 112  
113 113  (% style="text-align:center" %)
114 -Figure: Median measured moods for the advanced version of the robot
136 +Figure 4: Median measured moods for the advanced version of the robot
115 115  
116 116  (% style="text-align:center" %)
117 -Table: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
139 +Table 1: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
118 118  
119 119  |=Mood|=Happiness|=Anxiety|=Sadness|=Anger
120 120  |Statistic|37|5|4|14
... ... @@ -121,7 +121,7 @@
121 121  |P-value|0.54|0.01|0.01|0.45
122 122  
123 123  (% style="text-align:center" %)
124 -Table: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
146 +Table 2: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
125 125  
126 126  |=Mood|=Happiness|=Anxiety|=Sadness|=Anger
127 127  |Statistic|32|11|2|17
... ... @@ -128,7 +128,7 @@
128 128  |P-value|0.18|0.01|0.01|0.45
129 129  
130 130  (% style="text-align:center" %)
131 -Table: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
153 +Table 3: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
132 132  
133 133  |=Mood|=Anxiety|=Sadness|=Anger
134 134  |Statistic|81|53|29
... ... @@ -135,7 +135,7 @@
135 135  |P-value|0.01|0.00|0.23
136 136  
137 137  (% style="text-align:center" %)
138 -Table: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
160 +Table 4: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
139 139  
140 140  |=Mood|=Anxiety|=Sadness|=Anger
141 141  |Statistic|32|149|52
... ... @@ -142,7 +142,7 @@
142 142  |P-value|0.00|0.01|0.07
143 143  
144 144  (% style="text-align:center" %)
145 -Table: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
167 +Table 5: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
146 146  
147 147  |=Mood|=Happiness
148 148  |Statistic|37
... ... @@ -149,21 +149,12 @@
149 149  |P-value|0.27
150 150  
151 151  (% style="text-align:center" %)
152 -Table: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
174 +Table 6: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
153 153  
154 154  |=Mood|=Happiness
155 155  |Statistic|32
156 156  |P-value|0.09
157 157  
158 -== Music ==
159 -
160 -{{html}}
161 -<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
162 -{{/html}}
163 -
164 -(% style="text-align:center" %)
165 -Figure: Answers of the test personas regarding music
166 -
167 167  == Godspeed ==
168 168  
169 169  {{html}}
... ... @@ -171,7 +171,7 @@
171 171  {{/html}}
172 172  
173 173  (% style="text-align:center" %)
174 -Figure: Answers to the statement 'I thought the robot was friendly'
187 +Figure 5: Answers to the statement 'I thought the robot was friendly'
175 175  
176 176  {{html}}
177 177  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/pleasant-hist.png?rev=1.1" alt="Answers to the statement 'I thought the robot was pleasant'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -178,7 +178,7 @@
178 178  {{/html}}
179 179  
180 180  (% style="text-align:center" %)
181 -Figure: Answers to the statement 'I thought the robot was pleasant'
194 +Figure 6: Answers to the statement 'I thought the robot was pleasant'
182 182  
183 183  {{html}}
184 184  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/godspeed-barchart.png?rev=1.1" alt="Godspeed questionnaire median comparison'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -185,20 +185,32 @@
185 185  {{/html}}
186 186  
187 187  (% style="text-align:center" %)
188 -Figure: Median measured Godspeed questionnaire dimensions
201 +Figure 7: Median measured Godspeed questionnaire dimensions
189 189  
203 +
204 +(% style="text-align:center" %)
205 +Table 7: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
206 +
190 190  |=Dimension|=Likeability|=Intelligence
191 191  |Statistic|36|70
192 192  |P-value|0.01|0.17
193 193  
194 -(% style="text-align:center" %)
195 -Table: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
196 -
197 197  = Conclusions =
198 198  
199 -From the results we can see that the more advanced robot
213 +From the results we can see that the more advanced robot shows advantages over the simple version in many categories. Hints of better performance in other categories can be seen, but no conclusions should be drawn from the ones that lack the statistical significance.
200 200  
215 +In improving the eating, it seems that both robots have limited success in causing the people to eat as seen in Figure 1, they could cause the patients to eat more regularly, if triggered by timers or other suitable systems. It also seems that the advanced robot is better in the reminding, by a slight margin. However, the long term effects of reminding should be researched more to conclude whether the usage of the demonstrated robot platform or similar would cause the patients to eat more regularly. It is also unclear how the test setup and the limited choice of food affected the eating.
201 201  
217 +Based on the answers of the participants regarding music seen in Figure 2, it seems that most of them were either indifferent or liked the music. Also, as the test personnel find the advanced robot more likeable with a 5% confidence limit (Table 7), and the advanced version was the only version with music, it seems likely that the music does make the interaction more pleasant for the personas. However, some of the likeability might be due to the other advanced features of the robot and thus more research is needed to conclude the effect of the music.
218 +
219 +The EVEA and partial Godspeed result can be seen in Figures 3-7 and Tables 1-7. The results show that with reasonable confidence (5% confidence limit), both versions of the robot decreased sadness and anxiety in the test personas. Hints are shown (10% confidence limit) that the advanced robot also decreases feelings of anger and increases happiness, while the simple robot fails to show similar results. The choice to compare the changes happening during the interaction was to show the
220 +
221 +A Wilcoxon signed rank test for the partial Godspeed test shows in Table 7 that with high confidence (1% confidence limit), the intelligent robot is more likeable in comparison to the simple robot.
222 +
223 +
224 +
225 +
226 +
202 202  = Discussion =
203 203  
204 204