Changes for page Test

Last modified by Sofia Kostakonti on 2022/04/05 14:08

From version Icon 69.2 Icon
edited by Veikko Saikkonen
on 2022/04/01 15:24
Change comment: There is no comment for this version
To version Icon 59.1 Icon
edited by Veikko Saikkonen
on 2022/04/01 14:43
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -2,13 +2,11 @@
2 2  
3 3  People with dementia often forget to eat and drink, leading to dehydration, malnutrition and decreased wellbeing in general. Our prototype engages in discourses to remind PwD to have lunch and drink water, using the Nao robot platform. The discourse aims to reming the PwD without causing any anxiety or embarrassment which a traditional "alarm" system could cause, and keep them company throughout these activities.
4 4  
5 -RQ1: "Does the robot cause PwD to eat more regularly?"*
6 -RQ2: "Does the robot remind the PwD of their hunger?"
7 -RQ3: "Does the music make the eating more enjoyable for the PwD?"
8 -RQ4: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
5 +RQ1: "Does the robot cause PwD to eat more regularly?"
6 +RQ2: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
7 +RQ3: "Does the robot remind the PwD of their hunger?"
8 +RQ4: "Does the music make the eating more enjoyable for the PwD?"
9 9  
10 -'*' This research question is difficult due to the practical limitations in designing the experimental setup and as such is left to lesser importance.
11 -
12 12  = Method =
13 13  
14 14  The prototype is evaluated with an in-person experiment with multiple participants. In the experiment, the participants will be asked to pretend to be PwD and act accordingly with/without the prototype.
... ... @@ -97,8 +97,12 @@
97 97  {{/html}}
98 98  
99 99  (% style="text-align:center" %)
100 -Figure 1: Results on the eating of the test personas during the experiment
98 +Figure: Results on the eating of the test personas during the experiment
101 101  
100 +|=Version|=Did not eat|=Ate|=Would not have eaten without the robot|\\
101 +|Simple|16|3|1
102 +|Advanced|13|6|4
103 +
102 102  Simple robot:
103 103  
104 104  * 16% ate
... ... @@ -109,16 +109,6 @@
109 109  * 32% ate
110 110  * 67% of those would not have eaten without the robot
111 111  
112 -== Music ==
113 -
114 -{{html}}
115 -<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
116 -{{/html}}
117 -
118 -(% style="text-align:center" %)
119 -Figure 2: Answers of the test personas regarding music
120 -
121 -
122 122  == EVEA (Mood) ==
123 123  
124 124  {{html}}
... ... @@ -126,7 +126,7 @@
126 126  {{/html}}
127 127  
128 128  (% style="text-align:center" %)
129 -Figure 3: Median measured moods for the simple version of the robot
121 +Figure: Median measured moods for the simple version of the robot
130 130  
131 131  {{html}}
132 132  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeSmart.png?rev=1.1" alt="Measured moods and changes for the advanced version of the robot" style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -133,10 +133,10 @@
133 133  {{/html}}
134 134  
135 135  (% style="text-align:center" %)
136 -Figure 4: Median measured moods for the advanced version of the robot
128 +Figure: Median measured moods for the advanced version of the robot
137 137  
138 138  (% style="text-align:center" %)
139 -Table 1: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
131 +Table: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
140 140  
141 141  |=Mood|=Happiness|=Anxiety|=Sadness|=Anger
142 142  |Statistic|37|5|4|14
... ... @@ -143,7 +143,7 @@
143 143  |P-value|0.54|0.01|0.01|0.45
144 144  
145 145  (% style="text-align:center" %)
146 -Table 2: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
138 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
147 147  
148 148  |=Mood|=Happiness|=Anxiety|=Sadness|=Anger
149 149  |Statistic|32|11|2|17
... ... @@ -150,7 +150,7 @@
150 150  |P-value|0.18|0.01|0.01|0.45
151 151  
152 152  (% style="text-align:center" %)
153 -Table 3: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
145 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
154 154  
155 155  |=Mood|=Anxiety|=Sadness|=Anger
156 156  |Statistic|81|53|29
... ... @@ -157,7 +157,7 @@
157 157  |P-value|0.01|0.00|0.23
158 158  
159 159  (% style="text-align:center" %)
160 -Table 4: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
152 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
161 161  
162 162  |=Mood|=Anxiety|=Sadness|=Anger
163 163  |Statistic|32|149|52
... ... @@ -164,7 +164,7 @@
164 164  |P-value|0.00|0.01|0.07
165 165  
166 166  (% style="text-align:center" %)
167 -Table 5: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
159 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
168 168  
169 169  |=Mood|=Happiness
170 170  |Statistic|37
... ... @@ -171,19 +171,21 @@
171 171  |P-value|0.27
172 172  
173 173  (% style="text-align:center" %)
174 -Table 6: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
166 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
175 175  
176 176  |=Mood|=Happiness
177 177  |Statistic|32
178 178  |P-value|0.09
179 179  
180 -(% style="text-align:center" %)
181 -Table 7: Wilcoxon signed rank test results for the hypothesis that the mood changes with the simple and advanced robots during the interaction are different
172 +== Music ==
182 182  
183 -|=Mood|=Happiness|=Anxiety|=Sadness|=Anger
184 -|Statistic|92|49|85|69
185 -|P-value|0.92|0.07|0.71|0.31
174 +{{html}}
175 +<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
176 +{{/html}}
186 186  
178 +(% style="text-align:center" %)
179 +Figure: Answers of the test personas regarding music
180 +
187 187  == Godspeed ==
188 188  
189 189  {{html}}
... ... @@ -191,7 +191,7 @@
191 191  {{/html}}
192 192  
193 193  (% style="text-align:center" %)
194 -Figure 5: Answers to the statement 'I thought the robot was friendly'
188 +Figure: Answers to the statement 'I thought the robot was friendly'
195 195  
196 196  {{html}}
197 197  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/pleasant-hist.png?rev=1.1" alt="Answers to the statement 'I thought the robot was pleasant'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -198,7 +198,7 @@
198 198  {{/html}}
199 199  
200 200  (% style="text-align:center" %)
201 -Figure 6: Answers to the statement 'I thought the robot was pleasant'
195 +Figure: Answers to the statement 'I thought the robot was pleasant'
202 202  
203 203  {{html}}
204 204  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/godspeed-barchart.png?rev=1.1" alt="Godspeed questionnaire median comparison'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -205,32 +205,20 @@
205 205  {{/html}}
206 206  
207 207  (% style="text-align:center" %)
208 -Figure 7: Median measured Godspeed questionnaire dimensions
202 +Figure: Median measured Godspeed questionnaire dimensions
209 209  
210 -
211 -(% style="text-align:center" %)
212 -Table 7: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
213 -
214 214  |=Dimension|=Likeability|=Intelligence
215 215  |Statistic|36|70
216 216  |P-value|0.01|0.17
217 217  
208 +(% style="text-align:center" %)
209 +Table: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
210 +
218 218  = Conclusions =
219 219  
220 -From the results we can see that the more advanced robot shows advantages over the simple version in many categories. Hints of better performance in other categories can be seen, but no conclusions should be drawn from the ones that lack the statistical significance.
213 +From the results we can see that the more advanced robot
221 221  
222 -In improving the eating, it seems that both robots have limited success in causing the people to eat as seen in Figure 1, they could cause the patients to eat more regularly, if triggered by timers or other suitable systems. It also seems that the advanced robot is better in the reminding, by a slight margin. However, the long term effects of reminding should be researched more to conclude whether the usage of the demonstrated robot platform or similar would cause the patients to eat more regularly. It is also unclear how the test setup and the limited choice of food affected the eating.
223 223  
224 -Based on the answers of the participants regarding music seen in Figure 2, it seems that most of them were either indifferent or liked the music. Also, as the test personnel find the advanced robot more likeable with a 5% confidence limit (Table 7), and the advanced version was the only version with music, it seems likely that the music does make the interaction more pleasant for the personas. However, some of the likeability might be due to the other advanced features of the robot and thus more research is needed to conclude the effect of the music.
225 -
226 -The EVEA and partial Godspeed result can be seen in Figures 3-7 and Tables 1-7. The results show that with reasonable confidence (5% confidence limit), both versions of the robot decreased sadness and anxiety in the test personas. Hints are shown (10% confidence limit) that the advanced robot also decreases feelings of anger and increases happiness, while the simple robot fails to show similar results. The choice to compare the changes happening during the interaction was to show the
227 -
228 -A Wilcoxon signed rank test for the partial Godspeed test shows in Table 7 that with high confidence (1% confidence limit), the intelligent robot is more likeable in comparison to the simple robot.
229 -
230 -
231 -
232 -
233 -
234 234  = Discussion =
235 235  
236 236