Changes for page Test

Last modified by Sofia Kostakonti on 2022/04/05 14:08

From version Icon 72.1 Icon
edited by Veikko Saikkonen
on 2022/04/01 15:39
Change comment: There is no comment for this version
To version Icon 61.1 Icon
edited by Veikko Saikkonen
on 2022/04/01 14:49
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -97,8 +97,12 @@
97 97  {{/html}}
98 98  
99 99  (% style="text-align:center" %)
100 -Figure 1: Results on the eating of the test personas during the experiment
100 +Figure: Results on the eating of the test personas during the experiment
101 101  
102 +|=Version|=Did not eat|=Ate|=Would not have eaten without the robot|\\
103 +|Simple|16|3|1
104 +|Advanced|13|6|4
105 +
102 102  Simple robot:
103 103  
104 104  * 16% ate
... ... @@ -109,16 +109,6 @@
109 109  * 32% ate
110 110  * 67% of those would not have eaten without the robot
111 111  
112 -== Music ==
113 -
114 -{{html}}
115 -<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
116 -{{/html}}
117 -
118 -(% style="text-align:center" %)
119 -Figure 2: Answers of the test personas regarding music
120 -
121 -
122 122  == EVEA (Mood) ==
123 123  
124 124  {{html}}
... ... @@ -126,7 +126,7 @@
126 126  {{/html}}
127 127  
128 128  (% style="text-align:center" %)
129 -Figure 3: Median measured moods for the simple version of the robot
123 +Figure: Median measured moods for the simple version of the robot
130 130  
131 131  {{html}}
132 132  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeSmart.png?rev=1.1" alt="Measured moods and changes for the advanced version of the robot" style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -133,10 +133,10 @@
133 133  {{/html}}
134 134  
135 135  (% style="text-align:center" %)
136 -Figure 4: Median measured moods for the advanced version of the robot
130 +Figure: Median measured moods for the advanced version of the robot
137 137  
138 138  (% style="text-align:center" %)
139 -Table 1: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
133 +Table: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
140 140  
141 141  |=Mood|=Happiness|=Anxiety|=Sadness|=Anger
142 142  |Statistic|37|5|4|14
... ... @@ -143,7 +143,7 @@
143 143  |P-value|0.54|0.01|0.01|0.45
144 144  
145 145  (% style="text-align:center" %)
146 -Table 2: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
140 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
147 147  
148 148  |=Mood|=Happiness|=Anxiety|=Sadness|=Anger
149 149  |Statistic|32|11|2|17
... ... @@ -150,7 +150,7 @@
150 150  |P-value|0.18|0.01|0.01|0.45
151 151  
152 152  (% style="text-align:center" %)
153 -Table 3: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
147 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
154 154  
155 155  |=Mood|=Anxiety|=Sadness|=Anger
156 156  |Statistic|81|53|29
... ... @@ -157,7 +157,7 @@
157 157  |P-value|0.01|0.00|0.23
158 158  
159 159  (% style="text-align:center" %)
160 -Table 4: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
154 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
161 161  
162 162  |=Mood|=Anxiety|=Sadness|=Anger
163 163  |Statistic|32|149|52
... ... @@ -164,7 +164,7 @@
164 164  |P-value|0.00|0.01|0.07
165 165  
166 166  (% style="text-align:center" %)
167 -Table 5: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
161 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
168 168  
169 169  |=Mood|=Happiness
170 170  |Statistic|37
... ... @@ -171,19 +171,21 @@
171 171  |P-value|0.27
172 172  
173 173  (% style="text-align:center" %)
174 -Table 6: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
168 +Table: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
175 175  
176 176  |=Mood|=Happiness
177 177  |Statistic|32
178 178  |P-value|0.09
179 179  
180 -(% style="text-align:center" %)
181 -Table 7: Wilcoxon signed rank test results for the hypothesis that the mood changes with the simple and advanced robots during the interaction are different
174 +== Music ==
182 182  
183 -|=Mood|=Happiness|=Anxiety|=Sadness|=Anger
184 -|Statistic|92|49|85|69
185 -|P-value|0.92|0.07|0.71|0.31
176 +{{html}}
177 +<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
178 +{{/html}}
186 186  
180 +(% style="text-align:center" %)
181 +Figure: Answers of the test personas regarding music
182 +
187 187  == Godspeed ==
188 188  
189 189  {{html}}
... ... @@ -191,7 +191,7 @@
191 191  {{/html}}
192 192  
193 193  (% style="text-align:center" %)
194 -Figure 5: Answers to the statement 'I thought the robot was friendly'
190 +Figure: Answers to the statement 'I thought the robot was friendly'
195 195  
196 196  {{html}}
197 197  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/pleasant-hist.png?rev=1.1" alt="Answers to the statement 'I thought the robot was pleasant'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -198,7 +198,7 @@
198 198  {{/html}}
199 199  
200 200  (% style="text-align:center" %)
201 -Figure 6: Answers to the statement 'I thought the robot was pleasant'
197 +Figure: Answers to the statement 'I thought the robot was pleasant'
202 202  
203 203  {{html}}
204 204  <img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/godspeed-barchart.png?rev=1.1" alt="Godspeed questionnaire median comparison'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
... ... @@ -205,36 +205,24 @@
205 205  {{/html}}
206 206  
207 207  (% style="text-align:center" %)
208 -Figure 7: Median measured Godspeed questionnaire dimensions
204 +Figure: Median measured Godspeed questionnaire dimensions
209 209  
210 -
211 -(% style="text-align:center" %)
212 -Table 8: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
213 -
214 214  |=Dimension|=Likeability|=Intelligence
215 215  |Statistic|36|70
216 216  |P-value|0.01|0.17
217 217  
218 -= Discussion =
219 -Analysis the results surfaced some minor issues in the experiment, such as the lack of comparison with two robots of similar features, with and without music. Also the practical limitations in the setup, such as the lack of different food options and some participants being aware of the design goals of the prototype could have interfered with the natural flow of the intercourse. With these limitations, the research method was successful in extracting differences within the robots and brought up additional directions for future research.
210 +(% style="text-align:center" %)
211 +Table: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
220 220  
221 -The most interesting direction for future research would be the longer term studying of the effect of mealtime reminders on the health of the test subjects. The longer term health study would uncover the effect on eating frequency and the development of the relationship with the robot, for example would the test subjects that were first excited about the novel interaction with the robot, develop negative feelings about the supervision that the robot is conducting into their personal life.
222 -
223 -Another topic to study is the differences with and without music. The effects of music could be studied with the music tailored to personal taste and all versions of the robot with and without the music playback included in the interaction. This would allow to pinpoint the effects of music, without the other features causing variance.
224 -
225 225  = Conclusions =
226 226  
227 -From the results we can see that the more advanced robot shows advantages over the simple version in many categories. Hints of better performance in other categories can be seen, but no conclusions should be drawn from the ones that lack the statistical significance.
215 +From the results we can see that the more advanced robot
228 228  
229 -In improving the eating, it seems that both robots have limited success in causing the people to eat as seen in Figure 1, they could cause the patients to eat more regularly, if triggered by timers or other suitable systems. It also seems that the advanced robot is better in the reminding, by a slight margin. However, the long term effects of reminding should be researched more to conclude whether the usage of the demonstrated robot platform or similar would cause the patients to eat more regularly. It is also unclear how the test setup and the limited choice of food affected the eating.
230 230  
231 -Based on the answers of the participants regarding music seen in Figure 2, it seems that most of them were either indifferent or liked the music. Also, as the test personnel find the advanced robot more likeable with a 5% confidence limit (Table 7), and the advanced version was the only version with music, it seems likely that the music does make the interaction more pleasant for the personas. However, some of the likeability might be due to the other advanced features of the robot and thus more research is needed to conclude the effect of the music.
218 += Discussion =
232 232  
233 -The EVEA and partial Godspeed result can be seen in Figures 3-7 and Tables 1-8. The results show that with reasonable confidence (5% confidence limit), both versions of the robot decreased sadness and anxiety in the test personas. Hints are shown (10% confidence limit) that the advanced robot also decreases feelings of anger and increases happiness, while the simple robot fails to show similar results. However, in Table 7 we can see that the statistical differences in the mood differences during the interactions with the different versions are not highly significant.
234 234  
235 -A Wilcoxon signed rank test for the partial Godspeed test shows in Table 8 that with high confidence (1% confidence limit), the intelligent robot is more likeable in comparison to the simple robot. With these results it is likely that the more advanced robot is slightly preferrable and the personas might experience less negative emotions after the interaction with the robots, but it is slightly unclear if the effect is more powerful with the advanced robot.
236 236  
237 -
238 238  = Appendix =
239 239  
240 240  == Experiment introduction for participants ==