Changes for page Test

Last modified by Sofia Kostakonti on 2022/04/05 14:08

From 31.1 to 32.1 From 69.1 to 69.2

From version

32.1

edited by Veikko Saikkonen
on 2022/03/31 16:45

Change comment: There is no comment for this version

To version

69.1

edited by Veikko Saikkonen
on 2022/04/01 15:23

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (1 modified, 0 added, 0 removed)
Attachments (0 modified, 1 added, 0 removed)
- godspeed-barchart.png

Details

Page properties

Content

@@ -2,11 +2,13 @@
  People with dementia often forget to eat and drink, leading to dehydration, malnutrition and decreased wellbeing in general. Our prototype engages in discourses to remind PwD to have lunch and drink water, using the Nao robot platform. The discourse aims to reming the PwD without causing any anxiety or embarrassment which a traditional "alarm" system could cause, and keep them company throughout these activities.
--RQ1: "Does the robot cause PwD to eat more regularly?"
--RQ2: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
--RQ3: "Does the robot remind the PwD of their hunger?"
--RQ4: "Does the music make the eating more enjoyable for the PwD?"
++RQ1: "Does the robot cause PwD to eat more regularly?"*
++RQ2: "Does the robot remind the PwD of their hunger?"
++RQ3: "Does the music make the eating more enjoyable for the PwD?"
++RQ4: "Does the PwD experience less negative emotions, such as agitation, sadness, embarrassment, after the interaction with the 'intelligent' robot?"
++'*' This research question is difficult due to the practical limitations in designing the experimental setup and as such is left to lesser importance.
++
  = Method =
  The prototype is evaluated with an in-person experiment with multiple participants. In the experiment, the participants will be asked to pretend to be PwD and act accordingly with/without the prototype.
@@ -86,30 +86,146 @@
  = Results =
--% style="text-align:center" %
--- TODO: Add median emotion changes bar chart for smart and dumb (try out a difference graph as well)
++The results were gathered from 19 personnel, all of whom interacted first with one version of the robot and then the other. 10 of the participants interacted first with the simple version, nine having their first interaction with the advanced version.
++== Eating ==
++
  {{html}}
--<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeDumb.png?rev=1.1" alt="Measured moods and changes for the simple robot" style="display:block;margin-left:auto;margin-right:auto;width:750"/>
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/EatingComp.png?rev=1.1" alt="Results on the eating of the test personas" style="display:block;margin-left:auto;margin-right:auto" width=750/>
  {{/html}}
--Figure: Median measured moods for the simple version of the robot
++(% style="text-align:center" %)
++Figure 1: Results on the eating of the test personas during the experiment
--{{html}}<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeSmart.png?rev=1.1" alt="Measured moods and changes for the advanced version of the robot" width="750"/>{{/html}}
--Figure: Median measured moods for the advanced version of the robot
++Simple robot:
--- TODO: Add Wilcox test results for emotion changes
--- TODO: Add "I liked the music" and "I thought the music was calming" figures
--- TODO: Add "I thought the robot was pleasant." and "I thought the robot was friendly" figures
++* 16% ate
++* 33% of those would not have eaten without the robot
--= Discussion =
++Advanced robot:
++* 32% ate
++* 67% of those would not have eaten without the robot
++== Music ==
++{{html}}
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MusicEnjoyable.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=1250/>
++{{/html}}
++
++(% style="text-align:center" %)
++Figure 2: Answers of the test personas regarding music
++
++
++== EVEA (Mood) ==
++
++{{html}}
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeDumb.png?rev=1.1" alt="Measured moods and changes for the simple robot" style="display:block;margin-left:auto;margin-right:auto" width=750/>
++{{/html}}
++
++(% style="text-align:center" %)
++Figure 3: Median measured moods for the simple version of the robot
++
++{{html}}
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/MoodChangeSmart.png?rev=1.1" alt="Measured moods and changes for the advanced version of the robot" style="display:block;margin-left:auto;margin-right:auto" width=750/>
++{{/html}}
++
++(% style="text-align:center" %)
++Figure 4: Median measured moods for the advanced version of the robot
++
++(% style="text-align:center" %)
++Table 1: Wilcoxon signed rank test results for the hypothesis that the mood changed during the interaction with the simple robot
++
++|=Mood|=Happiness|=Anxiety|=Sadness|=Anger
++|Statistic|37|5|4|14
++|P-value|0.54|0.01|0.01|0.45
++
++(% style="text-align:center" %)
++Table 2: Wilcoxon signed rank test results for the null hypothesis that the mood changed during the interaction with the advanced robot
++
++|=Mood|=Happiness|=Anxiety|=Sadness|=Anger
++|Statistic|32|11|2|17
++|P-value|0.18|0.01|0.01|0.45
++
++(% style="text-align:center" %)
++Table 3: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the simple robot
++
++|=Mood|=Anxiety|=Sadness|=Anger
++|Statistic|81|53|29
++|P-value|0.01|0.00|0.23
++
++(% style="text-align:center" %)
++Table 4: Wilcoxon signed rank test results for the null hypothesis that the mood decreased during the interaction with the advanced robot
++
++|=Mood|=Anxiety|=Sadness|=Anger
++|Statistic|32|149|52
++|P-value|0.00|0.01|0.07
++
++(% style="text-align:center" %)
++Table 5: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the simple robot
++
++|=Mood|=Happiness
++|Statistic|37
++|P-value|0.27
++
++(% style="text-align:center" %)
++Table 6: Wilcoxon signed rank test results for the null hypothesis that the mood increased during the interaction with the advanced robot
++
++|=Mood|=Happiness
++|Statistic|32
++|P-value|0.09
++
++== Godspeed ==
++
++{{html}}
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/friendly-hist.png?rev=1.1" alt="Effects of music on the test personnel" style="display:block;margin-left:auto;margin-right:auto" width=750/>
++{{/html}}
++
++(% style="text-align:center" %)
++Figure 5: Answers to the statement 'I thought the robot was friendly'
++
++{{html}}
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/pleasant-hist.png?rev=1.1" alt="Answers to the statement 'I thought the robot was pleasant'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
++{{/html}}
++
++(% style="text-align:center" %)
++Figure 6: Answers to the statement 'I thought the robot was pleasant'
++
++{{html}}
++<img src="https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group01/download/Test/WebHome/godspeed-barchart.png?rev=1.1" alt="Godspeed questionnaire median comparison'." style="display:block;margin-left:auto;margin-right:auto" width=750/>
++{{/html}}
++
++(% style="text-align:center" %)
++Figure 7: Median measured Godspeed questionnaire dimensions
++
++
++(% style="text-align:center" %)
++Table 7: Wilcoxon signed rank test results for the null hypothesis that the advanced robot scored higher in the perceived dimensions
++
++|=Dimension|=Likeability|=Intelligence
++|Statistic|36|70
++|P-value|0.01|0.17
++
  = Conclusions =
--The experiment showed promising results and encourages more research into the subject.
++From the results we can see that the more advanced robot shows advantages over the simple version in many categories. Hints of better performance in other categories can be seen, but no conclusions should be drawn from the ones that lack the statistical significance.
++In improving the eating, it seems that both robots have limited success in causing the people to eat as seen in Figure 1, they could cause the patients to eat more regularly, if triggered by timers or other suitable systems. It also seems that the advanced robot is better in the reminding, by a slight margin. However, the long term effects of reminding should be researched more to conclude whether the usage of the demonstrated robot platform or similar would cause the patients to eat more regularly. It is also unclear how the test setup and the limited choice of food affected the eating.
++
++Based on the answers of the participants regarding music seen in Figure 2, it seems that most of them were either indifferent or liked the music. Also, as the test personnel find the advanced robot more likeable with a 5% confidence limit (Table 7), and the advanced version was the only version with music, it seems likely that the music does make the interaction more pleasant for the personas. However, some of the likeability might be due to the other advanced features of the robot and thus more research is needed to conclude the effect of the music.
++
++The EVEA and partial Godspeed result can be seen in Figures 3-7 and Tables 1-7. The results show that with reasonable confidence (5% confidence limit), both versions of the robot decreased sadness and anxiety in the test personas. Hints are shown (10% confidence limit) that the advanced robot also decreases feelings of anger and increases happiness, while the simple robot fails to show similar results. The choice to compare the changes happening during the interaction was to show the
++
++A Wilcoxon signed rank test for the partial Godspeed test shows in Table 7 that with high confidence (1% confidence limit), the intelligent robot is more likeable in comparison to the simple robot.
++
++
++
++
++
++= Discussion =
++
++
++
  = Appendix =
  == Experiment introduction for participants ==

godspeed-barchart.png

Author

...	...	@@ -1,0 +1,1 @@
	1	+XWiki.VSaikkonen

Size

...	...	@@ -1,0 +1,1 @@
	1	+15.9 KB

Content