Skip to Content

Changes for page Test

Last modified by Clara Stiller on 2022/04/05 13:44
From version Icon 42.1 Icon
edited by Clara Stiller
on 2022/03/27 14:04
Change comment: There is no comment for this version
To version Icon 52.2 Icon
edited by Clara Stiller
on 2022/03/27 16:23
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -101,7 +101,25 @@
101 101  
102 102  
103 103  = Results =
104 +=== Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype ===
104 104  
106 +{{html}}
107 +<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Stay_inside.svg" width="500" height="270" />
108 +{{/html}}
109 +
110 +Non of the participants who interacted with the less intelligent robot was prevented from leaving. Still, 3 people assigned to condition 1 weren't convinced to stay inside. A failure rate of 27,3 % is too high for this application since people could be in danger if the system fails.
111 +
112 +**Mood evolution**
113 +[[image:mood_only.png||height="150"]]
114 +
115 +{{html}}<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/mood_before.svg" width="500" height="270" /><br>
116 +<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/mood_after.svg" width="500" height="270" /><br>{{/html}}
117 +
118 +Regarding the changes in mood, 4 out of 11 participants assigned to condition 1 had an increase in mood throughout the interaction. Only one participant felt less happy afterward, the rest stayed at the same level of happiness. The overall mood shifted to happier in general (as you can see in the graphic above), even though only small improvements in mood were detected (<= 2 steps on the scale).
119 +The participants from condition 2 mostly stayed at the same mood level, 2 were less happy, one participant was happier afterward. Comparing both conditions it becomes clear, that condition 1 had a more positive impact on the participant's mood.
120 +
121 +Interesting is also, none of the participants was in a really bad mood at the beginning or end.
122 +
105 105  ==== Condition 1 - intelligent Prototype: ====
106 106  
107 107  {{html}}
... ... @@ -118,22 +118,13 @@
118 118  Only 4 out of 11 people agreed, that the music fits the situation. One of our claims, to use music that fits the situation or place, is therefore not reached and the music didn't have the intended effect. Even though we carefully choose the music and discussed a lot about our choice, it was hard to find music that different people connect with a certain place or activity. An approach to improve this could be using an individual playlist for each participant.
119 119  
120 120  
121 -
122 122  ==== Condition 2 - less intelligent prototype: ====
123 123  
124 124  Participants assigned to condition 2 weren't convinced to leave. We saw, that most of them tried to continue talking to pepper when it raises its arm to block the door, even though it didn't listen. They were surprised by peppers reaction and asked for a reason why they are not allowed to leave. In order to have a natural conversation flow, the robot should provide an explanation for each scenario that tells why the person is not allowed to leave. This confirms that our approach, to give reason to stay inside, might be helpful to convince PwD to stay inside.
125 125  
126 -=== Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype ===
127 127  
128 -{{html}}
129 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Stay_inside.svg" width="500" height="270" />
130 -{{/html}}
144 +=== Problems that occurred during the evaluation ===
131 131  
132 -Non of the participants who interacted with the less intelligent robot was prevented from leaving. Still, 3 people assigned to condition 1 weren't convinced to stay inside. A failure rate of 27,3 % is too high for this application since people could be in danger if the system fails.
133 -
134 -
135 -==== Problems that occurred during the evaluation ====
136 -
137 137  1. lots of difficulties with speech recognition:
138 138  1.1. even though the participant said one of the expected words, pepper understood it wrong and continued with a wrong path
139 139  1.2. If the participant started to talk before pepper was listening (eyes turning blue), it misses a "yes" or "no" at the beginning of the sentence, which causes misunderstandings.
... ... @@ -155,7 +155,14 @@
155 155  
156 156  
157 157  
167 += Limitation=
158 158  
169 +* participants don't have dementia, only playing the role of having it. --> it's hard to play someone starting to wander
170 +* issues with speech recognition leads to "wrong" dialogues and unintended behavior of the robot
171 +* unsuitable environment confused participants in how they should continue, they might have done something else, if they would know where to do the provided activities
172 +
173 +
174 +
159 159  = Conclusions =
160 160  
161 161  just some notes...
Icon mood.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.ClaraStiller
Size
... ... @@ -1,0 +1,1 @@
1 +7.0 KB
Content
... ... @@ -1,0 +1,1 @@
1 +<svg width="1653" height="993" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" overflow="hidden"><defs><clipPath id="clip0"><rect x="754" y="261" width="1653" height="993"/></clipPath><clipPath id="clip1"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip2"><rect x="941" y="432" width="1417" height="515"/></clipPath><clipPath id="clip3"><rect x="941" y="432" width="1417" height="515"/></clipPath><clipPath id="clip4"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip5"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip6"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip7"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip8"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip9"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip10"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip11"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip12"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip13"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip14"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip15"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip16"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip17"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip18"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip19"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip20"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip21"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip22"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip23"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip24"><rect x="755" y="262" width="1650" height="990"/></clipPath></defs><g clip-path="url(#clip0)" transform="translate(-754 -261)"><rect x="755" y="262" width="1650" height="990" fill="#FFFFFF"/><g clip-path="url(#clip1)"><path d="M941.5 858.528 2354.5 858.528M941.5 773.526 2354.5 773.526M941.5 688.523 2354.5 688.523M941.5 602.52 2354.5 602.52M941.5 517.517 2354.5 517.517M941.5 432.5 2354.5 432.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g><g clip-path="url(#clip2)"><path d="M999.033 773.025 1052.03 773.025 1052.03 944 999.033 944ZM1235.04 859.028 1287.04 859.028 1287.04 944 1235.04 944ZM1706.06 518.017 1759.06 518.017 1759.06 944 1706.06 944ZM1941.06 773.025 1994.07 773.025 1994.07 944 1941.06 944ZM2177.07 859.028 2230.07 859.028 2230.07 944 2177.07 944Z" fill="#009999"/></g><g clip-path="url(#clip3)"><path d="M1066.03 518.017 1119.04 518.017 1119.04 944 1066.03 944ZM1302.04 859.028 1355.04 859.028 1355.04 944 1302.04 944Z" fill="#ED7D31"/></g><g clip-path="url(#clip4)"><path d="M941.5 944.5 2354.5 944.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none" fill-rule="evenodd"/></g><g clip-path="url(#clip5)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 956)">0</text></g><g clip-path="url(#clip6)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 870)">1</text></g><g clip-path="url(#clip7)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 785)">2</text></g><g clip-path="url(#clip8)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 700)">3</text></g><g clip-path="url(#clip9)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 614)">4</text></g><g clip-path="url(#clip10)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 529)">5</text></g><g clip-path="url(#clip11)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 444)">6</text></g><g clip-path="url(#clip12)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 960.153 1009)">1 - Disagree</text></g><g clip-path="url(#clip13)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1284.16 1009)">2</text></g><g clip-path="url(#clip14)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1519.73 1009)">3</text></g><g clip-path="url(#clip15)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1755.31 1009)">4</text></g><g clip-path="url(#clip16)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1925.86 1009)">5 - Agree</text></g><g clip-path="url(#clip17)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2173.02 1009)">no data</text></g><g clip-path="url(#clip18)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(6.12323e-17 -1 1 6.12323e-17 856.396 905)">Number of participants</text></g><g clip-path="url(#clip19)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(1 0 0 1 1468.51 1078)">Level of agreement</text></g><g clip-path="url(#clip20)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="64" transform="matrix(1 0 0 1 1147.96 358)">Are you convinced to stay inside?</text></g><g clip-path="url(#clip21)"><rect x="1340" y="1175" width="23" height="23" fill="#009999"/></g><g clip-path="url(#clip22)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1372.39 1198)">Condition 1</text></g><g clip-path="url(#clip23)"><rect x="1611" y="1175" width="22" height="23" fill="#ED7D31"/></g><g clip-path="url(#clip24)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1643.06 1198)">Condition 2</text></g><rect x="755.5" y="262.5" width="1650" height="990" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g></svg>
Icon mood_after.svg
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.ClaraStiller
Size
... ... @@ -1,0 +1,1 @@
1 +7.3 KB
Content Icon
Icon mood_before.svg
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.ClaraStiller
Size
... ... @@ -1,0 +1,1 @@
1 +7.1 KB
Content Icon
Icon mood_only.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.ClaraStiller
Size
... ... @@ -1,0 +1,1 @@
1 +228.5 KB
Content Icon