Skip to Content

Changes for page Test

Last modified by Clara Stiller on 2022/04/05 13:44
From version Icon 45.1 Icon
edited by Clara Stiller
on 2022/03/27 15:25
Change comment: There is no comment for this version
To version Icon 40.1 Icon
edited by Clara Stiller
on 2022/03/27 14:00
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -16,6 +16,7 @@
16 16  1. Does the activity that the robot suggests prevent people from wandering/ leaving? (CL06)
17 17  1. Can pepper identify and catch the attention of the PwD?
18 18  
19 +
19 19  //Future research questions//
20 20  
21 21  1. Does the interaction with Pepper make PwD come back to reality? (CL08)
... ... @@ -102,42 +102,35 @@
102 102  
103 103  = Results =
104 104  
105 -==== Condition 1 - intelligent Prototype: ====
106 +**Results from Questionnaire:**
106 106  
107 -{{html}}
108 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Music_reco.svg" width="500" height="270" /> <br>
109 -{{/html}}
108 +1. Condition 1 - intelligent Prototype:
109 +{{html}}<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Music_reco.svg" width="500" height="270" /> <br>{{/html}}
110 110  
111 111  8 out of 11 Participants answered, that they don't know the music that has been played. If we told them afterward the title of the song, most participants do know the song. Why didn't they recognize it during the interaction?
112 112  This can have two reasons: The part of the song we pick was too short to be recognized or not the most significant part of the song. For example, the beginning of "escape - the pina colada song" is not as well known as its chorus. Another reason could be, that the participant was distracted or confused by the robot and therefore couldn't carefully listen to the music.
113 +Only 4 out of 11 people agreed, that the music fits the situation. One of our claims, to use music that fits the situation or place, is therefore not reached and the music didn't have the intended effect. Even though we carefully choose the music and discussed a lot about our choice, it was hard to find music that different people connect with a certain place or activity. An approach to improve this could be using an individual playlist for each participant.
113 113  
114 114  {{html}}
115 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Music_fit.svg" width="500" height="270" /> <br>
116 +<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Music_fit.svg" width="500" height="270" />
116 116  {{/html}}
117 117  
118 -Only 4 out of 11 people agreed, that the music fits the situation. One of our claims, to use music that fits the situation or place, is therefore not reached and the music didn't have the intended effect. Even though we carefully choose the music and discussed a lot about our choice, it was hard to find music that different people connect with a certain place or activity. An approach to improve this could be using an individual playlist for each participant.
119 +Still, for most participants the music was suitable to that situation.
120 +
119 119  
122 +1. Condition 2 - less intelligent prototype:
120 120  
121 121  
122 -==== Condition 2 - less intelligent prototype: ====
125 +**Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype**
123 123  
124 -Participants assigned to condition 2 weren't convinced to leave. We saw, that most of them tried to continue talking to pepper when it raises its arm to block the door, even though it didn't listen. They were surprised by peppers reaction and asked for a reason why they are not allowed to leave. In order to have a natural conversation flow, the robot should provide an explanation for each scenario that tells why the person is not allowed to leave. This confirms that our approach, to give reason to stay inside, might be helpful to convince PwD to stay inside.
125 -
126 -=== Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype ===
127 -
128 -{{html}}
129 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Stay_inside.svg" width="500" height="270" />
130 -{{/html}}
131 -
127 +{{html}}<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Stay_inside.svg" width="500" height="270" />{{/html}}
132 132  Non of the participants who interacted with the less intelligent robot was prevented from leaving. Still, 3 people assigned to condition 1 weren't convinced to stay inside. A failure rate of 27,3 % is too high for this application since people could be in danger if the system fails.
133 133  
134 134  
135 -Mood evolution
136 -[[image:Mood.png||height="300"]]
137 137  
138 -Condition 1: Improvement in 4 cases,
139 139  
140 -=== Problems that occurred during the evaluation ===
133 +**Observations:**
134 +Problems that occurred during the evaluation
141 141  
142 142  1. lots of difficulties with speech recognition:
143 143  1.1. even though the participant said one of the expected words, pepper understood it wrong and continued with a wrong path
... ... @@ -152,8 +152,9 @@
152 152  The reasons for failure in speech recognition are listed above. An unsuitable answer can e.g. be an argument to stay inside, that doesn't fit the participant's reason to leave. Also, some people told in a long sentence that they don't like the provided activity and still want to leave. If the speech recognition fails in this case and pepper understood you would like to do the activity, it seems like it encourages you to leave, instead of doing the activity. This leads to the total opposite of our intention.
153 153  Furthermore, we found out, that our prototype doesn't fit in the environment of the lab. We encourage the participant to do some activities, that they can't do in the lab environment (go to the living room, have a coffee or do a puzzle). If the robot tells asks you if you want to do the activity, most people don't know how to react and are insecure about how to answer. Participants "freeze" in front of the robot or just left the room.
154 154  
149 +Condition 2:
150 +Participants assigned to condition 2 weren't convinced to leave. We saw, that most of them tried to continue talking to pepper when it raises its arm to block the door, even though it didn't listen. They were surprised by peppers reaction and asked for a reason why they are not allowed to leave. In order to have a natural conversation flow, the robot should provide an explanation for each scenario that tells why the person is not allowed to leave. This confirms that our approach, to give reason to stay inside, might be helpful to convince PwD to stay inside.
155 155  
156 -
157 157  = Discussion =
158 158  
159 159  
Icon mood.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.ClaraStiller
Size
... ... @@ -1,1 +1,0 @@
1 -7.0 KB
Content
... ... @@ -1,1 +1,0 @@
1 -<svg width="1653" height="993" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" overflow="hidden"><defs><clipPath id="clip0"><rect x="754" y="261" width="1653" height="993"/></clipPath><clipPath id="clip1"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip2"><rect x="941" y="432" width="1417" height="515"/></clipPath><clipPath id="clip3"><rect x="941" y="432" width="1417" height="515"/></clipPath><clipPath id="clip4"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip5"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip6"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip7"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip8"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip9"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip10"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip11"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip12"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip13"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip14"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip15"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip16"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip17"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip18"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip19"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip20"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip21"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip22"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip23"><rect x="755" y="262" width="1650" height="990"/></clipPath><clipPath id="clip24"><rect x="755" y="262" width="1650" height="990"/></clipPath></defs><g clip-path="url(#clip0)" transform="translate(-754 -261)"><rect x="755" y="262" width="1650" height="990" fill="#FFFFFF"/><g clip-path="url(#clip1)"><path d="M941.5 858.528 2354.5 858.528M941.5 773.526 2354.5 773.526M941.5 688.523 2354.5 688.523M941.5 602.52 2354.5 602.52M941.5 517.517 2354.5 517.517M941.5 432.5 2354.5 432.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g><g clip-path="url(#clip2)"><path d="M999.033 773.025 1052.03 773.025 1052.03 944 999.033 944ZM1235.04 859.028 1287.04 859.028 1287.04 944 1235.04 944ZM1706.06 518.017 1759.06 518.017 1759.06 944 1706.06 944ZM1941.06 773.025 1994.07 773.025 1994.07 944 1941.06 944ZM2177.07 859.028 2230.07 859.028 2230.07 944 2177.07 944Z" fill="#009999"/></g><g clip-path="url(#clip3)"><path d="M1066.03 518.017 1119.04 518.017 1119.04 944 1066.03 944ZM1302.04 859.028 1355.04 859.028 1355.04 944 1302.04 944Z" fill="#ED7D31"/></g><g clip-path="url(#clip4)"><path d="M941.5 944.5 2354.5 944.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none" fill-rule="evenodd"/></g><g clip-path="url(#clip5)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 956)">0</text></g><g clip-path="url(#clip6)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 870)">1</text></g><g clip-path="url(#clip7)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 785)">2</text></g><g clip-path="url(#clip8)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 700)">3</text></g><g clip-path="url(#clip9)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 614)">4</text></g><g clip-path="url(#clip10)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 529)">5</text></g><g clip-path="url(#clip11)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 882.086 444)">6</text></g><g clip-path="url(#clip12)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 960.153 1009)">1 - Disagree</text></g><g clip-path="url(#clip13)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1284.16 1009)">2</text></g><g clip-path="url(#clip14)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1519.73 1009)">3</text></g><g clip-path="url(#clip15)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1755.31 1009)">4</text></g><g clip-path="url(#clip16)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1925.86 1009)">5 - Agree</text></g><g clip-path="url(#clip17)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2173.02 1009)">no data</text></g><g clip-path="url(#clip18)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(6.12323e-17 -1 1 6.12323e-17 856.396 905)">Number of participants</text></g><g clip-path="url(#clip19)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(1 0 0 1 1468.51 1078)">Level of agreement</text></g><g clip-path="url(#clip20)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="64" transform="matrix(1 0 0 1 1147.96 358)">Are you convinced to stay inside?</text></g><g clip-path="url(#clip21)"><rect x="1340" y="1175" width="23" height="23" fill="#009999"/></g><g clip-path="url(#clip22)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1372.39 1198)">Condition 1</text></g><g clip-path="url(#clip23)"><rect x="1611" y="1175" width="22" height="23" fill="#ED7D31"/></g><g clip-path="url(#clip24)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1643.06 1198)">Condition 2</text></g><rect x="755.5" y="262.5" width="1650" height="990" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g></svg>