Skip to Content

Changes for page Test

Last modified by Clara Stiller on 2022/04/05 13:44
From version Icon 43.1 Icon
edited by Clara Stiller
on 2022/03/27 15:12
Change comment: There is no comment for this version
To version Icon 16.2 Icon
edited by Clara Stiller
on 2022/03/27 12:33
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -11,17 +11,19 @@
11 11  
12 12  1. What percentage of people are prevented from going out unsupervised? (Quantitative) (CL01, CL05)
13 13  1. How does the interaction change the participant's mood? (CL02)
14 -1. Can the robot respond appropriately to the participant's intention? (CL03)
14 +1. Can the robot respond appropriately to the participant's intention? (CL03)
15 15  1. How do the participants react to the music? (CL04)
16 16  1. Does the activity that the robot suggests prevent people from wandering/ leaving? (CL06)
17 17  1. Can pepper identify and catch the attention of the PwD?
18 18  
19 -//Future research questions//
20 20  
20 +
21 +//Future research questions//
21 21  1. Does the interaction with Pepper make PwD come back to reality? (CL08)
22 22  1. Does the interaction with Pepper make PwD feel he/she is losing freedom? (CL09)
23 23  1. Does preventing the participant from going out alone make them feel dependent? (CL10)
24 24  
26 +
25 25  = Method =
26 26  
27 27  A between-subject study with students who play the role of having dementia. Data will be collected with a questionnaire (before and after participation), observing the participant's body language and the way that they're responding to Pepper.
... ... @@ -102,41 +102,20 @@
102 102  
103 103  = Results =
104 104  
105 -==== Condition 1 - intelligent Prototype: ====
107 +**Results from Questionnaire:**
106 106  
107 -{{html}}
108 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Music_reco.svg" width="500" height="270" /> <br>
109 -{{/html}}
110 -
109 +1. Condition 1 - intelligent Prototype:
111 111  8 out of 11 Participants answered, that they don't know the music that has been played. If we told them afterward the title of the song, most participants do know the song. Why didn't they recognize it during the interaction?
112 112  This can have two reasons: The part of the song we pick was too short to be recognized or not the most significant part of the song. For example, the beginning of "escape - the pina colada song" is not as well known as its chorus. Another reason could be, that the participant was distracted or confused by the robot and therefore couldn't carefully listen to the music.
113 -
114 -{{html}}
115 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Music_fit.svg" width="500" height="270" /> <br>
116 -{{/html}}
117 -
118 118  Only 4 out of 11 people agreed, that the music fits the situation. One of our claims, to use music that fits the situation or place, is therefore not reached and the music didn't have the intended effect. Even though we carefully choose the music and discussed a lot about our choice, it was hard to find music that different people connect with a certain place or activity. An approach to improve this could be using an individual playlist for each participant.
113 +
114 +1. Condition 2 - less intelligent prototype:
115 +Non of the participants who interacted with the less intelligent robot were prevented from leaving.
116 +**Feedback from Participants:**
119 119  
118 +**Observations:**
119 +Problems that occurred during the evaluation
120 120  
121 -
122 -==== Condition 2 - less intelligent prototype: ====
123 -
124 -Participants assigned to condition 2 weren't convinced to leave. We saw, that most of them tried to continue talking to pepper when it raises its arm to block the door, even though it didn't listen. They were surprised by peppers reaction and asked for a reason why they are not allowed to leave. In order to have a natural conversation flow, the robot should provide an explanation for each scenario that tells why the person is not allowed to leave. This confirms that our approach, to give reason to stay inside, might be helpful to convince PwD to stay inside.
125 -
126 -=== Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype ===
127 -
128 -{{html}}
129 -<img src="/xwiki/wiki/sce2022group05/download/Test/WebHome/Stay_inside.svg" width="500" height="270" />
130 -{{/html}}
131 -
132 -Non of the participants who interacted with the less intelligent robot was prevented from leaving. Still, 3 people assigned to condition 1 weren't convinced to stay inside. A failure rate of 27,3 % is too high for this application since people could be in danger if the system fails.
133 -
134 -
135 -Mood evolution
136 -Condition 1: Improvement in 4 cases,
137 -
138 -=== Problems that occurred during the evaluation ===
139 -
140 140  1. lots of difficulties with speech recognition:
141 141  1.1. even though the participant said one of the expected words, pepper understood it wrong and continued with a wrong path
142 142  1.2. If the participant started to talk before pepper was listening (eyes turning blue), it misses a "yes" or "no" at the beginning of the sentence, which causes misunderstandings.
... ... @@ -154,15 +154,9 @@
154 154  
155 155  = Discussion =
156 156  
138 +**Comparison between intelligent and less intelligent prototype**
139 +[[image:STay_inside.png||height="400"]]
140 +[[image:Stay_inside.svg||height="400"]]
157 157  
158 158  
159 -
160 -
161 -
162 162  = Conclusions =
163 -
164 -just some notes...
165 -
166 -* Evaluation is not significant enough to answer our main question/ goal, due to many issues with speech reco and misunderstandings
167 -* difference in effectiveness between cond 1 and cond 2, but not in all cases
168 -* Confusion + waiting for the robot to listen -> bad for PwD, because they are already confused and might not remember to wait for the eyes to turn blue
Icon Music_fit.svg
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.ClaraStiller
Size
... ... @@ -1,1 +1,0 @@
1 -7.3 KB
Content
... ... @@ -1,1 +1,0 @@
1 -<svg width="1653" height="1163" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" overflow="hidden"><defs><clipPath id="clip0"><rect x="1556" y="3933" width="1653" height="1163"/></clipPath><clipPath id="clip1"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip2"><rect x="1743" y="4103" width="1417" height="636"/></clipPath><clipPath id="clip3"><rect x="1743" y="4103" width="1417" height="636"/></clipPath><clipPath id="clip4"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip5"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip6"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip7"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip8"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip9"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip10"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip11"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip12"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip13"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip14"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip15"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip16"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip17"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip18"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip19"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip20"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip21"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip22"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip23"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip24"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip25"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath></defs><g clip-path="url(#clip0)" transform="translate(-1556 -3933)"><rect x="1557" y="3934" width="1650" height="1160" fill="#FFFFFF"/><g clip-path="url(#clip1)"><path d="M1743.5 4645.65 3156.5 4645.65M1743.5 4554.65 3156.5 4554.65M1743.5 4464.65 3156.5 4464.65M1743.5 4374.64 3156.5 4374.64M1743.5 4284.64 3156.5 4284.64M1743.5 4193.64 3156.5 4193.64M1743.5 4103.5 3156.5 4103.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g><g clip-path="url(#clip2)"><path d="M1813.06 4194.14 1876.06 4194.14 1876.06 4736 1813.06 4736ZM2095.07 4284.14 2159.07 4284.14 2159.07 4736 2095.07 4736Z" fill="#009999"/></g><g clip-path="url(#clip3)"><path d="M1893.06 4465.15 1957.06 4465.15 1957.06 4736 1893.06 4736ZM2176.07 4555.15 2239.07 4555.15 2239.07 4736 2176.07 4736ZM2459.08 4645.15 2522.08 4645.15 2522.08 4736 2459.08 4736Z" fill="#ED7D31"/></g><g clip-path="url(#clip4)"><path d="M1743.5 4735.5 3156.5 4735.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none" fill-rule="evenodd"/></g><g clip-path="url(#clip5)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4747)">0</text></g><g clip-path="url(#clip6)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4657)">1</text></g><g clip-path="url(#clip7)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4567)">2</text></g><g clip-path="url(#clip8)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4476)">3</text></g><g clip-path="url(#clip9)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4386)">4</text></g><g clip-path="url(#clip10)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4296)">5</text></g><g clip-path="url(#clip11)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4205)">6</text></g><g clip-path="url(#clip12)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4115)">7</text></g><g clip-path="url(#clip13)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1794.91 4801)">A1 - happy</text></g><g clip-path="url(#clip14)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2144.98 4801)">A2</text></g><g clip-path="url(#clip15)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2351.36 4801)">A3 - neutral</text></g><g clip-path="url(#clip16)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2710.35 4801)">A4</text></g><g clip-path="url(#clip17)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2896.02 4801)">A5 - unhappy/</text></g><g clip-path="url(#clip18)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2986.64 4851)">sad</text></g><g clip-path="url(#clip19)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(6.12323e-17 -1 1 6.12323e-17 1658.48 4636)">Number of Participants</text></g><g clip-path="url(#clip20)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(1 0 0 1 2342.77 4920)">Mood scale</text></g><g clip-path="url(#clip21)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="64" transform="matrix(1 0 0 1 2084.67 4029)">Mood after Interaction</text></g><g clip-path="url(#clip22)"><rect x="2142" y="5017" width="23" height="23" fill="#009999"/></g><g clip-path="url(#clip23)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2174.48 5040)">Condition 1</text></g><g clip-path="url(#clip24)"><rect x="2413" y="5017" width="23" height="23" fill="#ED7D31"/></g><g clip-path="url(#clip25)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2445.14 5040)">Condition 2</text></g><rect x="1557.5" y="3934.5" width="1650" height="1160" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g></svg>
Icon Music_reco.svg
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.ClaraStiller
Size
... ... @@ -1,1 +1,0 @@
1 -7.3 KB
Content
... ... @@ -1,1 +1,0 @@
1 -<svg width="1653" height="1163" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" overflow="hidden"><defs><clipPath id="clip0"><rect x="1556" y="3933" width="1653" height="1163"/></clipPath><clipPath id="clip1"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip2"><rect x="1743" y="4103" width="1417" height="636"/></clipPath><clipPath id="clip3"><rect x="1743" y="4103" width="1417" height="636"/></clipPath><clipPath id="clip4"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip5"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip6"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip7"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip8"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip9"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip10"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip11"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip12"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip13"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip14"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip15"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip16"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip17"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip18"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip19"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip20"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip21"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip22"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip23"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip24"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath><clipPath id="clip25"><rect x="1557" y="3933" width="1650" height="1161"/></clipPath></defs><g clip-path="url(#clip0)" transform="translate(-1556 -3933)"><rect x="1557" y="3934" width="1650" height="1160" fill="#FFFFFF"/><g clip-path="url(#clip1)"><path d="M1743.5 4645.65 3156.5 4645.65M1743.5 4554.65 3156.5 4554.65M1743.5 4464.65 3156.5 4464.65M1743.5 4374.64 3156.5 4374.64M1743.5 4284.64 3156.5 4284.64M1743.5 4193.64 3156.5 4193.64M1743.5 4103.5 3156.5 4103.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g><g clip-path="url(#clip2)"><path d="M1813.06 4194.14 1876.06 4194.14 1876.06 4736 1813.06 4736ZM2095.07 4284.14 2159.07 4284.14 2159.07 4736 2095.07 4736Z" fill="#009999"/></g><g clip-path="url(#clip3)"><path d="M1893.06 4465.15 1957.06 4465.15 1957.06 4736 1893.06 4736ZM2176.07 4555.15 2239.07 4555.15 2239.07 4736 2176.07 4736ZM2459.08 4645.15 2522.08 4645.15 2522.08 4736 2459.08 4736Z" fill="#ED7D31"/></g><g clip-path="url(#clip4)"><path d="M1743.5 4735.5 3156.5 4735.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none" fill-rule="evenodd"/></g><g clip-path="url(#clip5)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4747)">0</text></g><g clip-path="url(#clip6)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4657)">1</text></g><g clip-path="url(#clip7)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4567)">2</text></g><g clip-path="url(#clip8)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4476)">3</text></g><g clip-path="url(#clip9)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4386)">4</text></g><g clip-path="url(#clip10)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4296)">5</text></g><g clip-path="url(#clip11)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4205)">6</text></g><g clip-path="url(#clip12)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1684.17 4115)">7</text></g><g clip-path="url(#clip13)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1794.91 4801)">A1 - happy</text></g><g clip-path="url(#clip14)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2144.98 4801)">A2</text></g><g clip-path="url(#clip15)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2351.36 4801)">A3 - neutral</text></g><g clip-path="url(#clip16)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2710.35 4801)">A4</text></g><g clip-path="url(#clip17)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2896.02 4801)">A5 - unhappy/</text></g><g clip-path="url(#clip18)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2986.64 4851)">sad</text></g><g clip-path="url(#clip19)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(6.12323e-17 -1 1 6.12323e-17 1658.48 4636)">Number of Participants</text></g><g clip-path="url(#clip20)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="46" transform="matrix(1 0 0 1 2342.77 4920)">Mood scale</text></g><g clip-path="url(#clip21)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="64" transform="matrix(1 0 0 1 2084.67 4029)">Mood after Interaction</text></g><g clip-path="url(#clip22)"><rect x="2142" y="5017" width="23" height="23" fill="#009999"/></g><g clip-path="url(#clip23)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2174.48 5040)">Condition 1</text></g><g clip-path="url(#clip24)"><rect x="2413" y="5017" width="23" height="23" fill="#ED7D31"/></g><g clip-path="url(#clip25)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2445.14 5040)">Condition 2</text></g><rect x="1557.5" y="3934.5" width="1650" height="1160" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g></svg>
Icon STay_inside.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.ClaraStiller
Size
... ... @@ -1,0 +1,1 @@
1 +26.3 KB
Content Icon