Skip to Content

Changes for page Test

Last modified by Clara Stiller on 2022/04/05 13:44
From version Icon 52.3 Icon
edited by Sayak Mukherjee
on 2022/04/02 02:40
Change comment: There is no comment for this version
To version Icon 58.1 Icon
edited by Vishruty Mittal
on 2022/04/02 11:51
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.SayakMukherjee
1 +XWiki.Vishruty
Content
... ... @@ -1,5 +1,4 @@
1 -The best way to test our prototype would be a study with persons with dementia. However, testing the robot in a real environment would be very time-consuming, because it is not predictable if and when people with dementia start wandering. Hence it is out of the scope of this project.
2 -Nevertheless, we wanted to get a first impression of how realistic and convincing the provided dialogues and suggested activities are. In a small study with students, who play the role of having dementia, we are observing the interaction with the robot with an aim to find out how effective it is in preventing people from wandering.
1 +Evaluation is an iterative process where the initial iterations focus on examining if the proposed idea is working as intended. Therefore, we want to first understand how realistic and convincing the provided dialogues and suggested activities are, and would they be able to prevent people from wandering. To examine this, we conduct a small pilot study with students, who role-play having dementia. We then observe their interaction with Pepper to examine the effectiveness of our dialog flow in preventing people from wandering.
3 3  
4 4  
5 5  = Problem statement and research questions =
... ... @@ -24,11 +24,12 @@
24 24  
25 25  = Method =
26 26  
27 -A between-subject study with students who play the role of having dementia. Data will be collected with a questionnaire (before and after participation), observing the participant's body language and the way that they're responding to Pepper.
26 +A between-subject study with students who play the role of having dementia. Data will be collected with a questionnaire
27 + that participants fill out before and after interacting with Pepper. The questionnaire captured different aspects of their conversation.
28 28  
29 29  == Participants ==
30 30  
31 -18 students who play the role of having dementia. They will be divided into two groups. One group (11 participants) will be interacting with the intelligent (group 1) robot while the other group (7 students) will interact with the unintelligent robot (group 2).
31 +17 students who play the role of having dementia. They will be divided into two groups. One group (11 participants) will be interacting with the intelligent (group 1) robot while the other group (6 students) will interact with the unintelligent robot (group 2).
32 32  It is assumed that all participants are living at the same care center.
33 33  Before they start, they can choose how stubborn they want to be and where they want to go.
34 34  
... ... @@ -99,8 +99,8 @@
99 99  
100 100  Pepper, laptop, door, and music.
101 101  
102 -
103 103  = Results =
103 +
104 104  {{html}}
105 105  <!--=== Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype ===
106 106  
... ... @@ -157,19 +157,13 @@
157 157  Furthermore, we found out, that our prototype doesn't fit in the environment of the lab. We encourage the participant to do some activities, that they can't do in the lab environment (go to the living room, have a coffee or do a puzzle). If the robot tells asks you if you want to do the activity, most people don't know how to react and are insecure about how to answer. Participants "freeze" in front of the robot or just left the room. -->
158 158  {{/html}}
159 159  
160 -1. What percentage of people are prevented from going out unsupervised? (Quantitative) (CL01, CL05)
161 -1. How does the interaction change the participant's mood? (CL02)
162 -1. Can the robot respond appropriately to the participant's intention? (CL03)
163 -1. How do the participants react to the music? (CL04)
164 -1. Does the activity that the robot suggests prevent people from wandering/ leaving? (CL06)
165 -1. Can pepper identify and catch the attention of the PwD?
166 -
167 167  === RQ1: Are people convinced not to go out unsupervised? ===
161 +
168 168  {{html}}
169 169  <table style="width: 100%">
170 170  <tr>
171 171  <td style="width: 50%">
172 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
166 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ1.jpg?height=250&rev=1.1" />
173 173  </td>
174 174  <td>
175 175  Comment on the graph
... ... @@ -179,11 +179,12 @@
179 179  {{/html}}
180 180  
181 181  === RQ2: How does the interaction change the participant's mood? ===
176 +
182 182  {{html}}
183 183  <table style="width: 100%">
184 184  <tr>
185 185  <td style="width: 50%">
186 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
181 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ2.jpg?height=250&rev=1.1" />
187 187  </td>
188 188  <td>
189 189  Comment on the graph
... ... @@ -193,11 +193,12 @@
193 193  {{/html}}
194 194  
195 195  === RQ3: Can the robot respond appropriately to the participant's intention? ===
191 +
196 196  {{html}}
197 197  <table style="width: 100%">
198 198  <tr>
199 199  <td style="width: 50%">
200 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
196 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ3.jpg?height=250&rev=1.1" />
201 201  </td>
202 202  <td>
203 203  Comment on the graph
... ... @@ -207,11 +207,12 @@
207 207  {{/html}}
208 208  
209 209  === RQ4: How do the participants react to the music? ===
206 +
210 210  {{html}}
211 211  <table style="width: 100%">
212 212  <tr>
213 213  <td style="width: 50%">
214 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
211 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ4.jpg?height=250&rev=1.1" />
215 215  </td>
216 216  <td>
217 217  Comment on the graph
... ... @@ -221,11 +221,12 @@
221 221  {{/html}}
222 222  
223 223  === RQ5: Does the activity that the robot suggests prevent people from wandering/ leaving? ===
221 +
224 224  {{html}}
225 225  <table style="width: 100%">
226 226  <tr>
227 227  <td style="width: 50%">
228 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
226 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ5.jpg?height=250&rev=1.1" />
229 229  </td>
230 230  <td>
231 231  Comment on the graph
... ... @@ -235,11 +235,12 @@
235 235  {{/html}}
236 236  
237 237  === RQ6: Can pepper identify and catch the attention of the PwD? ===
236 +
238 238  {{html}}
239 239  <table style="width: 100%">
240 240  <tr>
241 241  <td style="width: 50%">
242 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
241 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ6.jpg?height=250&rev=1.1" />
243 243  </td>
244 244  <td>
245 245  Comment on the graph
... ... @@ -249,11 +249,12 @@
249 249  {{/html}}
250 250  
251 251  === Reliabity Scores ===
251 +
252 252  {{html}}
253 253  <table style="width: 100%">
254 254  <tr>
255 255  <td style="width: 50%">
256 -<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/Storyboard_1.png?height=750&rev=1.1" />
256 +<img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RelScores.jpg?height=250&rev=1.1" />
257 257  </td>
258 258  <td>
259 259  Comment on the graph
... ... @@ -262,7 +262,7 @@
262 262  </table>
263 263  {{/html}}
264 264  
265 -= Limitation=
265 += Limitation =
266 266  
267 267  * **Lab Environment**: The lab environment is different from a care home, the participants found it difficult to process the suggestions made by Pepper. For example, if Pepper asked someone to visit the living room, it created confusion among the participants regarding their next action.
268 268  
... ... @@ -273,6 +273,7 @@
273 273  * **Face Detection**: The face recognition module within Pepper is also rudimentary in nature. It can not detect half faces are when participants approach from the side. Adding to the problem, the lighting condition in the lab was not sufficient for the reliable functioning of the face recognition module. Hence Pepper failed to notice the participant in some cases and did not start the dialogue flow.
274 274  
275 275  = Conclusions =
276 +
276 276  * People who liked the activity tend to stay in
277 277  * People who knew the music found it more fitting
278 278  * People are more convinced to stay in with the intelligent prototype
... ... @@ -281,8 +281,8 @@
281 281  * Experiment with personalization
282 282  
283 283  = Future Work =
285 +
284 284  * **Personalisation**: Personalize music, and activity preferences according to the person interacting with Pepper.
285 285  * **Robot Collaboration**: Collaborate with other robots such as Miro to assist a person with dementia while going for a walk instead of the caretaker.
286 286  * **Recognise Person**: For a personalised experience, it is essential that Pepper is able to identify each person based on an internal database.
287 287  * **Fine Tune Speech Recognition**: Improvements are necessary for the speech recognition module before the actual deployment of the project in a care home. Additionally, support for multiple languages can be considered to engage with non-English speaking people.
288 -
Icon XWiki.XWikiComments[1]
Comment
... ... @@ -1,1 +1,1 @@
1 -Modified Research Questions so that they align with claims
1 +Add claim number with RQ6 once claims are fixed back
Date
... ... @@ -1,1 +1,1 @@
1 -2022-03-26 13:50:45.49
1 +2022-04-02 11:44:44.339
Icon XWiki.XWikiComments[2]
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.Vishruty
Comment
... ... @@ -1,0 +1,1 @@
1 +Check if RQ and claims align with each other(CL numbers) once claims are reverted.
Date
... ... @@ -1,0 +1,1 @@
1 +2022-04-02 11:45:38.960