Skip to Content

Changes for page Test

Last modified by Clara Stiller on 2022/04/05 13:44
From version Icon 58.1 Icon
edited by Vishruty Mittal
on 2022/04/02 11:51
Change comment: There is no comment for this version
To version Icon 54.1 Icon
edited by Sayak Mukherjee
on 2022/04/02 02:45
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.Vishruty
1 +XWiki.SayakMukherjee
Content
... ... @@ -1,4 +1,5 @@
1 -Evaluation is an iterative process where the initial iterations focus on examining if the proposed idea is working as intended. Therefore, we want to first understand how realistic and convincing the provided dialogues and suggested activities are, and would they be able to prevent people from wandering. To examine this, we conduct a small pilot study with students, who role-play having dementia. We then observe their interaction with Pepper to examine the effectiveness of our dialog flow in preventing people from wandering.
1 +The best way to test our prototype would be a study with persons with dementia. However, testing the robot in a real environment would be very time-consuming, because it is not predictable if and when people with dementia start wandering. Hence it is out of the scope of this project.
2 +Nevertheless, we wanted to get a first impression of how realistic and convincing the provided dialogues and suggested activities are. In a small study with students, who play the role of having dementia, we are observing the interaction with the robot with an aim to find out how effective it is in preventing people from wandering.
2 2  
3 3  
4 4  = Problem statement and research questions =
... ... @@ -23,12 +23,11 @@
23 23  
24 24  = Method =
25 25  
26 -A between-subject study with students who play the role of having dementia. Data will be collected with a questionnaire
27 - that participants fill out before and after interacting with Pepper. The questionnaire captured different aspects of their conversation.
27 +A between-subject study with students who play the role of having dementia. Data will be collected with a questionnaire (before and after participation), observing the participant's body language and the way that they're responding to Pepper.
28 28  
29 29  == Participants ==
30 30  
31 -17 students who play the role of having dementia. They will be divided into two groups. One group (11 participants) will be interacting with the intelligent (group 1) robot while the other group (6 students) will interact with the unintelligent robot (group 2).
31 +18 students who play the role of having dementia. They will be divided into two groups. One group (11 participants) will be interacting with the intelligent (group 1) robot while the other group (7 students) will interact with the unintelligent robot (group 2).
32 32  It is assumed that all participants are living at the same care center.
33 33  Before they start, they can choose how stubborn they want to be and where they want to go.
34 34  
... ... @@ -99,8 +99,8 @@
99 99  
100 100  Pepper, laptop, door, and music.
101 101  
102 -= Results =
103 103  
103 += Results =
104 104  {{html}}
105 105  <!--=== Comparison between intelligent (cond. 1) and less intelligent (cond. 2) prototype ===
106 106  
... ... @@ -157,8 +157,14 @@
157 157  Furthermore, we found out, that our prototype doesn't fit in the environment of the lab. We encourage the participant to do some activities, that they can't do in the lab environment (go to the living room, have a coffee or do a puzzle). If the robot tells asks you if you want to do the activity, most people don't know how to react and are insecure about how to answer. Participants "freeze" in front of the robot or just left the room. -->
158 158  {{/html}}
159 159  
160 -=== RQ1: Are people convinced not to go out unsupervised? ===
160 +1. What percentage of people are prevented from going out unsupervised? (Quantitative) (CL01, CL05)
161 +1. How does the interaction change the participant's mood? (CL02)
162 +1. Can the robot respond appropriately to the participant's intention? (CL03)
163 +1. How do the participants react to the music? (CL04)
164 +1. Does the activity that the robot suggests prevent people from wandering/ leaving? (CL06)
165 +1. Can pepper identify and catch the attention of the PwD?
161 161  
167 +=== RQ1: Are people convinced not to go out unsupervised? ===
162 162  {{html}}
163 163  <table style="width: 100%">
164 164  <tr>
... ... @@ -173,7 +173,6 @@
173 173  {{/html}}
174 174  
175 175  === RQ2: How does the interaction change the participant's mood? ===
176 -
177 177  {{html}}
178 178  <table style="width: 100%">
179 179  <tr>
... ... @@ -188,7 +188,6 @@
188 188  {{/html}}
189 189  
190 190  === RQ3: Can the robot respond appropriately to the participant's intention? ===
191 -
192 192  {{html}}
193 193  <table style="width: 100%">
194 194  <tr>
... ... @@ -203,7 +203,6 @@
203 203  {{/html}}
204 204  
205 205  === RQ4: How do the participants react to the music? ===
206 -
207 207  {{html}}
208 208  <table style="width: 100%">
209 209  <tr>
... ... @@ -218,7 +218,6 @@
218 218  {{/html}}
219 219  
220 220  === RQ5: Does the activity that the robot suggests prevent people from wandering/ leaving? ===
221 -
222 222  {{html}}
223 223  <table style="width: 100%">
224 224  <tr>
... ... @@ -233,7 +233,6 @@
233 233  {{/html}}
234 234  
235 235  === RQ6: Can pepper identify and catch the attention of the PwD? ===
236 -
237 237  {{html}}
238 238  <table style="width: 100%">
239 239  <tr>
... ... @@ -248,7 +248,6 @@
248 248  {{/html}}
249 249  
250 250  === Reliabity Scores ===
251 -
252 252  {{html}}
253 253  <table style="width: 100%">
254 254  <tr>
... ... @@ -262,7 +262,7 @@
262 262  </table>
263 263  {{/html}}
264 264  
265 -= Limitation =
265 += Limitation=
266 266  
267 267  * **Lab Environment**: The lab environment is different from a care home, the participants found it difficult to process the suggestions made by Pepper. For example, if Pepper asked someone to visit the living room, it created confusion among the participants regarding their next action.
268 268  
... ... @@ -273,7 +273,6 @@
273 273  * **Face Detection**: The face recognition module within Pepper is also rudimentary in nature. It can not detect half faces are when participants approach from the side. Adding to the problem, the lighting condition in the lab was not sufficient for the reliable functioning of the face recognition module. Hence Pepper failed to notice the participant in some cases and did not start the dialogue flow.
274 274  
275 275  = Conclusions =
276 -
277 277  * People who liked the activity tend to stay in
278 278  * People who knew the music found it more fitting
279 279  * People are more convinced to stay in with the intelligent prototype
... ... @@ -282,8 +282,8 @@
282 282  * Experiment with personalization
283 283  
284 284  = Future Work =
285 -
286 286  * **Personalisation**: Personalize music, and activity preferences according to the person interacting with Pepper.
287 287  * **Robot Collaboration**: Collaborate with other robots such as Miro to assist a person with dementia while going for a walk instead of the caretaker.
288 288  * **Recognise Person**: For a personalised experience, it is essential that Pepper is able to identify each person based on an internal database.
289 289  * **Fine Tune Speech Recognition**: Improvements are necessary for the speech recognition module before the actual deployment of the project in a care home. Additionally, support for multiple languages can be considered to engage with non-English speaking people.
288 +
Icon XWiki.XWikiComments[1]
Comment
... ... @@ -1,1 +1,1 @@
1 -Add claim number with RQ6 once claims are fixed back
1 +Modified Research Questions so that they align with claims
Date
... ... @@ -1,1 +1,1 @@
1 -2022-04-02 11:44:44.339
1 +2022-03-26 13:50:45.49
Icon XWiki.XWikiComments[2]
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.Vishruty
Comment
... ... @@ -1,1 +1,0 @@
1 -Check if RQ and claims align with each other(CL numbers) once claims are reverted.
Date
... ... @@ -1,1 +1,0 @@
1 -2022-04-02 11:45:38.960