Skip to Content

Changes for page Test

Last modified by Clara Stiller on 2022/04/05 13:44
From version Icon 67.2 Icon
edited by Vishruty Mittal
on 2022/04/02 12:58
Change comment: There is no comment for this version
To version Icon 74.2 Icon
edited by Vishruty Mittal
on 2022/04/02 14:33
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -1,6 +1,5 @@
1 1  Evaluation is an iterative process where the initial iterations focus on examining if the proposed idea is working as intended. Therefore, we want to first understand how realistic and convincing the provided dialogues and suggested activities are, and would they be able to prevent people from wandering. To examine this, we conduct a small pilot study with students, who role-play having dementia. We then observe their interaction with Pepper to examine the effectiveness of our dialog flow in preventing people from wandering.
2 2  
3 -
4 4  = Problem statement and research questions =
5 5  
6 6  **Goal**: How effective is music and dialogue in preventing people with dementia from wandering?
... ... @@ -32,13 +32,12 @@
32 32  
33 33  == Participants ==
34 34  
35 -17 students who play the role of having dementia. They will be divided into two groups. One group (11 participants) will be interacting with design X (group 1) robot while the other group (6 students) will interact with the design Y (group 2).
36 -It is assumed that all participants are living at the same care center.
34 +The ideal participants for our user study would have been people suffering from dementia. As the people in this section fall under vulnerable groups, testing with them would have been very difficult due to the current pandemic situation. Therefore we planned to conduct our experiments with students instead.
35 +Our experiment involves 17 students who play the role of having dementia. They will be divided into two groups. One group (11 participants) will be interacting with design X while the other group (6 students) will interact with design Y.
37 37  
38 38  == Experimental design ==
39 39  
40 40  **Before Experiment:**
41 -
42 42  We will explain to the participants the goal of this experiment and what do they need to do to prevent ambiguity. Therefore, as our participants are students and only playing the role of having dementia, we will give them a level of stubbornness/ willpower with which they are trying to leave the care home.
43 43  Participants will also be given a reason to leave, from the below list:
44 44  
... ... @@ -54,52 +54,14 @@
54 54  **After Experiment:**
55 55  After the participant finishes interacting with Pepper, he/she will be asked to fill out the remaining questionnaire. Almost all the questions in the questionnaire collect quantitative data, using a 5 point Likert scale. The questionnaire also used images from Self Assessment Manikin (SAM) so that user can self attest to their mood before and after their interaction with Pepper.
56 56  
57 -== Measures ==
58 -
59 -We will be measuring this physically and emotionally.
60 -Physically: whether the participant was stopped from leaving the building or not.
61 -Emotionally: evaluate their responses to the robot and observe their mood before and after the interaction.
62 -
63 -
64 -== Procedure ==
65 -
66 -{{html}}
67 -<!-- Your HTML code here -->
68 -<table width='100%'>
69 -<tr>
70 -<th width='50%'>Group 1</th>
71 -<th width='50%'>Group 2</th>
72 -</tr>
73 -<tr>
74 -<td>intelligent robot</td>
75 -<td>unintelligent robot</td>
76 -</tr>
77 -<tr>
78 -<td>
79 -1. Starts with a short briefing on what we expect from the participant<br>
80 -2. Let them fill out the informed consent form<br>
81 -3. Tell them their level of stubbornness and reason to leave<br>
82 -4. Fill out question about current mood (in their role)<br>
83 -4. Let the user interact with the robot<br>
84 -5. While user is interacting, we will be observing the conversation with the robot<br>
85 -6. Let user fill out the questionnaire about their experience after the interaction
86 -</td>
87 -<td>
88 -1. Starts with a short briefing on what we expect from the participant<br>
89 -2. Let them fill out the informed consent form<br>
90 -4. Fill out question about current mood (in their role)<br>
91 -5. Let the user interact with the robot<br>
92 -6. Let user fill out the questionnaire about their experience after the interaction<br>
93 -</td>
94 -</tr>
95 -</table>
96 -
97 -{{/html}}
98 -
99 99  == Material ==
100 100  
101 -Pepper, laptop, door, and music.
57 +The items required for this evaluation are the following:
102 102  
59 +* Pepper
60 +* Door
61 +* Caretaker in a nearby room in case of emergency
62 +
103 103  = Results =
104 104  
105 105  {{html}}
... ... @@ -167,7 +167,8 @@
167 167  <img src="/xwiki/wiki/sce2022group05/download/Foundation/Operational%20Demands/Personas/WebHome/RQ1.jpg?height=250&rev=1.1" />
168 168  </td>
169 169  <td>
170 -Comment on the graph
130 +We used a Likert scale for this question, 1 being the lowest and 5 being the highest. Participants who interacted with design Y tend to agree less to stay inside compared to the people who interacted with design X.
131 +
171 171  </td>
172 172  </tr>
173 173  </table>