Changes for page Test

Last modified by Mathieu Jung-Muller on 2022/04/04 13:52

From version Icon 44.1 Icon
edited by Haoran Wang
on 2022/03/26 18:00
Change comment: There is no comment for this version
To version Icon 40.1 Icon
edited by Pietro Piccini
on 2022/03/21 16:34
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.haoranwang
1 +XWiki.PietroPiccini
Content
... ... @@ -90,26 +90,17 @@
90 90  1. Does the prototype allow the PwD greater autonomy in their day-to-day life?
91 91  1. Does the prototype improve the emotional state of the PwD and their relatives?
92 92  
93 -Based on these questions and our evaluation setting, we can evaluate some of our claims from our Claim page.
94 -
95 -1. CL01: The PwD becomes aware of Pepper's presence. PwD would know the presence of Pepper when Pepper starts to talk.
96 -1. CL02: The PwD feels understood. Whenever PwD says something, Pepper would respond. So, PwD feels understood.
97 -1. CL03: The PwD performs an activity step. In our evaluation, Pepper would guide PwD with a specific activity.
98 -1. CL08: The PwD feels accomplished. After the activity is done, we can evaluate the mood of the PwD to indicate the feeling of accomplishment.
99 -1. CL10: The PwD feels reassured. After PwD finishes each step, Pepper would wait for the response and give positive approval to the PwD.
100 -1. CL11: The PwD feels content. We can evaluate this with the data we collected from the questionnaire.
101 -
102 102  == Method ==
103 103  
104 104  In our situation, we recruit 20 students in our class to simulate the research. Since they are not real PwD, we ask them to act as if they were in home settings and we observe their behavior and expression. These data will also be reviewed after the evaluation to obtain the data and feedback.
105 105  
106 -==== Questionnaires ====
97 +==== Questionnairs ====
107 107  
108 -In order to collect qualitative data, we prepared two questionnaires to give to the participants: the affect assessment questionnaire and the system assessment questionnaire. All questionnaire questions are expressed in the form of statements and the participant can express one out of seven levels of agreement/disagreement from strongly disagree to strongly agree with the only exception being the additional remarks field at the end of the system assessment questionnaire.
99 +In order to collect qualitative data, we have prepared two questionnaires to give to the participants: the affect assessment questionnaire and the system assessment questionnaire. All questionnaire questions are expressed in the form of statements and the participant can express one out of 6 levels of agreement/disagreement from strongly disagree to strongly agree with the only exception being the additional remarks field at the end of the system assessment questionnaire.
109 109  
110 -**Affect assessment**
101 +**affect assessment**
111 111  
112 -The affect assessment questionnaire asks the participant to describe their mood and feelings experienced during a task. The questionnaire is given two times: once before the experiments and once right after. The purpose of this questionnaire is to compare the feelings experienced by the participant before the interaction with Pepper and after to study how Pepper influences the participant's feelings. The questionnaire has six questions each designed to measure the level of a certain feeling experienced at the moment of filling the questionnaire. The six feelings we take into consideration are evaluated from the following statements:
103 +The affect assessment questionnaire asks the participant to describe his/her mood and feelings experienced during a task. The questionnaire is given two times: once before the experiments and once right after. The purpose of this questionnaire is to compare the feelings experienced by the participant before the interaction with Pepper and after to study how Pepper influences the participant's feelings. The questionnaire has 6 questions each designed to measure the level of a certain feeling experienced at the moment of filling the questionnaire. The 6 feelings we take into consideration and evaluated from the following statements:
113 113  
114 114  1. I feel sad
115 115  1. I feel content
... ... @@ -118,10 +118,13 @@
118 118  1. I feel nervous
119 119  1. I feel caring
120 120  
121 -**System assessment**
112 +**system assessment**
122 122  
123 -The system assessment questionnaire is given after the interaction with Pepper and its purpose is to assess the participant's experience with Pepper in more detail. The questionnaire has fourteen questions which are designed to answer research questions as described below:
114 +The system assessment questionnaire is given after the interaction with Pepper and its purpose is to assess the participant's experience with pepper in more detail. The questionnaire has 14 questions which are designed to answer research questions as described below:
124 124  
116 +
117 +Questionnaire questions:
118 +
125 125  1. I like gardening
126 126  1. I think Pepper made the task easier for me.
127 127  1. I would have known how to do the whole task without Pepper.
... ... @@ -139,10 +139,10 @@
139 139  
140 140  Research questions:
141 141  
142 -1. To what extent did Pepper improve the task's experience? [Questions: 2,3,4,5,10,11,12]
143 -1. To what extent did Pepper improve the participant's autonomy and perception of control? [Questions: 6, 8, 9]
136 +1. To what extent did Pepper improve the task's experience? [Questions: 2,3,4,10,11,12]
137 +1. To what extent did Pepper improve the participant's autonomy and perception of control? [Questions: 8, 9]
144 144  1. To what extent did Pepper improve the participant's sense of accomplishment? [Questions: 7]
145 -1. Did the participant perceive Pepper as a social agent? [Questions: 13, 14]
139 +1. Did the participant perceive Pepper as a social agent? [Questions: 13]
146 146  1. How was Pepper's ability to guide the participant through the task? [Questions: 4]
147 147  
148 148  Question 1 is used to take into consideration the expected baseline enjoyment of the task for each participant.
... ... @@ -149,11 +149,11 @@
149 149  
150 150  == Participants ==
151 151  
152 -For this study, we simulate the real research by including 24 students from TU Delft. One third of them were female and two thirds male, so gender balance was decent. The students were not asked to roleplay someone with dementia, but simply to follow the experiment and do the activity.
146 +For this study, we simulate the real research by including 20 students in our class. To avoid too much gender imbalance, there will be at least five men and five women. All participants will be asked to pretend to be a demented person and to make the simulation as real as possible.
153 153  
154 154  == Experimental design ==
155 155  
156 -Since our evaluating process is relatively short, we use within-subject, which means each participant goes through all conditions. In this way, our experiment tends to have more statistical power and less variability. Furthermore, every PwD may have different issues in their day-to-day life, while also not having the same living conditions (alone, living with husband, family, etc), thus would require a different treatment. But in our setting, we use the same setting for every participant.
150 +Since our evaluating process is relatively short, we use within-subject, which means each participant goes through all conditions. In this way, our experiments tend to have more statistical power and less variability. Furthermore, every PwD may have different issues in their day-to-day life, while also not having the same living conditions (alone, living with husband, family, etc), thus would require a different treatment. But in our setting, we use the same home setting for every participant.
157 157  
158 158  == Tasks ==
159 159