Changes for page Test
Last modified by Mathieu Jung-Muller on 2022/04/04 13:52
From version
44.1


edited by Haoran Wang
on 2022/03/26 18:00
on 2022/03/26 18:00
Change comment:
There is no comment for this version
To version
39.1


edited by Pietro Piccini
on 2022/03/20 20:36
on 2022/03/20 20:36
Change comment:
There is no comment for this version
Summary
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. haoranwang1 +XWiki.PietroPiccini - Content
-
... ... @@ -90,70 +90,68 @@ 90 90 1. Does the prototype allow the PwD greater autonomy in their day-to-day life? 91 91 1. Does the prototype improve the emotional state of the PwD and their relatives? 92 92 93 -Based on these questions and our evaluation setting, we can evaluate some of our claims from our Claim page. 94 - 95 -1. CL01: The PwD becomes aware of Pepper's presence. PwD would know the presence of Pepper when Pepper starts to talk. 96 -1. CL02: The PwD feels understood. Whenever PwD says something, Pepper would respond. So, PwD feels understood. 97 -1. CL03: The PwD performs an activity step. In our evaluation, Pepper would guide PwD with a specific activity. 98 -1. CL08: The PwD feels accomplished. After the activity is done, we can evaluate the mood of the PwD to indicate the feeling of accomplishment. 99 -1. CL10: The PwD feels reassured. After PwD finishes each step, Pepper would wait for the response and give positive approval to the PwD. 100 -1. CL11: The PwD feels content. We can evaluate this with the data we collected from the questionnaire. 101 - 102 102 == Method == 103 103 104 104 In our situation, we recruit 20 students in our class to simulate the research. Since they are not real PwD, we ask them to act as if they were in home settings and we observe their behavior and expression. These data will also be reviewed after the evaluation to obtain the data and feedback. 105 105 106 -==== Questionnair es ====97 +==== Questionnairs ==== 107 107 108 -In order to collect qualitative data, we prepared two questionnaires to give to the participants: the affect assessment questionnaire and the system assessment questionnaire. All questionnaire questions are expressed in the form of statements and the participant can express one out of seven levels of agreement/disagreement from strongly disagree to strongly agree with the only exception being the additional remarks field at the end of the system assessment questionnaire.99 +In order to collect qualitative data, we have prepared two questionnaires to give to the participants: the affect assessment questionnaire and the system assessment questionnaire. 109 109 110 -** Affect assessment**101 +**affect assessment** 111 111 112 -The affect assessment questionnaire asks the participant to describe their mood and feelings experienced during a task. The questionnaire is given two times: once before the experiments and oncerightafter.Thepurposeofthisquestionnaireistocompare thefeelings experiencedby the participant before the interaction with Pepperand aftertotudyhow Pepperinfluencestheparticipant'sfeelings. Thequestionnaire hassixquestions each designedto measure thelevelofacertain feeling experiencedatthemomentof fillingthe questionnaire.Thesixfeelingswetake intoconsideration areevaluatedfrom thefollowing statements:103 +The affect assessment questionnaire asks the participant to describe his/her mood and feelings experienced during a task. The questionnaire is given two times: once before the experiments and once after. When compiling the questionnaire before the experiment the task that is taken as a reference is chosen by the participant based on his/her most common daily, challenging tasks. When doing the questionnaire after the interaction with Pepper the questions reference the task that has just been completed with Pepper. The purpose of this questionnaire is to compare the feelings experienced by the participant during a typical task with the feelings experienced during the task with Pepper. The questionnaire has 6 questions in total and they are s designed to answer research questions as listed below: 113 113 114 -1. I feel sad 115 -1. I feel content 116 -1. I feel calm 117 -1. I feel tired 118 -1. I feel nervous 119 -1. I feel caring 105 +Questionnaire questions: 120 120 121 -**System assessment** 107 +1. I felt frustrated by the difficulty of the task 108 +1. I felt frustrated by the lack of help 109 +1. I felt embarrassed by my ability to complete the task 110 +1. I felt embarrassed when asking for help 111 +1. The task was easier than usual 112 +1. I enjoyed the task more than usual 122 122 123 - Theystemassessment questionnaire is given after the interaction withPepper and its purpose is to assess the participant's experience with Pepper in more detail. Thequestionnaire hasfourteen questions which are designed to answer research questions as described below:114 +Research questions: 124 124 125 -1. I like gardening 126 -1. I think Pepper made the task easier for me. 127 -1. I would have known how to do the whole task without Pepper. 128 -1. Pepper was easy to understand. 129 -1. I enjoyed the task more than if I had had to do it alone. 130 -1. I am pleased that Pepper reminded me to do the activity. 131 -1. I feel like completing the task was a good accomplishment. 132 -1. I feel like I accomplished it myself. 133 -1. I felt in control of what I had to do. 134 -1. I felt annoyed by Pepper. 135 -1. I felt frustrated by the task. 136 -1. I felt pressured by Pepper. 137 -1. Pepper cared about helping me. 138 -1. I would trust Pepper with more important activities. 116 +1. To what extent has Pepper improved the task's experience? [Questions: 1,2,3,4,5,6] 117 +1. Did pepper make it easier to ask for help? [Questions: 2,4] 118 +1. Did pepper make it easier to perform the task? [Questions: 1,5] 139 139 140 - Researchquestions:120 +**system assessment** 141 141 142 -1. To what extent did Pepper improve the task's experience? [Questions: 2,3,4,5,10,11,12] 143 -1. To what extent did Pepper improve the participant's autonomy and perception of control? [Questions: 6, 8, 9] 144 -1. To what extent did Pepper improve the participant's sense of accomplishment? [Questions: 7] 145 -1. Did the participant perceive Pepper as a social agent? [Questions: 13, 14] 146 -1. How was Pepper's ability to guide the participant through the task? [Questions: 4] 122 +The system assessment questionnaire is given after the interaction with Pepper and its purpose is to assess the participant's experience with pepper in more detail. The questionnaire has 12 questions which are designed to answer research questions as described below: 147 147 148 -Question 1 is used to take into consideration the expected baseline enjoyment of the task for each participant. 149 149 125 +Questionnaire questions: 126 + 127 +1. It was easy to understand each step from Pepper’s explanation 128 +1. I would have preferred if Pepper divided the task into more, easier steps 129 +1. The tablet images were very helpful for the task 130 +1. I felt annoyed by Pepper’s explanations 131 +1. I felt accomplished after completing the task 132 +1. I felt that completing the task was my own accomplishment 133 +1. The presence of Pepper made the task more enjoyable 134 +1. I felt reassured that I could ask pepper to repeat the task 135 +1. I felt pressured by Pepper to complete the task 136 +1. I would trust pepper with more important tasks 137 +1. I felt in control of the interaction with Pepper 138 +1. I believed that pepper cared about helping me 139 + 140 +Research questions: 141 + 142 +1. To what extent did Pepper improve the task's experience? [Questions: 4,5,6,7,8,9,10] 143 +1. To what extent did Pepper improve the participant's autonomy and perception of control? [Questions: 6, 11] 144 +1. To what extent did Pepper improve the participant's sense of accomplishment? [Questions: 5] 145 +1. Did the participant perceive Pepper as a social agent? [Questions: 7, 9, 12] 146 +1. How was Pepper's ability to guide the participant through the task? [Questions: 1, 2, 3] 147 + 150 150 == Participants == 151 151 152 -For this study, we simulate the real research by including 2 4studentsfromTU Delft.Onethird ofthemwerefemaleandtwo thirdsmale,sogenderbalance was decent.Thestudents werenotasked to roleplay someonewithdementia,but simplytofollowtheexperiment anddo the activity.150 +For this study, we simulate the real research by including 20 students in our class. To avoid too much gender imbalance, there will be at least five men and five women. All participants will be asked to pretend to be a demented person and to make the simulation as real as possible. 153 153 154 154 == Experimental design == 155 155 156 -Since our evaluating process is relatively short, we use within-subject, which means each participant goes through all conditions. In this way, our experiment tend sto have more statistical power and less variability. Furthermore, every PwD may have different issues in their day-to-day life, while also not having the same living conditions (alone, living with husband, family, etc), thus would require a different treatment. But in our setting, we use the same setting for every participant.154 +Since our evaluating process is relatively short, we use within-subject, which means each participant goes through all conditions. In this way, our experiments tend to have more statistical power and less variability. Furthermore, every PwD may have different issues in their day-to-day life, while also not having the same living conditions (alone, living with husband, family, etc), thus would require a different treatment. But in our setting, we use the same home setting for every participant. 157 157 158 158 == Tasks == 159 159