Changes for page Test
Last modified by Mathieu Jung-Muller on 2022/04/04 13:52
To version
39.1


edited by Pietro Piccini
on 2022/03/20 20:36
on 2022/03/20 20:36
Change comment:
There is no comment for this version
Summary
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. XWikiGuest1 +XWiki.PietroPiccini - Content
-
... ... @@ -94,14 +94,57 @@ 94 94 95 95 In our situation, we recruit 20 students in our class to simulate the research. Since they are not real PwD, we ask them to act as if they were in home settings and we observe their behavior and expression. These data will also be reviewed after the evaluation to obtain the data and feedback. 96 96 97 +==== Questionnairs ==== 98 + 97 97 In order to collect qualitative data, we have prepared two questionnaires to give to the participants: the affect assessment questionnaire and the system assessment questionnaire. 98 98 99 -* affect assessment 100 -the affect assessment questionnaire has the purpose of tracking changes in the participant's affect state before and after interacting with Pepper. The questionnaire consists of a list of 10 statements each representing one emotion and participants will be asked to give a score of 1 through 5 to each statement depending on the intensity of the emotion as experienced during the questionnaire. The affect questionnaire will be given twice, once before the interaction with Pepper and once after. 101 +**affect assessment** 101 101 102 -* system assessment 103 -for assessing the quality of Pepper's interaction we used the Subjective Assessment of Speech System Interfaces (SASSI) questionnaire. The SASSI questionnaire is wildly used in research to evaluate speech and conversational systems. The questionnaire contains 36 questions divided into six main factors: System Response Accuracy, Likeability, Cognitive Demand, Annoyance, Habitability, and Speed. The questions are short and unambiguous and the length of the questionnaires is not too long which could cause the participants to give fast and unreliable answers but it is also long enough so that a good amount of information is collected. 103 +The affect assessment questionnaire asks the participant to describe his/her mood and feelings experienced during a task. The questionnaire is given two times: once before the experiments and once after. When compiling the questionnaire before the experiment the task that is taken as a reference is chosen by the participant based on his/her most common daily, challenging tasks. When doing the questionnaire after the interaction with Pepper the questions reference the task that has just been completed with Pepper. The purpose of this questionnaire is to compare the feelings experienced by the participant during a typical task with the feelings experienced during the task with Pepper. The questionnaire has 6 questions in total and they are s designed to answer research questions as listed below: 104 104 105 +Questionnaire questions: 106 + 107 +1. I felt frustrated by the difficulty of the task 108 +1. I felt frustrated by the lack of help 109 +1. I felt embarrassed by my ability to complete the task 110 +1. I felt embarrassed when asking for help 111 +1. The task was easier than usual 112 +1. I enjoyed the task more than usual 113 + 114 +Research questions: 115 + 116 +1. To what extent has Pepper improved the task's experience? [Questions: 1,2,3,4,5,6] 117 +1. Did pepper make it easier to ask for help? [Questions: 2,4] 118 +1. Did pepper make it easier to perform the task? [Questions: 1,5] 119 + 120 +**system assessment** 121 + 122 +The system assessment questionnaire is given after the interaction with Pepper and its purpose is to assess the participant's experience with pepper in more detail. The questionnaire has 12 questions which are designed to answer research questions as described below: 123 + 124 + 125 +Questionnaire questions: 126 + 127 +1. It was easy to understand each step from Pepper’s explanation 128 +1. I would have preferred if Pepper divided the task into more, easier steps 129 +1. The tablet images were very helpful for the task 130 +1. I felt annoyed by Pepper’s explanations 131 +1. I felt accomplished after completing the task 132 +1. I felt that completing the task was my own accomplishment 133 +1. The presence of Pepper made the task more enjoyable 134 +1. I felt reassured that I could ask pepper to repeat the task 135 +1. I felt pressured by Pepper to complete the task 136 +1. I would trust pepper with more important tasks 137 +1. I felt in control of the interaction with Pepper 138 +1. I believed that pepper cared about helping me 139 + 140 +Research questions: 141 + 142 +1. To what extent did Pepper improve the task's experience? [Questions: 4,5,6,7,8,9,10] 143 +1. To what extent did Pepper improve the participant's autonomy and perception of control? [Questions: 6, 11] 144 +1. To what extent did Pepper improve the participant's sense of accomplishment? [Questions: 5] 145 +1. Did the participant perceive Pepper as a social agent? [Questions: 7, 9, 12] 146 +1. How was Pepper's ability to guide the participant through the task? [Questions: 1, 2, 3] 147 + 105 105 == Participants == 106 106 107 107 For this study, we simulate the real research by including 20 students in our class. To avoid too much gender imbalance, there will be at least five men and five women. All participants will be asked to pretend to be a demented person and to make the simulation as real as possible.