Skip to Content

Changes for page b. Test

Last modified by Demi Breen on 2023/04/09 15:10
From version 50.2
edited by Maya Elasmar
on 2023/04/07 13:37
Change comment: There is no comment for this version
To version 52.1
edited by Liza Wensink
on 2023/04/07 14:27
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.MayaElasmar
1 +XWiki.lwensink
Content
... ... @@ -79,15 +79,12 @@
79 79  
80 80  == 2.5 Procedure ==
81 81  
82 -
83 83  The procedure is as follows: we want the to test the claims mentioned above in the introduction. Therefore we programmed two routes in Choreography: one for the emotion-based motivation test and one for the goal-based motivation. To focus on only these two types of motivations, everything else in the route was kept the same. This is also to make sure that nothing else besides the motivation influences the participant's opinion on taking the walk.
84 84  
85 85  For the exeperiment we wrote an [[orientation script>>doc:3\. Evaluation.Scenario description.WebHome]] for the participants to introduce them to our design and explain them what they should do and that they should step into the shoes of our persona Bob. Bob is a person with anger issues and dementia. However, the participants did not know whether they are tested with emotion-based or goal-based motivation walk. We also wrote a consent form to ask for their consent to take part in the experiment. One of the main points in the consent from is that they will be recorded. We wanted to record them to re-evaluate all the experiments and see if we missed something. This also helped us with the final results and the discussion. If the participant did not agree, then we of course did not record him/her.
86 86  
87 -Then
86 +The following happend during an experiment:
88 88  
89 -The robot and students need to perform the following tasks:
90 -
91 91  ~1. Pepper will be turned on and will scan/check his environment
92 92  
93 93  2. Pepper will look for a face and will turn to the person that he sees
... ... @@ -98,13 +98,13 @@
98 98  
99 99  5. Pepper will start motivating based on the answer that the student gives:
100 100  
101 - 5.1 When the student says yes, Pepper will start walking with the student and during the walk will have some small talk
102 -5.2 When the student says no, Pepper will start the motivational part of the experiment. For the first experiment Pepper will use emotion-based motivation and for the second experiment Pepper will use the goal-based motivation
103 -5.3 If the student then decides to say yes, then Pepper will start walking with the student and during the walk will have some small talk
104 -6. After the walk/activity is finished Pepper will thank the student and will state again how important it is to stay active
98 + 5a. When the student says yes, Pepper will start walking with the student and during the walk will have some small talk
99 + 5b. When the student says no, Pepper will start the motivational part of the experiment. For the first experiment Pepper will use emotion-based  motivation and for the second experiment Pepper will use the goal-based motivation
100 + 5c. If the student then decides to say yes, then Pepper will start walking with the student and during the walk will have some small talk
105 105  
106 -7. Then the student is asked to answer some questions to evaluate the experience.
102 +During the experiment, one of us wrote down observations of the experiment and another one recoreded the experiment if allowed. We had also prepared a questionnaire to measure our claims, which we talked about in details in the measures section. All the participants had to fill in these questionnaire after the experiment. We wanted to make sure that we had an equal amount of both types of tests to get an unbiased result. Hence, we finished the evaluation once we had a relatively good and equal amount of experiments.
107 107  
104 +
108 108  == 2.6 Material ==
109 109  
110 110  The material needed for this experiment is of course the Pepper robot. We also need a laptop to run the robot.
... ... @@ -138,9 +138,9 @@
138 138  
139 139  As the robot's speech recognition could only understand single words due to its implementation, this resulted in numerous occasions where a participant was not understood and had to repeat themselves. It also occurred that the robot understood 'yes' when 'no' was said.
140 140  
141 -- Mention something about only one participant going into Bob's character fully? And that he mentioned that the "no" he was giving was more attention-seeking than a real no.
138 +In total during all of the evaluations performed, only one participant went into the Bob persona fully, which was described for the participant in the orientation script. He mentioned that the "no" he was giving during the test was more attention-seeking than a real no to the walk, which is a very useful observation.
142 142  
143 -- Add that sometimes the robot cut participants off, if they were speaking slower or elaborating on their answers.
140 +In a couple of the evaluations, it happened that the robot cut participants off mid-sentence once it had recognized a word that was spoken if they were speaking slower or elaborating on their answers. This is not ideal for a future and complete design and definitely would be something that needs to be worked on.
144 144  
145 145  
146 146