Changes for page Test
Last modified by Sofia Kostakonti on 2022/04/05 14:08
From version
88.1


edited by Aleksanteri Hämäläinen
on 2022/04/03 18:00
on 2022/04/03 18:00
Change comment:
There is no comment for this version
To version
93.1


edited by Aleksanteri Hämäläinen
on 2022/04/03 18:46
on 2022/04/03 18:46
Change comment:
There is no comment for this version
Summary
Details
- Page properties
-
- Content
-
... ... @@ -19,7 +19,7 @@ 19 19 20 20 = Method = 21 21 22 -The prototype is evaluated with an in-person experiment with multiple participants.22 +The prototype was evaluated with an in-person experiment with multiple participants. 23 23 24 24 == Participants == 25 25 ... ... @@ -44,59 +44,52 @@ 44 44 1. Welcome participant and explain what they are going to be doing. 45 45 1. Have them sign the permission form. 46 46 1. Complete questionnaire 1 regarding their emotional state (control). 47 +1. Have an interaction with version A of the robot. 48 +1. Complete questionnaire 2 (extended version). 49 +1. Have a short interview during downtime (prepared questions). 50 +1. Have an interaction with version B of the robot. 51 +1. Complete questionnaire 3 (extended version). 52 +1. Have a short interview during downtime (prepared questions). 47 47 48 -* Have an interaction with version A of the robot. 49 -* Complete questionnaire 2 (extended version). 50 -* Have a short interview during downtime (prepared questions). 51 -* Have an interaction with version B of the robot. 52 -* Complete questionnaire 3 (extended version). 53 -* Have a short interview during downtime (prepared questions). 54 54 55 +We used the "Wizard of Oz" method for recognizing agreement and disagreement, to make sure that the whole process did not depend on voice recognition being good enough. In practice, this meant that someone was pressing "y" and "n" on the keyboard according to the participants answers in a place the participant did not see, such as behind them. 56 + 55 55 == Material == 56 56 57 -For the experiments, we 'llbeusingthe NAO robot platform, aswellasalaptopfor the participantstocomplete the questionnaires on. The questionnairewill be a combination of questions regarding the emotional state of the participants, their interaction with the robot, and the music included in the interaction.Food willbe made available to see and measure how much peoplewill eat.59 +For the experiments, we used the NAO robot platform, and a laptop to control it with. The participants completed the questionnaires on their phones by scanning a QR code. The questionnaires are a combination of questions regarding the emotional state of the participants, their interaction with the robot, and the music included in the interaction. Stroopwafels and water in a clean cup were made available to see and measure how much people ate. 58 58 59 -Questionnaires: 60 -Consent Form and Disclaimers 61 -8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire 62 -4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire 63 -3 food-related questions of our own (5-point Likert scale) 64 -2 music-related questions of our own (5-point Likert scale) 61 +Below are listed the contents of the three questionnares: 65 65 66 -== Practicalities == 63 +Questionnare 1: 64 +* Consent Form and Disclaimers 65 +* Control for robot version A 66 +** 8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire 67 +** 4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire 67 67 68 -Beforehand: 69 +Questionnare 2: 70 +* Questions about robot version A 71 +** 3 food-related questions of our own (5-point Likert scale) 72 +** 2 music-related questions of our own (5-point Likert scale) 73 +* Control for robot version B 74 +** 8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire 75 +** 4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire 69 69 70 -* Do a practice round by ourselves 71 -** Film this 72 -* Contact other groups and decide on a time slot 73 -** Might be better to reserve in 10 min slots, so that people don't have to wait so much 74 -** If possible, this could be done in parallel with another groups testing 75 -* Reserve lab 76 -* Buy snacks 77 +Questionnare 3: 78 +* Questions about robot version B 79 +** 3 food-related questions of our own (5-point Likert scale) 80 +** 2 music-related questions of our own (5-point Likert scale) 77 77 78 - During:82 +== Practicalities == 79 79 80 -1. Give starting questionnare to fill while people are waiting for the previous participant 81 -2. Guide the participant to the testing spot 82 -3. Inform the participant where the snacks are 83 -4. Run the first version 84 -5. Give the mid-questionnare 85 -6. Run the other test 86 -7. Conduct the questionnare for the participant 87 -8. Give the participant the end-questionnare 84 +Before the experiment we: 88 88 89 -Other practicalities during: 86 +* did a practice round by ourselves 87 +** This was filmed to have a controlled performance to give an example of the experiment if needed 88 +* contacted other groups and decide on scheduling 89 +** Each participant was booked a 20 min slot 90 +* reserved the lab 91 +* bought the stroopwafels 90 90 91 -* We will use the "Wizard of Oz" method for recognizing agreement and disagreement, to make sure that the whole process does not depend on voice recegnition being good enough 92 -** Someone will press eg. "y" and "n" on the keyboard according to the participants answers 93 -* We will change the order in which the smart and basic versions are for each participant 94 -** this way if someone doesn't show up, we don't get skewed amounts 95 - 96 -After: 97 - 98 -* Analyze results 99 - 100 100 = Results = 101 101 102 102 The results were gathered from 19 personnel, all of whom interacted first with one version of the robot and then the other. 10 of the participants interacted first with the simple version, nine having their first interaction with the advanced version.