Changes for page Test

Last modified by Sofia Kostakonti on 2022/04/05 14:08

From version Icon 88.1 Icon
edited by Aleksanteri Hämäläinen
on 2022/04/03 18:00
Change comment: There is no comment for this version
To version Icon 93.1 Icon
edited by Aleksanteri Hämäläinen
on 2022/04/03 18:46
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -19,7 +19,7 @@
19 19  
20 20  = Method =
21 21  
22 -The prototype is evaluated with an in-person experiment with multiple participants.
22 +The prototype was evaluated with an in-person experiment with multiple participants.
23 23  
24 24  == Participants ==
25 25  
... ... @@ -44,59 +44,52 @@
44 44  1. Welcome participant and explain what they are going to be doing.
45 45  1. Have them sign the permission form.
46 46  1. Complete questionnaire 1 regarding their emotional state (control).
47 +1. Have an interaction with version A of the robot.
48 +1. Complete questionnaire 2 (extended version).
49 +1. Have a short interview during downtime (prepared questions).
50 +1. Have an interaction with version B of the robot.
51 +1. Complete questionnaire 3 (extended version).
52 +1. Have a short interview during downtime (prepared questions).
47 47  
48 -* Have an interaction with version A of the robot.
49 -* Complete questionnaire 2 (extended version).
50 -* Have a short interview during downtime (prepared questions).
51 -* Have an interaction with version B of the robot.
52 -* Complete questionnaire 3 (extended version).
53 -* Have a short interview during downtime (prepared questions).
54 54  
55 +We used the "Wizard of Oz" method for recognizing agreement and disagreement, to make sure that the whole process did not depend on voice recognition being good enough. In practice, this meant that someone was pressing "y" and "n" on the keyboard according to the participants answers in a place the participant did not see, such as behind them.
56 +
55 55  == Material ==
56 56  
57 -For the experiments, we'll be using the NAO robot platform, as well as a laptop for the participants to complete the questionnaires on. The questionnaire will be a combination of questions regarding the emotional state of the participants, their interaction with the robot, and the music included in the interaction. Food will be made available to see and measure how much people will eat.
59 +For the experiments, we used the NAO robot platform, and a laptop to control it with. The participants completed the questionnaires on their phones by scanning a QR code. The questionnaires are a combination of questions regarding the emotional state of the participants, their interaction with the robot, and the music included in the interaction. Stroopwafels and water in a clean cup were made available to see and measure how much people ate.
58 58  
59 -Questionnaires:
60 -Consent Form and Disclaimers
61 -8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire
62 -4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire
63 -3 food-related questions of our own (5-point Likert scale)
64 -2 music-related questions of our own (5-point Likert scale)
61 +Below are listed the contents of the three questionnares:
65 65  
66 -== Practicalities ==
63 +Questionnare 1:
64 +* Consent Form and Disclaimers
65 +* Control for robot version A
66 +** 8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire
67 +** 4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire
67 67  
68 -Beforehand:
69 +Questionnare 2:
70 +* Questions about robot version A
71 +** 3 food-related questions of our own (5-point Likert scale)
72 +** 2 music-related questions of our own (5-point Likert scale)
73 +* Control for robot version B
74 +** 8 questions from the [[EVEA>>https://www.ucm.es/data/cont/docs/39-2013-04-19-EVEA%20-%20Datasheet.pdf]] questionnaire
75 +** 4 questions from the [[Godspeed>>https://www.bartneck.de/2008/03/11/the-godspeed-questionnaire-series/]] questionnaire
69 69  
70 -* Do a practice round by ourselves
71 -** Film this
72 -* Contact other groups and decide on a time slot
73 -** Might be better to reserve in 10 min slots, so that people don't have to wait so much
74 -** If possible, this could be done in parallel with another groups testing
75 -* Reserve lab
76 -* Buy snacks
77 +Questionnare 3:
78 +* Questions about robot version B
79 +** 3 food-related questions of our own (5-point Likert scale)
80 +** 2 music-related questions of our own (5-point Likert scale)
77 77  
78 -During:
82 +== Practicalities ==
79 79  
80 -1. Give starting questionnare to fill while people are waiting for the previous participant
81 -2. Guide the participant to the testing spot
82 -3. Inform the participant where the snacks are
83 -4. Run the first version
84 -5. Give the mid-questionnare
85 -6. Run the other test
86 -7. Conduct the questionnare for the participant
87 -8. Give the participant the end-questionnare
84 +Before the experiment we:
88 88  
89 -Other practicalities during:
86 +* did a practice round by ourselves
87 +** This was filmed to have a controlled performance to give an example of the experiment if needed
88 +* contacted other groups and decide on scheduling
89 +** Each participant was booked a 20 min slot
90 +* reserved the lab
91 +* bought the stroopwafels
90 90  
91 -* We will use the "Wizard of Oz" method for recognizing agreement and disagreement, to make sure that the whole process does not depend on voice recegnition being good enough
92 -** Someone will press eg. "y" and "n" on the keyboard according to the participants answers
93 -* We will change the order in which the smart and basic versions are for each participant
94 -** this way if someone doesn't show up, we don't get skewed amounts
95 -
96 -After:
97 -
98 -* Analyze results
99 -
100 100  = Results =
101 101  
102 102  The results were gathered from 19 personnel, all of whom interacted first with one version of the robot and then the other. 10 of the participants interacted first with the simple version, nine having their first interaction with the advanced version.