Changes for page b. Test

Last modified by Demi Breen on 2023/04/09 15:10

From version 24.1
edited by Hugo van Dijk
on 2023/03/30 15:15
Change comment: There is no comment for this version
To version 29.1
edited by Hugo van Dijk
on 2023/03/30 18:53
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -113,59 +113,26 @@
113 113  Firstly, the Jarque-Bera test [2] was used to check for normality. When the answers for a question weren't normally distributed, the Mann-Whitney U-Test [3] was used. For normally distributed answers, the T-Test [4] was used. These tests used the null hypothesis that there is no significant difference between the two groups. When the calculated probability value (p-value) is less than 0.05, we can reject the null hypothesis and conclude that there is a significant difference between the two groups for the answers to that question.
114 114  
115 115  
116 -Even though the mean rejections were higher for emotion-based (0,875) than for goal-based(0,125). This difference was not significant.
116 +Even though the average rejections were higher for emotion-based (0,875) than for goal-based(0,125). This difference was not significant.
117 117  
118 -Furthermore, there was no significant difference in questionnaire answers between the two groups.
118 +Furthermore, there was no significant difference in any of the questionnaire answers between the two groups.
119 119  
120 -The table below shows the p-value per measure.
120 +[[This table>>doc:.p-values.WebHome]] shows the p-value per measure.
121 121  
122 -|**Question / Measure**|**Mean group A**|**Mean group B**|**P-value**
123 -|//Amount of times said no//|//0,875//|//0,125//|//0,17//
124 -|If I should use the robot, I would be afraid to make mistakes with it|2,875|3,5|0,09
125 -|If I should use the robot, I would be afraid to break something|3,625|3,25|0,44
126 -|I find the robot scary|1,875|2,25|0,50
127 -|I find the robot intimidating|1,875|2,25|0,57
128 -|I think it’s a good idea to use the robot|3,375|3,875|0,23
129 -|the robot would make my life more interesting|3,875|4|0,60
130 -|It’s good to make use of the robot|4|4|1,00
131 -|I have everything I need to make good use of the robot|3,625|3,375|0,56
132 -|I know enough of the robot to make good use of it|3,125|2,75|0,60
133 -|I think I’ll use the robot during the next few days|3,875|3,625|0,30
134 -|I am certain to use the robot during the next few days|3,125|3,25|0,68
135 -|I’m planning to use the robot during the next few days|3,625|3,25|0,20
136 -|I think the robot can be adaptive to what I need|3,625|3,25|0,28
137 -|I think the robot will only do what I need at that particular moment|3,625|3,75|0,76
138 -|I think the robot will help me when I consider it to be necessary|3,75|3,625|0,76
139 -|I enjoy the robot talking to me|4|3,75|0,52
140 -|I enjoy doing things with the robot|3,625|4|0,22
141 -|I find the robot enjoyable|3,75|4|0,34
142 -|I find the robot fascinating|4,25|3,75|0,17
143 -|I find the robot boring|2|2,375|0,28
144 -|I think I will know quickly how to use the robot|3,125|2,75|0,48
145 -|I find the robot easy to use|3,375|3|0,57
146 -|I think I can use the robot without any help|3,25|3|0,77
147 -|I think I can use the robot when there is someone around to help me|4|4,125|0,83
148 -|I think I can use the robot when I have a good manual|3,625|3|0,37
149 -|I consider the robot a pleasant conversational partner|3,25|3,5|0,63
150 -|I find the robot pleasant to interact with|3,875|3,625|0,56
151 -|I feel the robot understands me|3|3,125|0,73
152 -|I think the robot is nice|4,125|4|0,76
153 -|I think the robot is useful to me|3,375|3,75|0,28
154 -|It would be convenient for me to have the robot|3,625|3,875|0,56
155 -|I think the robot can help me with many things|3,375|3|0,60
156 -|I think the staff would like me using the robot|4,25|3,875|0,35
157 -|I think it would give a good impression if I should use the robot|3,75|3,75|1,00
158 -|When interacting with the robot I felt like I’m talking to a real person|2,625|2,5|0,78
159 -|It sometimes felt as if the robot was really looking at me|3,125|3,25|0,78
160 -|I can imagine the robot to be a living creature|3,125|2,75|0,61
161 -|I often think the robot is not a real person|3,25|3|0,52
162 -|Sometimes the robot seems to have real feelings|2,125|2,5|0,20
163 -|I would trust the robot if it gave me advice|2,875|3,125|0,63
164 -|I would follow the advice the robot gives me|3,375|3,25|0,82
165 -|The reasons the robot gave to go on a walk convinced me|3,25|3,5|0,68
166 -|The robot insisted too much on going on a walk|2,25|2,375|0,76
167 -|If the robot had not asked me to go on a walk, I would not have gone|3,875|3,75|0,78
168 168  
123 +When asked the reason that convinced the participant to join the robot on a walk, two out of the six participants that said yes eventually in the emotion-based system recited one of the persuasion subjects. For the goal-based system, this was three out of eight.
124 +
125 +When participants were standing too close to the robot, it wouldn't walk. This happened in numerous times, resulting in conversation without walking.
126 +
127 +General remarks made by participants evaluating the emotion-based system were only about the walking aspect of the robot, stating that the walking distance should be increased and the change in direction was quite sharp. Participants doing the goal-based evaluation commented on the lacking speech recognition system and stated that it might be useful to start with asking how the participant feels.
128 +
129 +Even though it was specified at the start of every session that the participant can say either yes or no to the robot's persuasion attempts, we noticed that some participants did not seem to grasp the fact that they could say no. At the end of their session, one participant stated that he was not persuaded by the robot at all, even though they said yes on the robot's first persuasion attempt.
130 +\\Another participant, who said no to all persuasion attempts, stated afterwards that they "Just wanted to see what would happen if I said no all the time".  This indicated that some participants already had a plan of how many times they would reject the robot before starting, and did not really listen to the persuasions made.
131 +
132 +As the robot's speech recognition could only understand single words due to its implementation, this resulted in numerous occasions where a participant was not understood and had to repeat themselves. It also occurred that the robot understood 'yes' when 'no' was said.
133 +
134 +
135 +
169 169  = 4. Discussion =
170 170  
171 171