Changes for page Test
Last modified by Mathieu Jung-Muller on 2022/04/04 13:52
From version
104.1


edited by Mathieu Jung-Muller
on 2022/04/03 14:16
on 2022/04/03 14:16
Change comment:
There is no comment for this version
To version
111.1


edited by Pietro Piccini
on 2022/04/03 16:58
on 2022/04/03 16:58
Change comment:
There is no comment for this version
Summary
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. Mathieu1 +XWiki.PietroPiccini - Content
-
... ... @@ -192,7 +192,9 @@ 192 192 193 193 [[Affect assessment, interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]] 194 194 [[image:mood.svg]] 195 -{{html}}<!DOCTYPE html> 195 + 196 +{{html}} 197 +<!DOCTYPE html> 196 196 <html> 197 197 <head> 198 198 <style> ... ... @@ -250,7 +250,8 @@ 250 250 </table> 251 251 252 252 </body> 253 -</html>{{/html}} 255 +</html> 256 +{{/html}} 254 254 255 255 The hypothesis H0 is that Pepper does not have any effect. In this case, the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a sligt decrease as well regarding negative feelings. 256 256 There are however many biases in these results. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not. ... ... @@ -315,7 +315,6 @@ 315 315 316 316 </body> 317 317 </html> 318 - 319 319 {{/html}} 320 320 321 321 We did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement. ... ... @@ -325,7 +325,9 @@ 325 325 326 326 [[System assessment, first subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]] 327 327 [[image:group1.svg]] 328 -{{html}}<!DOCTYPE html> 330 + 331 +{{html}} 332 +<!DOCTYPE html> 329 329 <html> 330 330 <head> 331 331 <style> ... ... @@ -380,7 +380,8 @@ 380 380 </table> 381 381 382 382 </body> 383 -</html>{{/html}} 387 +</html> 388 +{{/html}} 384 384 385 385 In this first system assessment graph, it is shown that participants slightly agree that Pepper made the task easier for them, and generally agree that she was easy to understand. 386 386 ... ... @@ -387,7 +387,9 @@ 387 387 388 388 [[System assessment, second subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]] 389 389 [[image:group2.svg]] 390 -{{html}}<!DOCTYPE html> 395 + 396 +{{html}} 397 +<!DOCTYPE html> 391 391 <html> 392 392 <head> 393 393 <style> ... ... @@ -436,7 +436,8 @@ 436 436 </table> 437 437 438 438 </body> 439 -</html>{{/html}} 446 +</html> 447 +{{/html}} 440 440 441 441 The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree. 442 442 An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do. ... ... @@ -503,7 +503,9 @@ 503 503 504 504 [[System assessment, fourth subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_4.html]] 505 505 [[image:group4.svg]] 506 -{{html}}<!DOCTYPE html> 514 + 515 +{{html}} 516 +<!DOCTYPE html> 507 507 <html> 508 508 <head> 509 509 <style> ... ... @@ -549,7 +549,8 @@ 549 549 </table> 550 550 551 551 </body> 552 -</html>{{/html}} 562 +</html> 563 +{{/html}} 553 553 554 554 This graph shows that the trust in Pepper was highly dependent on whether the participants enjoyed the activity or not. 555 555 ... ... @@ -561,6 +561,41 @@ 561 561 * Scope: No. It would be very difficult to generalize the results, since each prototype is built for a special patient. However, if the results conclude that the customized prototypes did improve the well-being of the people, then similar effort to customize Pepper for more patients should produce similar effects. 562 562 * Ecological validity: Yes. Since we compare "without Pepper" (BEFORE) and "with Pepper" (AFTER) in a similar environment (i.e., for everything but Pepper), the results are not dependent on the environment. 563 563 575 +**mood questionnaire** 576 + 577 +We analyzed the participants' moods before and after the interaction with Pepper in order to be able to observe positive and negative changes that are caused by the interaction with Pepper. the results showed that, in general, there is a slight increase in positive moods and a slight decrease in negative moods. The Wilcoxon Signed-rank demonstrated that the only statistically significant change happened for contentness and tiredness based on a p-value threshold of 0.05. 578 + 579 +It is often the case that PwDs have to perform tasks that are not enjoyable for them such as taking medicines or performing routine activities. In order to analyze the difference in the mood change between people who liked the activity and people who didn't we divided into two groups and performed a Wilcoxon Rank-Sum test. The results show that only the contentness mood shows a statistically significant difference between the two groups. 580 +This confirms that PwDs can potentially benefit from a boost of energy from interacting with Pepper and, if the activity is enjoyable, a general improvement in contentness as well. 581 + 582 +**system questionnaire** 583 + 584 +We divided the results from the system questionnaire into 4 separate groups containing similar questions as illustrated by the 4 different graphs above. 585 + 586 +The first group contains questions aimed at measuring how easy and pleasant was the activity when being guided by Pepper. The responses for this group are around the slightly agree line, a bit higher for the "Pepper was easy to understand" statement and a bit lower for the "I enjoyed the task more than if I had had to do it alone". 587 + 588 +The second group has questions concerning the sense of control and accomplishment felt during the task by the participants. The participants on average responded between slightly agree and agree that completing the task was a good accomplishment and that they felt in control while doing it and a bit lower for the statement "I feel like I have accomplished it myself" suggesting 589 +that it is possible for the participants to feel like Pepper is responsible, at least partially, for the accomplishment of the task. 590 + 591 +The third group is used to group together questions that measure negative experiences with Pepper. The results show that the participants on average answered between slightly disagree and disagreed. This suggests that Pepper was not frustrating for most people but only for a small fraction of the participants. 592 + 593 +The fourth and final group is for assessing Pepper's social presence and trustworthiness as felt by the participants. The two statements used are "Pepper cared about helping me" and "I would trust Pepper with more important activities". The responses were on average slightly above the neutral level. 594 + 595 +We performed a statistical test for the system questionnaire to see if the difference between the "like gardening" group and the "dislike gardening" group is significant in any of the questions. The results didn't show any statistical significance with the exception of the question "I would trust Pepper with more important activities" which showed that people who liked gardening were more likely to trust Pepper with more important activities. 596 + 597 +**observations** 598 + 599 +Despite having on average good results, some participants still found Pepper frustrating or annoying. In order to understand what could have caused that we analyzed the video of the interaction and the feedback from the participants. We observed that when a participant felt frustrated was often due to Pepper's limitation. For example, sometimes Pepper would start listening too late missing part of the participant's answer. It is also common for the participant to say a word that Pepper is not able to understand which can result in the participant being stuck in a loop during the conversation which can be frustrating. We notice that in most of the experiments the experience and the ease of the interaction with Pepper improved as the participant learned how to interact with Pepper. 600 + 601 + 602 + 603 + 604 + 605 + 606 + 607 + 608 + 609 + 564 564 == Conclusions == 565 565 566 566 The results from the mood questionnaire seem to support our claims CL10: the PwD feels reassured and CL11: the PwD feels content.