Changes for page Test

Last modified by Mathieu Jung-Muller on 2022/04/04 13:52

From version Icon 108.1 Icon
edited by Pietro Piccini
on 2022/04/03 15:56
Change comment: There is no comment for this version
To version Icon 101.1 Icon
edited by Mathieu Jung-Muller
on 2022/04/03 14:06
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.PietroPiccini
1 +XWiki.Mathieu
Content
... ... @@ -188,19 +188,11 @@
188 188  
189 189  We produced our results as interactive graphs. Only a printed version is shown below. To get a better version with more information (data point information on mouse hovering for instance), click the provided link for each graph.
190 190  
191 -For the statistical test, we used the Wilcoxon test because we do not assume that our data is normally distributed.
192 -we used the Wilcoxon Signed-rank test to measure the statistical significance of the mood change before and after Pepper's interaction because the data comes from the same group of participants.
193 -To measure the statistical significance between two different groups (liking gardening group and disliking gardening group) we use the Wilcoxon Rank-Sum test.
194 -The statistics value of the test is the sum of the difference in the rank.
195 -the p-value is the probability of obtaining results at least as extreme as the one we obtained given that the null hypothesis is true. We decided to set a threshold of 5% to claim statistical significance.
196 -
197 197  === Affect assessment ===
198 198  
199 199  [[Affect assessment, interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
200 200  [[image:mood.svg]]
201 -
202 -{{html}}
203 -<!DOCTYPE html>
195 +{{html}}<!DOCTYPE html>
204 204  <html>
205 205  <head>
206 206  <style>
... ... @@ -324,6 +324,7 @@
324 324  
325 325  </body>
326 326  </html>
319 +
327 327  {{/html}}
328 328  
329 329  We did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
... ... @@ -333,9 +333,7 @@
333 333  
334 334  [[System assessment, first subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
335 335  [[image:group1.svg]]
336 -
337 -{{html}}
338 -<!DOCTYPE html>
329 +{{html}}<!DOCTYPE html>
339 339  <html>
340 340  <head>
341 341  <style>
... ... @@ -398,9 +398,7 @@
398 398  
399 399  [[System assessment, second subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
400 400  [[image:group2.svg]]
401 -
402 -{{html}}
403 -<!DOCTYPE html>
392 +{{html}}<!DOCTYPE html>
404 404  <html>
405 405  <head>
406 406  <style>
... ... @@ -458,9 +458,7 @@
458 458  
459 459  [[System assessment, third subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
460 460  [[image:group3.svg]]
461 -
462 -{{html}}
463 -<!DOCTYPE html>
450 +{{html}}<!DOCTYPE html>
464 464  <html>
465 465  <head>
466 466  <style>
... ... @@ -517,9 +517,7 @@
517 517  
518 518  [[System assessment, fourth subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_4.html]]
519 519  [[image:group4.svg]]
520 -
521 -{{html}}
522 -<!DOCTYPE html>
507 +{{html}}<!DOCTYPE html>
523 523  <html>
524 524  <head>
525 525  <style>
... ... @@ -578,18 +578,19 @@
578 578  * Scope: No. It would be very difficult to generalize the results, since each prototype is built for a special patient. However, if the results conclude that the customized prototypes did improve the well-being of the people, then similar effort to customize Pepper for more patients should produce similar effects.
579 579  * Ecological validity: Yes. Since we compare "without Pepper" (BEFORE) and "with Pepper" (AFTER) in a similar environment (i.e., for everything but Pepper), the results are not dependent on the environment.
580 580  
581 -We analyzed the participants' moods before and after the interaction with Pepper in order to be able to observe positive and negative changes that are caused by Pepper. the results showed that, in general, there is a slight increase in positive moods and a slight decrease in negative moods. The Wilcoxon Signed-rank demonstrated that the only statistically significant change happened for contentness and tiredness based on a p-value threshold of 0.05.
566 +== Conclusions ==
582 582  
583 -It is often the case that PwDs have to perform tasks that are not enjoyable for them such as taking medicines or performing routine activities. In order to analyze the difference in the mood change between people who liked the activity and people who didn't we divided into two groups and performed a Wilcoxon Rank-Sum test. The results show that only the contentness mood shows a statistically significant difference between the two groups.
584 -This confirms that PwDs can potentially benefit from a boost of energy from interacting with Pepper and, if the activity is enjoyable, a general improvement in contentness as well.
568 +The results from the mood questionnaire seem to support our claims CL10: the PwD feels reassured and CL11: the PwD feels content.
569 +Although there are many potential biases, there seems to be a general trend which is that the mood of the participants slightly improved thanks to the activity.
585 585  
571 +All participants, except one who asked to leave the experiment early, finished the whole activity we had prepared for them during the session. This means the participants were able to perform activity steps told by Pepper. This supports our claim CL03: the PwD performs an activity step.
586 586  
573 +No participant failed to notice Pepper or did not hear what she was saying after the experiment had started. This supports our claim CL01: the PwD becomes aware of Pepper's presence.
587 587  
575 +From the system assessment questionnaire, participants quite agree that completing the task was a good accomplishment for them. This supports our claim CL08: the PwD feels accomplished.
588 588  
577 +We did not have any question explictly aimed at targeting our claim CL08. However, frustration, annoyance and pressure are often linked to a lack of understanding from the other part. We can combine these with the question about whether Pepper cared about helping the participants, and with our observations during the experiment. When aggregated together, it seems that generally speaking, the participants felt understood. This supports our claim CL08: the PwD feels understood. However, we did notice frustration a couple of times from the participants, because of Pepper's speech recognition system.
589 589  
590 -
591 -== Conclusions ==
592 -
593 593  The results from the mood questionnaire seem to support our claims CL10: the PwD feels reassured and CL11: the PwD feels content.
594 594  Although there are many potential biases, there seems to be a general trend which is that the mood of the participants slightly improved thanks to the activity.
595 595