Changes for page Test

Last modified by Mathieu Jung-Muller on 2022/04/04 13:52

From version Icon 109.1 Icon
edited by Pietro Piccini
on 2022/04/03 16:03
Change comment: There is no comment for this version
To version Icon 97.1 Icon
edited by Mathieu Jung-Muller
on 2022/04/03 13:55
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.PietroPiccini
1 +XWiki.Mathieu
Content
... ... @@ -186,17 +186,9 @@
186 186  
187 187  == Results ==
188 188  
189 -We produced our results as interactive graphs. Only a printed version is shown below. To get a better version with more information (data point information on mouse hovering for instance), click the provided link for each graph.
189 +=== mood questionnaire results ===
190 190  
191 -For the statistical test, we used the Wilcoxon test because we do not assume that our data is normally distributed.
192 -we used the Wilcoxon Signed-rank test to measure the statistical significance of the mood change before and after Pepper's interaction because the data comes from the same group of participants.
193 -To measure the statistical significance between two different groups (liking gardening group and disliking gardening group) we use the Wilcoxon Rank-Sum test.
194 -The statistics value of the test is the sum of the difference in the rank.
195 -the p-value is the probability of obtaining results at least as extreme as the one we obtained given that the null hypothesis is true. We decided to set a threshold of 5% to claim statistical significance.
196 -
197 -=== Affect assessment ===
198 -
199 -[[Affect assessment, interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
191 +[[interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
200 200  [[image:mood.svg]]
201 201  
202 202  {{html}}
... ... @@ -224,7 +224,7 @@
224 224  <body>
225 225  
226 226  <h5>Wilcoxon Signed-rank test</h5>
227 -<h6><i>H0</i>: The mood distribution before and after the interaction with Pepper is the same.</h6>
219 +<h6><i>H0</i>: The mood distribution before and after the interaction with Pepper is the same</h6>
228 228  
229 229  <table>
230 230   <tr>
... ... @@ -259,10 +259,9 @@
259 259  
260 260  </body>
261 261  </html>
254 +
262 262  {{/html}}
263 263  
264 -The hypothesis H0 is that Pepper does not have any effect. In this case, the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a sligt decrease as well regarding negative feelings.
265 -There are however many biases in these results. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not.
266 266  
267 267  {{html}}
268 268  <!DOCTYPE html>
... ... @@ -289,7 +289,7 @@
289 289  <body>
290 290  
291 291  <h5>Wilcoxon Rank-Sum test</h5>
292 -<h6><i>H0</i>: The mood distribution after the interaction with Pepper for people who like gardening and people who do not like gardening is the same.</h6>
283 +<h6><i>H0</i>: The mood distribution after the interaction with Pepper for people who like gardening and people who don't like gardening is the same</h6>
293 293  
294 294  <table>
295 295   <tr>
... ... @@ -324,16 +324,15 @@
324 324  
325 325  </body>
326 326  </html>
318 +
327 327  {{/html}}
328 328  
329 -We did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
321 +=== System questionnaire results ===
330 330  
331 -
332 -=== System assessment ===
333 -
334 -[[System assessment, first subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
323 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
335 335  [[image:group1.svg]]
336 336  
326 +
337 337  {{html}}
338 338  <!DOCTYPE html>
339 339  <html>
... ... @@ -358,8 +358,8 @@
358 358  </head>
359 359  <body>
360 360  
361 -<h5>Wilcoxon Rank-Sum test</h5>
362 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
351 +<h5>Wilcoxon Rank-Sum test test</h5>
352 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
363 363  
364 364  <table>
365 365   <tr>
... ... @@ -391,14 +391,14 @@
391 391  
392 392  </body>
393 393  </html>
384 +
394 394  {{/html}}
395 395  
396 -In this first system assessment graph, it is shown that participants slightly agree that Pepper made the task easier for them, and generally agree that she was easy to understand.
397 397  
398 -
399 -[[System assessment, second subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
388 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
400 400  [[image:group2.svg]]
401 401  
391 +
402 402  {{html}}
403 403  <!DOCTYPE html>
404 404  <html>
... ... @@ -423,8 +423,8 @@
423 423  </head>
424 424  <body>
425 425  
426 -<h5>Wilcoxon Rank-Sum test</h5>
427 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
416 +<h5>Wilcoxon Rank-Sum test test</h5>
417 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
428 428  
429 429  <table>
430 430   <tr>
... ... @@ -450,13 +450,10 @@
450 450  
451 451  </body>
452 452  </html>
443 +
453 453  {{/html}}
454 454  
455 -The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree.
456 -An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do.
457 -
458 -
459 -[[System assessment, third subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
446 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
460 460  [[image:group3.svg]]
461 461  
462 462  {{html}}
... ... @@ -483,8 +483,8 @@
483 483  </head>
484 484  <body>
485 485  
486 -<h5>Wilcoxon Rank-Sum test</h5>
487 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
473 +<h5>Wilcoxon Rank-Sum test test</h5>
474 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
488 488  
489 489  <table>
490 490   <tr>
... ... @@ -510,14 +510,13 @@
510 510  
511 511  </body>
512 512  </html>
500 +
513 513  {{/html}}
514 514  
515 -The participants globally disagree that the presence of Pepper annoyed, frustrated or pressured them. Those who like gardening actually had a bit more negative feelings regarding the presence of Pepper than those who dislike gardening.
516 -
517 -
518 -[[System assessment, fourth subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_4.html]]
503 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_4.html]]
519 519  [[image:group4.svg]]
520 520  
506 +
521 521  {{html}}
522 522  <!DOCTYPE html>
523 523  <html>
... ... @@ -542,8 +542,8 @@
542 542  </head>
543 543  <body>
544 544  
545 -<h5>Wilcoxon Rank-Sum test</h5>
546 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
531 +<h5>Wilcoxon Rank-Sum test test</h5>
532 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
547 547  
548 548  <table>
549 549   <tr>
... ... @@ -566,10 +566,25 @@
566 566  
567 567  </body>
568 568  </html>
555 +
569 569  {{/html}}
570 570  
571 -This graph shows that the trust in Pepper was highly dependent on whether the participants enjoyed the activity or not.
572 572  
559 +
560 +Since each PwD has its own state of dementia and personal issues, it is very difficult to get uniform results, especially since they are collected orally.
561 +Getting very nice, fully robust and reliable results, is merely a hope and a dream.
562 +However, we can try to consider the main trends that we are interested in.
563 +Thus, the results wil be mainly focused on:
564 +- How much autonomy did the PwD gain?
565 +→ what did the HCP, relatives and PwD report
566 +→ how many tasks did they perform that they didn't do previously
567 +→ did the relatives feel they had more time for themselves
568 +- Did their emotional state improve?
569 +→ feelings from the PwD themselves
570 +→ reports from relatives and HCP
571 +These results will most likely never be yes-no results, but more like clues or hints that show whether some things worked on not, which will be the point of our discussion.
572 +NB: This part explains what we expect as kind of results, it will be replaced by actual results after we perform an experiment with the class. There may also be interesting points we did not think about.
573 +
573 573  == Discussion ==
574 574  
575 575  * Reliability: Yes. One could replicate the same experiment with other patients.
... ... @@ -578,20 +578,6 @@
578 578  * Scope: No. It would be very difficult to generalize the results, since each prototype is built for a special patient. However, if the results conclude that the customized prototypes did improve the well-being of the people, then similar effort to customize Pepper for more patients should produce similar effects.
579 579  * Ecological validity: Yes. Since we compare "without Pepper" (BEFORE) and "with Pepper" (AFTER) in a similar environment (i.e., for everything but Pepper), the results are not dependent on the environment.
580 580  
581 -We analyzed the participants' moods before and after the interaction with Pepper in order to be able to observe positive and negative changes that are caused by Pepper. the results showed that, in general, there is a slight increase in positive moods and a slight decrease in negative moods. The Wilcoxon Signed-rank demonstrated that the only statistically significant change happened for contentness and tiredness based on a p-value threshold of 0.05.
582 -
583 -It is often the case that PwDs have to perform tasks that are not enjoyable for them such as taking medicines or performing routine activities. In order to analyze the difference in the mood change between people who liked the activity and people who didn't we divided into two groups and performed a Wilcoxon Rank-Sum test. The results show that only the contentness mood shows a statistically significant difference between the two groups.
584 -This confirms that PwDs can potentially benefit from a boost of energy from interacting with Pepper and, if the activity is enjoyable, a general improvement in contentness as well.
585 -
586 -
587 -
588 -
589 -
590 -
591 -
592 -
593 -
594 -
595 595  == Conclusions ==
596 596  
597 597  The results from the mood questionnaire seem to support our claims CL10: the PwD feels reassured and CL11: the PwD feels content.