Changes for page Test

Last modified by Mathieu Jung-Muller on 2022/04/04 13:52

From version Icon 101.1 Icon
edited by Mathieu Jung-Muller
on 2022/04/03 14:06
Change comment: There is no comment for this version
To version Icon 97.1 Icon
edited by Mathieu Jung-Muller
on 2022/04/03 13:55
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -186,13 +186,13 @@
186 186  
187 187  == Results ==
188 188  
189 -We produced our results as interactive graphs. Only a printed version is shown below. To get a better version with more information (data point information on mouse hovering for instance), click the provided link for each graph.
189 +=== mood questionnaire results ===
190 190  
191 -=== Affect assessment ===
192 -
193 -[[Affect assessment, interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
191 +[[interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
194 194  [[image:mood.svg]]
195 -{{html}}<!DOCTYPE html>
193 +
194 +{{html}}
195 +<!DOCTYPE html>
196 196  <html>
197 197  <head>
198 198  <style>
... ... @@ -216,7 +216,7 @@
216 216  <body>
217 217  
218 218  <h5>Wilcoxon Signed-rank test</h5>
219 -<h6><i>H0</i>: The mood distribution before and after the interaction with Pepper is the same.</h6>
219 +<h6><i>H0</i>: The mood distribution before and after the interaction with Pepper is the same</h6>
220 220  
221 221  <table>
222 222   <tr>
... ... @@ -251,10 +251,9 @@
251 251  
252 252  </body>
253 253  </html>
254 +
254 254  {{/html}}
255 255  
256 -The hypothesis H0 is that Pepper does not have any effect. In this case, the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a sligt decrease as well regarding negative feelings.
257 -There are however many biases in these results. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not.
258 258  
259 259  {{html}}
260 260  <!DOCTYPE html>
... ... @@ -281,7 +281,7 @@
281 281  <body>
282 282  
283 283  <h5>Wilcoxon Rank-Sum test</h5>
284 -<h6><i>H0</i>: The mood distribution after the interaction with Pepper for people who like gardening and people who do not like gardening is the same.</h6>
283 +<h6><i>H0</i>: The mood distribution after the interaction with Pepper for people who like gardening and people who don't like gardening is the same</h6>
285 285  
286 286  <table>
287 287   <tr>
... ... @@ -319,14 +319,14 @@
319 319  
320 320  {{/html}}
321 321  
322 -We did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
321 +=== System questionnaire results ===
323 323  
323 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
324 +[[image:group1.svg]]
324 324  
325 -=== System assessment ===
326 326  
327 -[[System assessment, first subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
328 -[[image:group1.svg]]
329 -{{html}}<!DOCTYPE html>
327 +{{html}}
328 +<!DOCTYPE html>
330 330  <html>
331 331  <head>
332 332  <style>
... ... @@ -349,8 +349,8 @@
349 349  </head>
350 350  <body>
351 351  
352 -<h5>Wilcoxon Rank-Sum test</h5>
353 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
351 +<h5>Wilcoxon Rank-Sum test test</h5>
352 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
354 354  
355 355  <table>
356 356   <tr>
... ... @@ -382,14 +382,16 @@
382 382  
383 383  </body>
384 384  </html>
384 +
385 385  {{/html}}
386 386  
387 -In this first system assessment graph, it is shown that participants slightly agree that Pepper made the task easier for them, and generally agree that she was easy to understand.
388 388  
389 -
390 -[[System assessment, second subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
388 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
391 391  [[image:group2.svg]]
392 -{{html}}<!DOCTYPE html>
390 +
391 +
392 +{{html}}
393 +<!DOCTYPE html>
393 393  <html>
394 394  <head>
395 395  <style>
... ... @@ -412,8 +412,8 @@
412 412  </head>
413 413  <body>
414 414  
415 -<h5>Wilcoxon Rank-Sum test</h5>
416 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
416 +<h5>Wilcoxon Rank-Sum test test</h5>
417 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
417 417  
418 418  <table>
419 419   <tr>
... ... @@ -439,15 +439,14 @@
439 439  
440 440  </body>
441 441  </html>
443 +
442 442  {{/html}}
443 443  
444 -The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree.
445 -An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do.
446 -
447 -
448 -[[System assessment, third subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
446 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
449 449  [[image:group3.svg]]
450 -{{html}}<!DOCTYPE html>
448 +
449 +{{html}}
450 +<!DOCTYPE html>
451 451  <html>
452 452  <head>
453 453  <style>
... ... @@ -470,8 +470,8 @@
470 470  </head>
471 471  <body>
472 472  
473 -<h5>Wilcoxon Rank-Sum test</h5>
474 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
473 +<h5>Wilcoxon Rank-Sum test test</h5>
474 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
475 475  
476 476  <table>
477 477   <tr>
... ... @@ -497,14 +497,15 @@
497 497  
498 498  </body>
499 499  </html>
500 +
500 500  {{/html}}
501 501  
502 -The participants globally disagree that the presence of Pepper annoyed, frustrated or pressured them. Those who like gardening actually had a bit more negative feelings regarding the presence of Pepper than those who dislike gardening.
503 +[[interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_4.html]]
504 +[[image:group4.svg]]
503 503  
504 504  
505 -[[System assessment, fourth subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_4.html]]
506 -[[image:group4.svg]]
507 -{{html}}<!DOCTYPE html>
507 +{{html}}
508 +<!DOCTYPE html>
508 508  <html>
509 509  <head>
510 510  <style>
... ... @@ -527,8 +527,8 @@
527 527  </head>
528 528  <body>
529 529  
530 -<h5>Wilcoxon Rank-Sum test</h5>
531 -<h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
531 +<h5>Wilcoxon Rank-Sum test test</h5>
532 +<h6><i>H0</i>: The distribution of the sytem's questionnaire answers from people who like gardening and form people who don't like gardening is the same</h6>
532 532  
533 533  <table>
534 534   <tr>
... ... @@ -551,10 +551,25 @@
551 551  
552 552  </body>
553 553  </html>
555 +
554 554  {{/html}}
555 555  
556 -This graph shows that the trust in Pepper was highly dependent on whether the participants enjoyed the activity or not.
557 557  
559 +
560 +Since each PwD has its own state of dementia and personal issues, it is very difficult to get uniform results, especially since they are collected orally.
561 +Getting very nice, fully robust and reliable results, is merely a hope and a dream.
562 +However, we can try to consider the main trends that we are interested in.
563 +Thus, the results wil be mainly focused on:
564 +- How much autonomy did the PwD gain?
565 +→ what did the HCP, relatives and PwD report
566 +→ how many tasks did they perform that they didn't do previously
567 +→ did the relatives feel they had more time for themselves
568 +- Did their emotional state improve?
569 +→ feelings from the PwD themselves
570 +→ reports from relatives and HCP
571 +These results will most likely never be yes-no results, but more like clues or hints that show whether some things worked on not, which will be the point of our discussion.
572 +NB: This part explains what we expect as kind of results, it will be replaced by actual results after we perform an experiment with the class. There may also be interesting points we did not think about.
573 +
558 558  == Discussion ==
559 559  
560 560  * Reliability: Yes. One could replicate the same experiment with other patients.
... ... @@ -575,14 +575,3 @@
575 575  From the system assessment questionnaire, participants quite agree that completing the task was a good accomplishment for them. This supports our claim CL08: the PwD feels accomplished.
576 576  
577 577  We did not have any question explictly aimed at targeting our claim CL08. However, frustration, annoyance and pressure are often linked to a lack of understanding from the other part. We can combine these with the question about whether Pepper cared about helping the participants, and with our observations during the experiment. When aggregated together, it seems that generally speaking, the participants felt understood. This supports our claim CL08: the PwD feels understood. However, we did notice frustration a couple of times from the participants, because of Pepper's speech recognition system.
578 -
579 -The results from the mood questionnaire seem to support our claims CL10: the PwD feels reassured and CL11: the PwD feels content.
580 -Although there are many potential biases, there seems to be a general trend which is that the mood of the participants slightly improved thanks to the activity.
581 -
582 -All participants, except one who asked to leave the experiment early, finished the whole activity we had prepared for them during the session. This means the participants were able to perform activity steps told by Pepper. This supports our claim CL03: the PwD performs an activity step.
583 -
584 -No participant failed to notice Pepper or did not hear what she was saying after the experiment had started. This supports our claim CL01: the PwD becomes aware of Pepper's presence.
585 -
586 -From the system assessment questionnaire, participants quite agree that completing the task was a good accomplishment for them. This supports our claim CL08: the PwD feels accomplished.
587 -
588 -We did not have any question explictly aimed at targeting our claim CL08. However, frustration, annoyance and pressure are often linked to a lack of understanding from the other part. We can combine these with the question about whether Pepper cared about helping the participants, and with our observations during the experiment. When aggregated together, it seems that generally speaking, the participants felt understood. This supports our claim CL08: the PwD feels understood. However, we did notice frustration a couple of times from the participants, because of Pepper's speech recognition system.