Changes for page Test

Last modified by Mathieu Jung-Muller on 2022/04/04 13:52

From version Icon 113.1 Icon
edited by Mathieu Jung-Muller
on 2022/04/03 20:00
Change comment: There is no comment for this version
To version Icon 114.9 Icon
edited by Sneha Lodha
on 2022/04/04 00:29
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.Mathieu
1 +XWiki.snehalodha
Content
... ... @@ -186,12 +186,13 @@
186 186  
187 187  == Results ==
188 188  
189 -We produced our results as interactive graphs. Only a printed version is shown below. To get a better version with more information (data point information on mouse hovering for instance), click the provided link for each graph.
189 +The following sections contains the results gather from the affect and system assessment. Apart from the printed version being included below, the results are also included as interactive graphs. To get a better version with more information (data point information on mouse hovering for instance), simply click the provided link for each graph.
190 190  
191 191  === Affect assessment ===
192 192  
193 193  [[Affect assessment, interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
194 194  [[image:mood.svg]]
195 +Figure 1: Graphical results of affect assessment before and after conducting the evaluation activity with Pepper.
195 195  
196 196  {{html}}
197 197  <!DOCTYPE html>
... ... @@ -217,12 +217,11 @@
217 217  </head>
218 218  <body>
219 219  
220 -<h5>Wilcoxon Signed-rank test</h5>
221 221  <h6><i>H0</i>: The mood distribution before and after the interaction with Pepper is the same.</h6>
222 222  
223 223  <table>
224 224   <tr>
225 - <th>test results </th>
225 + <th><i>Wilcoxon Signed-Rank results</i></th>
226 226   <th>I feel caring </th>
227 227   <th>I feel content </th>
228 228   <th>I feel calm </th>
... ... @@ -255,9 +255,12 @@
255 255  </html>
256 256  {{/html}}
257 257  
258 -The hypothesis H0 is that Pepper does not have any effect. In this case, the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a sligt decrease as well regarding negative feelings.
259 -There are however many biases in these results. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not.
258 +Table 1: Results of wilcoxon statistical test on affect assessment
260 260  
260 +We analyzed the participants' moods before and after the interaction with Pepper in order to be able to observe positive and negative changes that are caused by the interaction with Pepper. The hypothesis H0 is that Pepper does not have any effect, which would mean that the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a slight decrease as well regarding negative feelings. The Wilcoxon Signed-rank demonstrated that the only statistically significant change happened for contentness and tiredness based on a p-value threshold of 0.05.
261 +
262 +There however exists an important source of bias in the above mentioned result. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not.
263 +
261 261  {{html}}
262 262  <!DOCTYPE html>
263 263  <html>
... ... @@ -282,12 +282,11 @@
282 282  </head>
283 283  <body>
284 284  
285 -<h5>Wilcoxon Rank-Sum test</h5>
286 286  <h6><i>H0</i>: The mood distribution after the interaction with Pepper for people who like gardening and people who do not like gardening is the same.</h6>
287 287  
288 288  <table>
289 289   <tr>
290 - <th>test results </th>
292 + <th><i>Wilcoxon Rank-Sum results</i> </th>
291 291   <th>I feel caring </th>
292 292   <th>I feel content </th>
293 293   <th>I feel calm </th>
... ... @@ -320,14 +320,26 @@
320 320  </html>
321 321  {{/html}}
322 322  
323 -We did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
325 +Table 2: Results of Wilcoxon Rank-Sum statistical test on affect assessment for people who like vs. dislike gardening
324 324  
325 325  
326 -=== System assessment ===
328 +In order to analyze the difference in the mood change between people who liked the activity of gardening and people who did not, we divided the assessments into two groups and performed a Wilcoxon Rank-Sum test. The results show that only the contentness mood shows a statistically significant difference between the two groups. Hence, we did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
327 327  
328 -[[System assessment, first subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
330 +This confirms that PwDs can potentially benefit from a boost of energy from interacting with Pepper and, if the activity is enjoyable, a general improvement in contentness as well.
331 +
332 +
333 +=== System Assessment ===
334 +
335 +**Task Guidance Assessment**
336 +[[System assessment, task guidance questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
337 +The results of the system questionnaire will be divided into four different group with similar questions in each group. This is done to improve the readability of the results and provide a more indepth analysis of various aspects of the system setup.
338 +
329 329  [[image:group1.svg]]
340 +Figure 2: Graphical representation of results for task guidance subset of the system assessment, with results shown for people who like vs. dislike gardening, along with the average of the sample.
330 330  
342 +
343 +The first group, namely task guidance assessment, contains questions aimed at measuring how easy and pleasant was the activity when being guided by Pepper. The responses for this group are around the slightly agree line, a bit higher for the "Pepper was easy to understand" statement and a bit lower for the "I enjoyed the task more than if I had had to do it alone".
344 +
331 331  {{html}}
332 332  <!DOCTYPE html>
333 333  <html>
... ... @@ -352,12 +352,11 @@
352 352  </head>
353 353  <body>
354 354  
355 -<h5>Wilcoxon Rank-Sum test</h5>
356 356  <h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
357 357  
358 358  <table>
359 359   <tr>
360 - <th>test results </th>
373 + <th><i>Wilcoxon Rank-Sum results</i></th>
361 361   <th>I would have known how to do the whole task without Pepper.</th>
362 362   <th>I think Pepper made the task easier for me.</th>
363 363   <th>I enjoyed the task more than if I had had to do it alone.</th>
... ... @@ -387,12 +387,16 @@
387 387  </html>
388 388  {{/html}}
389 389  
390 -In this first system assessment graph, it is shown that participants slightly agree that Pepper made the task easier for them, and generally agree that she was easy to understand.
403 +Table 3: Results of Wilcoxon Rank-Sum statistical test on task guidance subset of system assessment for people who like vs. dislike gardening
391 391  
392 392  
393 -[[System assessment, second subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
406 +**Accomplishment and Autonomy Assessment**
407 +[[System assessment, accomplishment and autonomy subset, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
394 394  [[image:group2.svg]]
409 +Figure 3: Graphical representation of results for accomplishment and autonomy subset of the system assessment, with results shown for people who like vs. dislike gardening, along with the average of the sample.
395 395  
411 +The second group, namely the accomplishment and autonomy subset has questions concerning the sense of control and accomplishment felt during the task by the participants. The participants on average responded between slightly agree and agree that completing the task was a good accomplishment and that they felt in control while doing it and a bit lower for the statement "I feel like I have accomplished it myself" suggestingthat it is possible for the participants to feel like Pepper is responsible, at least partially, for the accomplishment of the task.
412 +
396 396  {{html}}
397 397  <!DOCTYPE html>
398 398  <html>
... ... @@ -417,12 +417,11 @@
417 417  </head>
418 418  <body>
419 419  
420 -<h5>Wilcoxon Rank-Sum test</h5>
421 421  <h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
422 422  
423 423  <table>
424 424   <tr>
425 - <th>test results </th>
441 + <th><i>Wilcoxon Rank-Sum results </i></th>
426 426   <th>I feel like completing the task was a good accomplishment.</th>
427 427   <th>I feel like I accomplished it myself.</th>
428 428   <th>I felt in control of what I had to do.</th>
... ... @@ -446,10 +446,12 @@
446 446  </html>
447 447  {{/html}}
448 448  
449 -The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree.
450 -An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do.
465 +Table 4: Results of Wilcoxon Rank-Sum statistical test on accomplishment and autonomy subset of system assessment for people who like vs. dislike gardening
451 451  
452 452  
468 +The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree. An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do.
469 +
470 +
453 453  [[System assessment, third subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
454 454  [[image:group3.svg]]
455 455