Changes for page Test

Last modified by Mathieu Jung-Muller on 2022/04/04 13:52

From 112.1 to 113.1 From 114.10 to 114.11

From version

113.1

edited by Mathieu Jung-Muller
on 2022/04/03 20:00

Change comment: There is no comment for this version

To version

114.10

edited by Sneha Lodha
on 2022/04/04 00:32

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (2 modified, 0 added, 0 removed)

Details

Page properties

Author

@@ -1,1 +1,1 @@
--XWiki.Mathieu
++XWiki.snehalodha

Content

@@ -186,12 +186,13 @@
  == Results ==
--We produced our results as interactive graphs. Only a printed version is shown below. To get a better version with more information (data point information on mouse hovering for instance), click the provided link for each graph.
++The following sections contains the results gather from the affect and system assessment. Apart from the printed version being included below, the results are also included as interactive graphs. To get a better version with more information (data point information on mouse hovering for instance), simply click the provided link for each graph.
  === Affect assessment ===
  [[Affect assessment, interactive version>>https://pietro99.github.io/SCE/graphs/mood_questionnaire.html]]
  [[image:mood.svg]]
++Figure 1: Graphical results of affect assessment before and after conducting the evaluation activity with Pepper.
  {{html}}
  <!DOCTYPE html>
@@ -217,12 +217,11 @@
  </head>
  <body>
--<h5>Wilcoxon Signed-rank test</h5>
  <h6><i>H0</i>: The mood distribution before and after the interaction with Pepper is the same.</h6>
  <table>
    <tr>
--    <th>test results </th>
++    <th><i>Wilcoxon Signed-Rank results</i></th>
      <th>I feel caring </th>
      <th>I feel content </th>
      <th>I feel calm </th>
@@ -255,9 +255,12 @@
  </html>
  {{/html}}
--The hypothesis H0 is that Pepper does not have any effect. In this case, the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a sligt decrease as well regarding negative feelings.
--There are however many biases in these results. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not.
++Table 1: Results of wilcoxon statistical test on affect assessment
++We analyzed the participants' moods before and after the interaction with Pepper in order to be able to observe positive and negative changes that are caused by the interaction with Pepper. The hypothesis H0 is that Pepper does not have any effect, which would mean that the questionnaires 1 and 2 should give the exact same values for each of the six feelings. However, the graphs and table below show that there is a slight increase regarding positive feelings, and a slight decrease as well regarding negative feelings. The Wilcoxon Signed-rank demonstrated that the only statistically significant change happened for contentness and tiredness based on a p-value threshold of 0.05.
++
++There however exists an important source of bias in the above mentioned result. The main one that we isolated is that the activity of gardening itself could lead to the mood improvement. For this reason, we made subgroups based on whether the participants liked gardening or not.
++
  {{html}}
  <!DOCTYPE html>
  <html>
@@ -282,12 +282,11 @@
  </head>
  <body>
--<h5>Wilcoxon Rank-Sum test</h5>
  <h6><i>H0</i>: The mood distribution after the interaction with Pepper for people who like gardening and people who do not like gardening is the same.</h6>
  <table>
    <tr>
--    <th>test results </th>
++    <th><i>Wilcoxon Rank-Sum results</i> </th>
      <th>I feel caring </th>
      <th>I feel content </th>
      <th>I feel calm </th>
@@ -320,14 +320,26 @@
  </html>
  {{/html}}
--We did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
++Table 2: Results of Wilcoxon Rank-Sum statistical test on affect assessment for people who like vs. dislike gardening
--=== System assessment ===
++In order to analyze the difference in the mood change between people who liked the activity of gardening and people who did not, we divided the assessments into two groups and performed a Wilcoxon Rank-Sum test. The results show that only the contentness mood shows a statistically significant difference between the two groups. Hence, we did not notice any relevant pattern indicating a significant difference between "like gardening" and "dislike gardening" groups. It seems to be that this is not the cause of the mood improvement.
--[[System assessment, first subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
++This confirms that PwDs can potentially benefit from a boost of energy from interacting with Pepper and, if the activity is enjoyable, a general improvement in contentness as well.
++
++
++=== System Assessment ===
++
++**Task Guidance Assessment**
++[[System assessment, task guidance questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_1.html]]
++The results of the system questionnaire will be divided into four different group with similar questions in each group. This is done to improve the readability of the results and provide a more indepth analysis of various aspects of the system setup.
++
  [[image:group1.svg]]
++Figure 2: Graphical representation of results for task guidance subset of the system assessment, with results shown for people who like vs. dislike gardening, along with the average of the sample.
++
++The first group, namely task guidance assessment, contains questions aimed at measuring how easy and pleasant was the activity when being guided by Pepper. The responses for this group are around the slightly agree line, a bit higher for the "Pepper was easy to understand" statement and a bit lower for the "I enjoyed the task more than if I had had to do it alone".
++
  {{html}}
  <!DOCTYPE html>
  <html>
@@ -352,12 +352,11 @@
  </head>
  <body>
--<h5>Wilcoxon Rank-Sum test</h5>
  <h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
  <table>
    <tr>
--    <th>test results </th>
++    <th><i>Wilcoxon Rank-Sum results</i></th>
      <th>I would have known how to do the whole task without Pepper.</th>
      <th>I think Pepper made the task easier for me.</th>
      <th>I enjoyed the task more than if I had had to do it alone.</th>
@@ -387,12 +387,16 @@
  </html>
  {{/html}}
--In this first system assessment graph, it is shown that participants slightly agree that Pepper made the task easier for them, and generally agree that she was easy to understand.
++Table 3: Results of Wilcoxon Rank-Sum statistical test on task guidance subset of system assessment for people who like vs. dislike gardening
--[[System assessment, second subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
++**Accomplishment and Autonomy Assessment**
++[[System assessment, accomplishment and autonomy subset, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_2.html]]
  [[image:group2.svg]]
++Figure 3: Graphical representation of results for accomplishment and autonomy subset of the system assessment, with results shown for people who like vs. dislike gardening, along with the average of the sample.
++The second group, namely the accomplishment and autonomy subset has questions concerning the sense of control and accomplishment felt during the task by the participants. The participants on average responded between slightly agree and agree that completing the task was a good accomplishment and that they felt in control while doing it and a bit lower for the statement "I feel like I have accomplished it myself" suggestingthat it is possible for the participants to feel like Pepper is responsible, at least partially, for the accomplishment of the task.
++
  {{html}}
  <!DOCTYPE html>
  <html>
@@ -417,12 +417,11 @@
  </head>
  <body>
--<h5>Wilcoxon Rank-Sum test</h5>
  <h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
  <table>
    <tr>
--    <th>test results </th>
++    <th><i>Wilcoxon Rank-Sum results </i></th>
      <th>I feel like completing the task was a good accomplishment.</th>
      <th>I feel like I accomplished it myself.</th>
      <th>I felt in control of what I had to do.</th>
@@ -446,13 +446,19 @@
  </html>
  {{/html}}
--The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree.
--An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do.
++Table 4: Results of Wilcoxon Rank-Sum statistical test on accomplishment and autonomy subset of system assessment for people who like vs. dislike gardening
--[[System assessment, third subset of questions, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
++The sense of accomplishment is slightly higher for people who like gardening that for those who do not. It is globally around slightly agree. An interesting fact to notice is that participants who do not like gardening felt more in control of what they had to do.
++
++
++**Negative Experiences Assessment**
++[[System assessment, negative experiences subset, interactive version>>https://pietro99.github.io/SCE/graphs/first_questionnaire_3.html]]
  [[image:group3.svg]]
++Figure 4: Graphical representation of results for negative experiences subset of the system assessment, with results shown for people who like vs. dislike gardening, along with the average of the sample.
++The third group, namely negative experiences subset is used to group together questions that measure negative feeling experiences with Pepper. The results show that the participants on average answered between slightly disagree and disagreed. This suggests that Pepper was not frustrating for most people but only for a small fraction of the participants.
++
  {{html}}
  <!DOCTYPE html>
  <html>
@@ -477,12 +477,11 @@
  </head>
  <body>
--<h5>Wilcoxon Rank-Sum test</h5>
  <h6><i>H0</i>: The distribution of answers from people who like gardening and people who do not like gardening is the same.</h6>
  <table>
    <tr>
--    <th>test results </th>
++    <th><i> Wilcoxon Rank-Sum results </i></th>
      <th>I felt annoyed by Pepper.</th>
      <th>I felt frustrated by the task.</th>
      <th>I felt pressured by Pepper.</th>
@@ -506,6 +506,9 @@
  </html>
  {{/html}}
++Table 5: Results of Wilcoxon Rank-Sum statistical test on negative experiences subset of system assessment for people who like vs. dislike gardening
++
++
  The participants globally disagree that the presence of Pepper annoyed, frustrated or pressured them. Those who like gardening actually had a bit more negative feelings regarding the presence of Pepper than those who dislike gardening.