Skip to Content

Changes for page b. Test

Last modified by Demi Tao on 2023/04/10 10:13
From version 15.1
edited by Valentijn van de Beek
on 2023/04/08 00:04
Change comment: There is no comment for this version
To version 18.1
edited by Demi Tao
on 2023/04/08 01:17
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.vvandebeek
1 +XWiki.DemiTao
Content
... ... @@ -93,24 +93,41 @@
93 93  
94 94  = 3. Results =
95 95  
96 -=== Results of interaction: ===
96 +=== (% style="color:inherit; font-family:inherit" %)Results of the survey:(%%) ===
97 97  
98 -|=(% style="width: 199px;" %)Tasks|=(% style="width: 147px;" %)Succeeded by Themselves|=(% style="width: 146px;" %)Succeeded with Some Guidance|=(% style="width: 185px;" %)Succeeded with Detailed Explicit Instructions|=(% style="width: 175px;" %)Average Time to Complete Task (s)
99 -|(% style="width:199px" %)Add a reminder|(% style="width:147px" %)14.29%|(% style="width:146px" %)28.57%|(% style="width:185px" %)57.14%|(% style="width:175px" %)75
100 -|(% style="width:199px" %)Check weekly remainders on the Calendar page|(% style="width:147px" %)100%|(% style="width:146px" %)0%|(% style="width:185px" %)0%|(% style="width:175px" %)10
101 -|(% style="width:199px" %)Create a personal profile|(% style="width:147px" %)7.14%|(% style="width:146px" %)50%|(% style="width:185px" %)42.86%|(% style="width:175px" %)43
102 -|(% style="width:199px" %)Verify current profiles|(% style="width:147px" %)85.71%|(% style="width:146px" %)14.29%|(% style="width:185px" %)0%|(% style="width:175px" %)10
103 -|(% style="width:199px" %)Play memory game|(% style="width:147px" %)0%|(% style="width:146px" %)42.86%|(% style="width:185px" %)57.14%|(% style="width:175px" %)200
98 +[[image:attach:chart.png||alt="Survey Results"]]
104 104  
105 -if possible, note down some Parts Where Users Struggled in each task.
100 +|(% style="width:215px" %)**Attributes**|(% style="width:211px" %)**Mean (control group)**|(% style="width:229px" %)**Mean (Experimental group)**|(% style="width:197px" %)**P-value**
101 +|(% style="width:215px" %)Accessibility|(% style="width:211px" %)2,33|(% style="width:229px" %)3,25  |(% style="width:197px" %)0,0644
102 +|(% style="width:215px" %)Trustability|(% style="width:211px" %)3,83|(% style="width:229px" %)4,125|(% style="width:197px" %)0,3165
103 +|(% style="width:215px" %)Perceivability|(% style="width:211px" %)3,33|(% style="width:229px" %)3,5|(% style="width:197px" %)0,4112
104 +|(% style="width:215px" %)Understandability|(% style="width:211px" %)3,33|(% style="width:229px" %)4,25|(% style="width:197px" %)0,1151
105 +|(% style="width:215px" %)Empowerment|(% style="width:211px" %)3,33|(% style="width:229px" %)4|(% style="width:197px" %)0,0895
106 +|(% style="width:215px" %)Usability|(% style="width:211px" %)54,16666667|(% style="width:229px" %)71,875|(% style="width:197px" %)0,0903
106 106  
107 -=== Results of survey: ===
108 +=== Observation: ===
108 108  
109 -[[image:attach:chart.png||alt="Survey Results"]]
110 +|=(% style="width: 199px;" %)Tasks|=(% style="width: 147px;" %)Succeeded by Themselves|=(% style="width: 146px;" %)Succeeded with Some Guidance|=(% style="width: 185px;" %)Succeeded with Detailed Explicit Instructions|=(% style="width: 175px;" %)Average Time to Complete Task (s)
111 +|(% style="width:199px" %)Add a reminder|(% style="width:147px" %)14.29%|(% style="width:146px" %)28.57%|(% style="width:185px" %)57.14%|(% style="width:175px" %)97
112 +|(% style="width:199px" %)Check weekly remainders on the Calendar page|(% style="width:147px" %)100%|(% style="width:146px" %)0%|(% style="width:185px" %)0%|(% style="width:175px" %)36
113 +|(% style="width:199px" %)Create a personal profile|(% style="width:147px" %)7.14%|(% style="width:146px" %)50%|(% style="width:185px" %)42.86%|(% style="width:175px" %)69
114 +|(% style="width:199px" %)Verify current profiles|(% style="width:147px" %)85.71%|(% style="width:146px" %)14.29%|(% style="width:185px" %)0%|(% style="width:175px" %)32
115 +|(% style="width:199px" %)Play memory game|(% style="width:147px" %)0%|(% style="width:146px" %)42.86%|(% style="width:185px" %)57.14%|(% style="width:175px" %)208
110 110  
111 -=== Significance test: ===
117 +|(% style="width:330px" %)**Tasks**|(% style="width:523px" %)**Parts where people struggled**
118 +|(% style="width:330px" %)Add a reminder|(% style="width:523px" %)(((
119 +* Don't know where to start
120 +* No immediate audio feedback indicating success
121 +)))
122 +|(% style="width:330px" %)Create a personal profile|(% style="width:523px" %)(((
123 +* It's hard to type with taped fingers
124 +)))
125 +|(% style="width:330px" %)Play memory game|(% style="width:523px" %)(((
126 +* Have no idea how to play the game, sometimes even after listening to the explicit instructions
127 +* There are too many words in the text
128 +* The beta version has no right or wrong prompts, different from the instructions, making people confused
129 +)))
112 112  
113 -
114 114  = 4. Discussion =
115 115  
116 116  === Limitations: ===
... ... @@ -122,7 +122,7 @@
122 122  * We could not adapt the robot to the PwD due to time constraints. This means that we did not take into account the severity of the PwD's visual, acoustic and kinesthetic limitations while setting up Pepper.
123 123  * We could not test the full capabilities of the robot due to privacy constraints. Since we fabricated the information about relatives to protect the privacy of participants, we were not able to perform the scenarios in a realistic manner.
124 124  * Since the version of the Google Chrome browser on the Pepper tablet was outdated, we were not able to load our Flutter application onto it and simulate actual scenarios.
125 -* Participants where from a wide variety of different background and mother tongues, it was therefore not possible to adjust Pepper to the specific culture of the participant.
142 +* Participants were from a wide variety of different backgrounds and mother tongues, it was therefore not possible to adjust Pepper to the specific culture of the participant.
126 126  
127 127  ==== Evaluation: ====
128 128  
XWiki.XWikiComments[5]
Author
... ... @@ -1,1 +1,0 @@
1 -Anonymous
Comment
... ... @@ -1,8 +1,0 @@
1 -interview with the person who interact with the tablet only:
2 -
3 -* The system takes time to learn how to use
4 -* prefer audio instructions
5 -* expect audio feedback after completing each task
6 -* prefer visualization over text
7 -
8 -Suggestion: it's better to weaken the existence of the system and make it easier to learn
Date
... ... @@ -1,1 +1,0 @@
1 -2023-04-01 10:17:27.32
XWiki.XWikiComments[7]
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.DemiTao
Comment
... ... @@ -1,0 +1,1 @@
1 +Maybe add something related to the results in the discussion
Date
... ... @@ -1,0 +1,1 @@
1 +2023-04-08 01:14:56.749