Skip to Content

Changes for page b. Test

Last modified by Demi Tao on 2023/04/10 10:13
From version 16.2
edited by Demi Tao
on 2023/04/08 01:06
Change comment: Deleted object
To version 19.1
edited by Karthik Prakash
on 2023/04/08 10:26
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.DemiTao
1 +XWiki.KarthikPrakash
Content
... ... @@ -93,14 +93,26 @@
93 93  
94 94  = 3. Results =
95 95  
96 -=== Results of interaction: ===
96 +=== (% style="color:inherit; font-family:inherit" %)Results of the survey:(%%) ===
97 97  
98 +[[image:attach:chart.png||alt="Survey Results"]]
99 +
100 +|(% style="width:215px" %)**Attributes**|(% style="width:211px" %)**Mean (control group)**|(% style="width:229px" %)**Mean (Experimental group)**|(% style="width:197px" %)**P-value**
101 +|(% style="width:215px" %)Accessibility|(% style="width:211px" %)2,33|(% style="width:229px" %)3,25  |(% style="width:197px" %)0,0644
102 +|(% style="width:215px" %)Trustability|(% style="width:211px" %)3,83|(% style="width:229px" %)4,125|(% style="width:197px" %)0,3165
103 +|(% style="width:215px" %)Perceivability|(% style="width:211px" %)3,33|(% style="width:229px" %)3,5|(% style="width:197px" %)0,4112
104 +|(% style="width:215px" %)Understandability|(% style="width:211px" %)3,33|(% style="width:229px" %)4,25|(% style="width:197px" %)0,1151
105 +|(% style="width:215px" %)Empowerment|(% style="width:211px" %)3,33|(% style="width:229px" %)4|(% style="width:197px" %)0,0895
106 +|(% style="width:215px" %)Usability|(% style="width:211px" %)54,16666667|(% style="width:229px" %)71,875|(% style="width:197px" %)0,0903
107 +
108 +=== Observation: ===
109 +
98 98  |=(% style="width: 199px;" %)Tasks|=(% style="width: 147px;" %)Succeeded by Themselves|=(% style="width: 146px;" %)Succeeded with Some Guidance|=(% style="width: 185px;" %)Succeeded with Detailed Explicit Instructions|=(% style="width: 175px;" %)Average Time to Complete Task (s)
99 -|(% style="width:199px" %)Add a reminder|(% style="width:147px" %)14.29%|(% style="width:146px" %)28.57%|(% style="width:185px" %)57.14%|(% style="width:175px" %)75
100 -|(% style="width:199px" %)Check weekly remainders on the Calendar page|(% style="width:147px" %)100%|(% style="width:146px" %)0%|(% style="width:185px" %)0%|(% style="width:175px" %)10
101 -|(% style="width:199px" %)Create a personal profile|(% style="width:147px" %)7.14%|(% style="width:146px" %)50%|(% style="width:185px" %)42.86%|(% style="width:175px" %)43
102 -|(% style="width:199px" %)Verify current profiles|(% style="width:147px" %)85.71%|(% style="width:146px" %)14.29%|(% style="width:185px" %)0%|(% style="width:175px" %)10
103 -|(% style="width:199px" %)Play memory game|(% style="width:147px" %)0%|(% style="width:146px" %)42.86%|(% style="width:185px" %)57.14%|(% style="width:175px" %)200
111 +|(% style="width:199px" %)Add a reminder|(% style="width:147px" %)14.29%|(% style="width:146px" %)28.57%|(% style="width:185px" %)57.14%|(% style="width:175px" %)97
112 +|(% style="width:199px" %)Check weekly remainders on the Calendar page|(% style="width:147px" %)100%|(% style="width:146px" %)0%|(% style="width:185px" %)NA|(% style="width:175px" %)36
113 +|(% style="width:199px" %)Create a personal profile|(% style="width:147px" %)7.14%|(% style="width:146px" %)50%|(% style="width:185px" %)42.86%|(% style="width:175px" %)69
114 +|(% style="width:199px" %)Verify current profiles|(% style="width:147px" %)85.71%|(% style="width:146px" %)14.29%|(% style="width:185px" %)NA|(% style="width:175px" %)32
115 +|(% style="width:199px" %)Play memory game|(% style="width:147px" %)0%|(% style="width:146px" %)42.86%|(% style="width:185px" %)57.14%|(% style="width:175px" %)208
104 104  
105 105  |(% style="width:330px" %)**Tasks**|(% style="width:523px" %)**Parts where people struggled**
106 106  |(% style="width:330px" %)Add a reminder|(% style="width:523px" %)(((
... ... @@ -111,26 +111,11 @@
111 111  * It's hard to type with taped fingers
112 112  )))
113 113  |(% style="width:330px" %)Play memory game|(% style="width:523px" %)(((
114 -* Have not idea how to play the game, sometimes even after listening to the explicit instructions
126 +* Have no idea how to play the game, sometimes even after listening to the explicit instructions
115 115  * There are too many words in the text
116 116  * The beta version has no right or wrong prompts, different from the instructions, making people confused
117 117  )))
118 118  
119 -=== Results of survey: ===
120 -
121 -[[image:attach:chart.png||alt="Survey Results"]]
122 -
123 -=== Significance test: ===
124 -
125 -|**Attributes**|**P-value**
126 -|Accessibility|0,0644
127 -|Trustability|0,3165
128 -|Perceivability|0,4112
129 -|Understandability|0,1151
130 -|Empowerment|0,0895
131 -|Usability|0,0903
132 -
133 -
134 134  = 4. Discussion =
135 135  
136 136  === Limitations: ===
... ... @@ -142,7 +142,7 @@
142 142  * We could not adapt the robot to the PwD due to time constraints. This means that we did not take into account the severity of the PwD's visual, acoustic and kinesthetic limitations while setting up Pepper.
143 143  * We could not test the full capabilities of the robot due to privacy constraints. Since we fabricated the information about relatives to protect the privacy of participants, we were not able to perform the scenarios in a realistic manner.
144 144  * Since the version of the Google Chrome browser on the Pepper tablet was outdated, we were not able to load our Flutter application onto it and simulate actual scenarios.
145 -* Participants where from a wide variety of different background and mother tongues, it was therefore not possible to adjust Pepper to the specific culture of the participant.
142 +* Participants were from a wide variety of different backgrounds and mother tongues, it was therefore not possible to adjust Pepper to the specific culture of the participant.
146 146  
147 147  ==== Evaluation: ====
148 148  
XWiki.XWikiComments[1]
Author
... ... @@ -1,1 +1,0 @@
1 -Anonymous
Comment
... ... @@ -1,40 +1,0 @@
1 -Quintana et al. (2020) designed questions based on the most important quality attributes to evaluate how the application works for people with mild cognitive impairment.
2 -
3 -(potential questions tailored to our case)
4 -
5 -* (((
6 -How satisfied are you with the robot’s possibility to support you?
7 -)))
8 -* (((
9 -How well does the robot fulfill your expectations?
10 -)))
11 -* (((
12 -Imagine a perfect robot for this task. How far away from it is the robot you are using today?
13 -)))
14 -* (((
15 -I find the robot easily accessible for people with dementia.
16 -)))
17 -* (((
18 -I feel that I can trust the robot and that it is safe to use.
19 -)))
20 -* (((
21 -I find it easy to understand how to operate the robot.
22 -)))
23 -* (((
24 -I am able to understand all the information presented by the robot.
25 -)))
26 -* (((
27 -I feel that the robot gave me better control over my daily situation.
28 -)))
29 -
30 -The alternatives the users could give to all the above were the following: 1 = Strongly disagree; 2 = Disagree.; 3 = Neither agree nor disagree; 4 = Agree; 5 = Strongly agree.
31 -
32 -
33 -The System Usability Scale (SUS) is a dependable instrument for testing usability. It comprises of 10 questions with five response options which range from strongly agree to strongly disagree for responders (Jordan et al., 1996).
34 -
35 -(see the attachment for the 10 questions)
36 -
37 -
38 -1. Quintana M, Anderberg P, Sanmartin Berglund J, Frögren J, Cano N, Cellek S, Zhang J, Garolera M. Feasibility-Usability Study of a Tablet App Adapted Specifically for Persons with Cognitive Impairment—SMART4MD (Support Monitoring and Reminder Technology for Mild Dementia). //International Journal of Environmental Research and Public Health//. 2020; 17(18):6816. [[https:~~/~~/doi.org/10.3390/ijerph17186816>>https://doi.org/10.3390/ijerph17186816]]
39 -
40 -2. Brooke, J. SUS-A quick and dirty usability scale. //Usability Eval. Ind. **1996**, 189//, 4–7.
Date
... ... @@ -1,1 +1,0 @@
1 -2023-03-24 11:18:20.296
XWiki.XWikiComments[6]
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.DemiTao
Comment
... ... @@ -1,16 +1,0 @@
1 -**Interpretation for user evaluation **
2 -
3 -If a respondent had a minimum total score of 60% (15 out of 25 for the matrix question) or more, he or she was considered to be satisfied with the application.
4 -
5 -**Scoring SUS**
6 -
7 -* For odd items: subtract one from the user response.
8 -* For even-numbered items: subtract the user responses from 5
9 -* This scales all values from 0 to 4 (with four being the most positive response).
10 -* Add up the converted responses for each user and multiply that total by 2.5. This converts the range of possible values from 0 to 100 instead of from 0 to 40.
11 -
12 -**Interpreting Scores for SUS [[*>>https://measuringu.com/sus/]]**
13 -
14 -Interpreting scoring can be complex. The participant’s scores for each question are converted to a new number, added together and then multiplied by 2.5 to convert the original scores of 0-40 to 0-100.  Though the scores are 0-100, these are not percentages and should be considered only in terms of their percentile ranking.
15 -
16 -Based on research, a SUS score above a 68 would be considered above average and anything below 68 is below average, however, the best way to interpret your results involves “normalizing” the scores to produce a percentile ranking.
Date
... ... @@ -1,1 +1,0 @@
1 -2023-04-07 17:01:06.25
XWiki.XWikiComments[7]
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.DemiTao
Comment
... ... @@ -1,0 +1,1 @@
1 +Maybe add something related to the results in the discussion
Date
... ... @@ -1,0 +1,1 @@
1 +2023-04-08 01:14:56.749