... |
... |
@@ -95,8 +95,9 @@ |
95 |
95 |
|
96 |
96 |
=== (% style="color:inherit; font-family:inherit" %)Results of the survey:(%%) === |
97 |
97 |
|
98 |
|
-[[image:attach:chart.png||alt="Survey Results"]] |
|
98 |
+[[Figure: //Percentage of user satisfaction and SUS score//>>image:attach:chart.png]] |
99 |
99 |
|
|
100 |
+ |
100 |
100 |
|(% style="width:215px" %)**Attributes**|(% style="width:211px" %)**Mean (control group)**|(% style="width:229px" %)**Mean (Experimental group)**|(% style="width:197px" %)**P-value** |
101 |
101 |
|(% style="width:215px" %)Accessibility|(% style="width:211px" %)2,33|(% style="width:229px" %)3,25 |(% style="width:197px" %)0,0644 |
102 |
102 |
|(% style="width:215px" %)Trustability|(% style="width:211px" %)3,83|(% style="width:229px" %)4,125|(% style="width:197px" %)0,3165 |
... |
... |
@@ -105,6 +105,9 @@ |
105 |
105 |
|(% style="width:215px" %)Empowerment|(% style="width:211px" %)3,33|(% style="width:229px" %)4|(% style="width:197px" %)0,0895 |
106 |
106 |
|(% style="width:215px" %)Usability|(% style="width:211px" %)54,16666667|(% style="width:229px" %)71,875|(% style="width:197px" %)0,0903 |
107 |
107 |
|
|
109 |
+(% class="wikigeneratedid" %) |
|
110 |
+//Table: User evaluation score// |
|
111 |
+ |
108 |
108 |
=== Observation: (Total percentage sums up to 100) === |
109 |
109 |
|
110 |
110 |
|=(% style="width: 199px;" %)Tasks|=(% style="width: 147px;" %)Succeeded by Themselves|=(% style="width: 146px;" %)Succeeded with Some Guidance|=(% style="width: 185px;" %)Succeeded with Detailed Explicit Instructions|=(% style="width: 175px;" %)Average Time to Complete Task (s) |
... |
... |
@@ -114,6 +114,9 @@ |
114 |
114 |
|(% style="width:199px" %)Verify current profiles|(% style="width:147px" %)85.71%|(% style="width:146px" %)14.29%|(% style="width:185px" %)NA|(% style="width:175px" %)32 |
115 |
115 |
|(% style="width:199px" %)Play memory game|(% style="width:147px" %)0%|(% style="width:146px" %)42.86%|(% style="width:185px" %)57.14%|(% style="width:175px" %)208 |
116 |
116 |
|
|
121 |
+//Table: Results of user performance of tasks // |
|
122 |
+ |
|
123 |
+ |
117 |
117 |
|(% style="width:330px" %)**Tasks**|(% style="width:523px" %)**Parts where people struggled** |
118 |
118 |
|(% style="width:330px" %)Add a reminder|(% style="width:523px" %)((( |
119 |
119 |
* Don't know where to start |
... |
... |
@@ -128,8 +128,19 @@ |
128 |
128 |
* The beta version has no right or wrong prompts, different from the instructions, making people confused |
129 |
129 |
))) |
130 |
130 |
|
|
138 |
+//Table: Difficulties that users struggled with when solving tasks// |
|
139 |
+ |
131 |
131 |
= 4. Discussion = |
132 |
132 |
|
|
142 |
+(% class="wikigeneratedid" %) |
|
143 |
+As mentioned earlier, the user evaluation incorporated two quantitative measures. The first measure evaluated the various attributes of the system, including accessibility, trustworthiness, perceivability, understandability, and empowerment. The second measure employed was the System Usability Scale (SUS). |
|
144 |
+ |
|
145 |
+(% class="wikigeneratedid" %) |
|
146 |
+The attributes-related evaluation was analyzed based on the following way: if a respondent had a minimum total score of 60% (15 out of 25) or more, he or she was considered to be satisfied with the application. 11 out of 14 (78.57%) of the users achieved a score of 15 or higher. The average score is 18. According to the standard operating protocol (Quintana et al., 2020), the feasibility test was to be considered successfully completed if at least 75% were satisfied with the use of the application. Therefore, based on this criterion, the feasibility test was considered successfully completed. |
|
147 |
+ |
|
148 |
+The System Usability Scale (SUS) was interpreted in terms of percentile ranking. |
|
149 |
+ |
|
150 |
+ |
133 |
133 |
=== Limitations: === |
134 |
134 |
|
135 |
135 |
We ran into some problems while creating the application and performing the experiment: |