Skip to Content

Changes for page b. Test

Last modified by Demi Tao on 2023/04/10 10:13
From version 1.1
edited by Ruud de Jong
on 2023/02/13 10:57
Change comment: Imported from XAR
To version 2.1
edited by Demi Tao
on 2023/03/24 12:08
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.RuuddeJong
1 +XWiki.DemiTao
Content
... ... @@ -5,9 +5,11 @@
5 5  
6 6  = 2. Method =
7 7  
8 +The prototypes are evaluated in a simulated manner, with participants pretending to be PwDs and conducting in-person experiments.
8 8  
9 9  == 2.1 Participants ==
10 10  
12 +All students in CS4235 Socio-Cognitive Engineering (2022-2023) in TU Delft are invited to test the robot. In the end, X students are presented.
11 11  
12 12  == 2.2 Experimental design ==
13 13  
... ... @@ -14,13 +14,83 @@
14 14  
15 15  == 2.3 Tasks ==
16 16  
19 +In the user test, the following tasks were asked of the participants:
17 17  
21 +==== Reminders for activities ====
22 +
23 +* (((
24 +Add a reminder that a relative will pay a visit tomorrow with the format as "sb. will come at 10 am on Friday". Set the reminder to remind you 10 min before that.
25 +)))
26 +* (((
27 +Add a reminder USING A VOICE COMMAND that today at 2 pm will have a general health checkup.
28 +)))
29 +* (((
30 +Check the reminders you have added for today and tomorrow.
31 +)))
32 +
33 +==== Personal profile ====
34 +
35 +* (((
36 +Add relatives as a contact in the "profile" section.
37 +)))
38 +
39 +==== Memory games ====
40 +
41 +* (((
42 +Go to the Games section and check what is included there.
43 +)))
44 +
45 +==== Medicine reminders ====
46 +
47 +(for professional caregivers, write it just in case)
48 +
49 +* (((
50 +In the section “My Health”, add a medicine reminder to take the medicine **Donepezil**, 1 time per day at 9 PM before going to bed.
51 +)))
52 +* (((
53 +Check medicines that have been added.
54 +)))
55 +* (((
56 +Delete medicines that have been added.
57 +)))
58 +
59 +==== About dementia ====
60 +
61 +* (((
62 +Go to the About dementia section and check the information provided.
63 +)))
64 +* (((
65 +Click on the different chapters and have a look at them.
66 +)))
67 +
68 +==== General tasks ====
69 +
70 +* (((
71 +Turn on the robot.
72 +)))
73 +
18 18  == 2.4 Measures ==
19 19  
76 +Quantitative measures are used in a user evaluation.  If a respondent had a minimum total score of 60% or more, he or she was considered to be satisfied with the application.
20 20  
21 21  == 2.5 Procedure ==
22 22  
23 23  
81 +The procedure was conducted as follows:
82 +
83 +1. Welcome participants and give an introduction.
84 +1. Get them to sign a consent form.
85 +1. Prepare them to pretend to be a person with dementia. *
86 +1. Have interaction with the robot and complete the tasks.
87 +1. Complete a questionnaire.
88 +1. Have a short interview with selected participants. (if possible, 2 participants)
89 +
90 +//* Several fingers taped together (to simulate PwD's inability to control movements flexibly);//
91 +
92 +// Wearing very dirty glasses (simulates blurred vision and degraded perception);//
93 +
94 +// Wearing headphones that broadcast murmurs (simulating hearing degradation and the noisy environment).//
95 +
24 24  == 2.6 Material ==
25 25  
26 26  
XWiki.XWikiComments[0]
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.DemiTao
Comment
... ... @@ -1,0 +1,3 @@
1 +The survey can be designed based on UTAUT questionnaire (performance expectancy, effort expectancy, social influence, facilitating conditions) to test usability and user experience.
2 +
3 +Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User Acceptance of Information Technology: Toward a Unified View. //MIS Quarterly//, //27//(3), 425–478. https:~/~/doi.org/10.2307/30036540
Date
... ... @@ -1,0 +1,1 @@
1 +2023-03-23 09:22:38.687
XWiki.XWikiComments[1]
Author
... ... @@ -1,0 +1,1 @@
1 +Anonymous
Comment
... ... @@ -1,0 +1,40 @@
1 +Quintana et al. (2020) designed questions based on the most important quality attributes to evaluate how the application works for people with mild cognitive impairment.
2 +
3 +(potential questions tailored to our case)
4 +
5 +* (((
6 +How satisfied are you with the robot’s possibility to support you?
7 +)))
8 +* (((
9 +How well does the robot fulfill your expectations?
10 +)))
11 +* (((
12 +Imagine a perfect robot for this task. How far away from it is the robot you are using today?
13 +)))
14 +* (((
15 +I find the robot easily accessible for people with dementia.
16 +)))
17 +* (((
18 +I feel that I can trust the robot and that it is safe to use.
19 +)))
20 +* (((
21 +I find it easy to understand how to operate the robot.
22 +)))
23 +* (((
24 +I am able to understand all the information presented by the robot.
25 +)))
26 +* (((
27 +I feel that the robot gave me better control over my daily situation.
28 +)))
29 +
30 +The alternatives the users could give to all the above were the following: 1 = Strongly disagree; 2 = Disagree.; 3 = Neither agree nor disagree; 4 = Agree; 5 = Strongly agree.
31 +
32 +
33 +The System Usability Scale (SUS) is a dependable instrument for testing usability. It comprises of 10 questions with five response options which range from strongly agree to strongly disagree for responders (Jordan et al., 1996).
34 +
35 +(see the attachment for the 10 questions)
36 +
37 +
38 +1. Quintana M, Anderberg P, Sanmartin Berglund J, Frögren J, Cano N, Cellek S, Zhang J, Garolera M. Feasibility-Usability Study of a Tablet App Adapted Specifically for Persons with Cognitive Impairment—SMART4MD (Support Monitoring and Reminder Technology for Mild Dementia). //International Journal of Environmental Research and Public Health//. 2020; 17(18):6816. [[https:~~/~~/doi.org/10.3390/ijerph17186816>>https://doi.org/10.3390/ijerph17186816]]
39 +
40 +2. Brooke, J. SUS-A quick and dirty usability scale. //Usability Eval. Ind. **1996**, 189//, 4–7.
Date
... ... @@ -1,0 +1,1 @@
1 +2023-03-24 11:18:20.296