Wiki source code of Test
Version 34.1 by Andrei Stefan on 2022/03/15 12:18
Hide last authors
author | version | line-number | content |
---|---|---|---|
![]() |
30.1 | 1 | = Problem statement and research questions = |
![]() |
34.1 | 2 | The main use cases that the evaluation focuses on are UC001: Daily todo list and UC005: Quiz. Based on the claims corresponding to those use cases, we derive the following research questions: |
3 | 1. System A: the robot does not do anything | ||
4 | System B: the robot plays music associated with tasks | ||
5 | Research question: Are participants more likely to remember their daily tasks when using system B, compared to system A? | ||
![]() |
30.1 | 6 | |
![]() |
34.1 | 7 | 2. System A: the robot plays a song and regardless if the answer is right or not, it switches to a different song. |
8 | System B: the robot plays the same song until the user gets it right | ||
9 | Research question: Are participants happier to interact with the robot and more effective at linking tasks to music when using System B, compared to system A? | ||
10 | |||
![]() |
1.2 | 11 | = Method = |
![]() |
1.1 | 12 | |
![]() |
32.1 | 13 | We are doing a mixed-method approach. We are producing quantitative data from questionnaires after the interaction with the robot, by asking them how they felt about the whole experience. By measuring this data, we will assess if we successfully achieved our claims and determine the answers to the research questions. |
![]() |
1.1 | 14 | |
![]() |
1.2 | 15 | == Participants == |
![]() |
1.1 | 16 | |
![]() |
6.1 | 17 | Due to covid restrictions, we have to “simulate” our robot-human interaction with elderly people affected by dementia. For that reason, we will ask roughly eighteen people how will pretend to be people with different dementia types, the loved ones or the caregiver. We will create three groups / six people in each. In each group, one person will “play” the role of a caregiver, one plays the loved one, and the remaining four people will do the role of the person with dementia. In each group, the “onset of dementia played” should be different. In Group A, people act like they just have early-onset symptoms, but they are almost fully functioning. They sometimes get confused, but these moments swiftly pass and they are back to their true selves. In Group B, people should have a harder time keeping track of things, forgetting about tasks, people and memories should be common. These people’s life is constantly affected by the disease, but they sometimes have clear moments when they are back to their original selves before dementia. In Group C people have late-onset of dementia. Constant confusion is more common than moments of clarity which usually doesn't last long. People should have a hard time keeping track of anything, and remembering is not something that’s even possible anymore. |
![]() |
1.1 | 18 | |
![]() |
1.2 | 19 | == Experimental design == |
![]() |
1.1 | 20 | |
![]() |
8.1 | 21 | The experiment will be conducted by simulating the interaction between the patient, robot and other actors. The group of participants will be divided into 3 subgroups that simulate patients in different stages of dementia. The participants will be given artificial memory loss by forcing them to remember a large number of songs they have to associate with certain activities. From each group one of the participants will be asked to play the caregiver and another participant will take the roll of loved one. With these participants the interactions between the actors will be tested. The interactions are described in the design patterns. |
![]() |
1.1 | 22 | |
![]() |
8.1 | 23 | When the participant playing the role of patient has learned the association between the music pieces and activities the robot will start playing certain pieces of music. The participant has to recall the correct activity associated with the music piece. When this is wrong the loved one can step in and call to remind the |
24 | |||
![]() |
15.1 | 25 | == Tasks == |
26 | |||
![]() |
28.1 | 27 | **Event: Activity** |
![]() |
25.1 | 28 | |
29 | {{html}} | ||
30 | <table> | ||
![]() |
11.1 | 31 | <tr> |
![]() |
12.1 | 32 | <td>No.</td> |
![]() |
11.1 | 33 | <td>Group A</td> |
34 | <td>Group B</td> | ||
![]() |
20.1 | 35 | <td>Group C</td> |
![]() |
11.1 | 36 | </tr> |
37 | <tr> | ||
38 | <td>1</td> | ||
39 | <td>Memorize five pieces of music corresponding with different activities within three minutes;</td> | ||
40 | <td>Memorize seven pieces of music corresponding with different activities within three minutes;</td> | ||
41 | <td>Memorize ten pieces of music corresponding with different activities within three minutes;</td> | ||
42 | </tr> | ||
43 | <tr> | ||
44 | <td>2</td> | ||
45 | <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music1;</td> | ||
46 | <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music1;</td> | ||
47 | <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music1;</td> | ||
48 | </tr> | ||
49 | <tr> | ||
50 | <td>3</td> | ||
51 | <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music2;</td> | ||
52 | <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music2;</td> | ||
53 | <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music2;</td> | ||
54 | </tr> | ||
55 | <tr> | ||
56 | <td>4</td> | ||
57 | <td>Ignore the music when hearing the robot playing music3;</td> | ||
58 | <td>Ignore the music when hearing the robot playing music3;</td> | ||
59 | <td>Ignore the music when hearing the robot playing music3;</td> | ||
60 | </tr> | ||
61 | <tr> | ||
62 | <td>5</td> | ||
63 | <td>Say “I will do [task_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music3 again.</td> | ||
64 | <td>Say “I will do [task_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music3 again.</td> | ||
65 | <td>Say “I will do [task_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music3 again.</td> | ||
66 | </tr> | ||
![]() |
25.1 | 67 | <table> |
68 | {{/html}} | ||
![]() |
6.1 | 69 | |
![]() |
20.1 | 70 | **Event: Quiz** |
71 | |||
72 | {{html}} | ||
73 | <table> | ||
74 | <tr> | ||
75 | <td>No.</td> | ||
76 | <td>Group A</td> | ||
77 | <td>Group B</td> | ||
78 | <td>Group C</td> | ||
79 | </tr> | ||
80 | <tr> | ||
81 | <td>1</td> | ||
82 | <td>Say "I would like to do a quiz now." to the robot;</td> | ||
83 | <td>Say "I would like to do a quiz now." to the robot;</td> | ||
84 | <td>Say "I would like to do a quiz now." to the robot;</td> | ||
85 | </tr> | ||
86 | <tr> | ||
87 | <td>2</td> | ||
88 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music1;</td> | ||
89 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music1;</td> | ||
90 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music1;</td> | ||
91 | </tr> | ||
92 | <tr> | ||
93 | <td>3</td> | ||
94 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music2;</td> | ||
95 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music2;</td> | ||
96 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music2;</td> | ||
97 | </tr> | ||
![]() |
21.1 | 98 | <tr> |
99 | <td>4</td> | ||
100 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music3;</td> | ||
101 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music3;</td> | ||
102 | <td>Say “The activity is [activity_name].”/ ”I don’t know.” to the robot after hearing the robot play music3;</td> | ||
![]() |
20.1 | 103 | </tr> |
104 | <tr> | ||
![]() |
21.1 | 105 | <td>5</td> |
![]() |
20.1 | 106 | <td>Say “I want to end the quiz now.” to the robot.</td> |
107 | <td>Say “I want to end the quiz now.” to the robot.</td> | ||
108 | <td>Say “I want to end the quiz now.” to the robot.</td> | ||
109 | </tr> | ||
110 | <table> | ||
111 | {{/html}} | ||
112 | |||
![]() |
1.2 | 113 | == Measures == |
![]() |
9.1 | 114 | |
![]() |
33.1 | 115 | During the experiment, count how many times the user answers with the wrong task. |
116 | After the experiment, ask the user to fill in the system usability scale and the questionnaire regarding mood and satisfaction. | ||
![]() |
1.1 | 117 | |
![]() |
1.2 | 118 | == Procedure == |
![]() |
1.1 | 119 | |
![]() |
29.1 | 120 | 1. Sign the consent form; |
121 | 2. Complete the given tasks as instructed; | ||
122 | 3. Complete a questionnaire | ||
![]() |
1.1 | 123 | |
![]() |
1.2 | 124 | == Material == |
![]() |
1.1 | 125 | |
![]() |
6.1 | 126 | Robot |
![]() |
1.1 | 127 | |
![]() |
6.1 | 128 | The robot plays an important part in our experiment. |
![]() |
1.1 | 129 | |
![]() |
6.1 | 130 | Consent form |
![]() |
1.1 | 131 | |
![]() |
7.1 | 132 | = Results = |
![]() |
1.1 | 133 | |
![]() |
7.1 | 134 | = Discussion = |
![]() |
1.1 | 135 | |
![]() |
7.1 | 136 | = Conclusion = |