Skip to Content

Changes for page Test

Last modified by Andrei Stefan on 2022/04/04 13:38
From version Icon 66.1 Icon
edited by Xinqi Li
on 2022/04/01 22:32
Change comment: There is no comment for this version
To version Icon 59.1 Icon
edited by Xinqi Li
on 2022/04/01 22:13
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -1,4 +1,4 @@
1 -Our robot aims to help delay the stage of dementia or slow down the deterioration of memory. The best situation is that we can test the robot with real PwD and in a relatively long time period to see if this robot really works, which is impossible for our project. So our evaluation performs in a group control way. Participants are divided into two groups, group A with the intelligent one, and group B with the dumb one.
1 +Our robot aims to help delay the stage of dementia or slow down the deterioration of memory. The best situation is that we can test the robot with real PwD and in a relatively long time period to see if this robot really works, which is impossible for our project. So our evaluation performs in a group control way. Participants are divided into two groups, group A with the intelligent one, and group B with the dummy one.
2 2  
3 3  = Problem statement and research questions =
4 4  
... ... @@ -11,7 +11,7 @@
11 11  
12 12  = Method =
13 13  
14 -The control group evaluation is used. One group of participants interacts with a dumb robot and another group interacts with the intelligent robot. The only difference between these two groups is the independent variable - dumb or intelligent robot, which makes our result more reasonable.
14 +The control group evaluation is used. One group of participants interacts with a dummy robot and another group interacts with the intelligent robot. The only difference between these two groups is the independent variable - dummy or intelligent robot, which makes our result more reasonable.
15 15  
16 16  Besides, Our group decided to use a mixed-method approach for the evaluation.
17 17  
... ... @@ -22,18 +22,35 @@
22 22  
23 23  == Participants ==
24 24  
25 -We invited 19 participants. To validate our research question that the quiz will help people better memorize music-activity links, participants will be divided into two groups, Group A with the intelligent robot(9 participants) and Group B(10 participants) with the dumb robot.
25 +We invited 19 participants. To validate our research question that the quiz will help people better memorize music-activity links, participants will be divided into two groups, Group A with the intelligent robot(9 participants) and Group B(10 participants) with the dummy robot.
26 26  
27 27  == Experimental design ==
28 28  
29 29  The experiment will be conducted to simulate the reinforcement learning process of musical memory related to daily activities and to investigate if the quiz is indeed able to help with the learning.
30 -All participants would sign a consent form that informed them of the usage of the collected data and our goal of evaluations. In our prototype, users can personalize the association between music and activities based on their existing intrinsic knowledge. But due to the limited time and requiring a comparable result between groups, in evaluation, we forced 6 pieces of music and activities. Participants listened to the music and were asked the remember the associated activities.
30 +
31 +
32 +=== Evaluation Step ===
33 +
34 +First, all participants would sign a consent form that informed them of the usage of the collected data and our goal of evaluations.
35 +
36 +==== Step 1 ====
37 +
38 +In our prototype, users can personalize the link between music and activities based on their existing intrinsic knowledge. But due to the limited time and requiring a comparable result between groups, in evaluation, we forced 6 pieces of music and activities. Participants listened to the music and were asked the remember the associated activities.
39 +
40 +==== Step 2 ====
41 +
42 +Participants in two groups would play with the robot for 3 minutes. Participants in group A would play with the intelligent robot and group B would play with the dummy robot.
43 +
44 +==== Step 3 ====
45 +
31 31  In the end, the participants would take a quiz to see how much they remembered. They are also asked to fill in a questionnaire including the feeling of the robot and possible feedback.
32 32  
48 +==== Questionnaire ====
49 +
33 33  1. How many questions did you answer correctly? (Points from 0-6)
34 34  1. You feel the robot can help you remember the task. (Agree, Neutral, Disagree)
35 35  1. You feel the robot is annoying. (Agree, Neutral, Disagree)
36 -1. Based on the given system usability scale, please give our robot a score. (0-100)
53 +1. Based on the given system usability scale, please give our robot a score.(0-100)
37 37  
38 38  Except for the previous questions, we also collect feedback from participants
39 39  
... ... @@ -56,35 +56,25 @@
56 56   </tr>
57 57   <tr>
58 58   <td>1</td>
59 - <td>Participants sign the consent form and read the instruction for the evaluation;</td>
60 - <td>Participants sign the consent form and read the instruction for the evaluation;</td>
76 + <td>Memorize six pieces of music corresponding with different activities;</td>
77 + <td>Memorize six pieces of music corresponding with different activities;</td>
61 61   </tr>
62 62   <tr>
63 63   <td>2</td>
64 - <td>Participants memorize six pieces of music corresponding with different activities;</td>
65 - <td>Participants memorize six pieces of music corresponding with different activities;</td>
81 + <td>Play quiz with the smart robot for five minutes, which will correct the participant when wrong answers are given;</td>
82 + <td>Play quiz with the dumb robot for five minutes, which will not correct the participant when wrong answers are given;</td>
66 66   </tr>
67 67   <tr>
68 68   <td>3</td>
69 - <td>Participants play quiz with the smart robot for three minutes, which will correct the participant when wrong answers are given;</td>
70 - <td>Participants play quiz with the dumb robot for three minutes, which will not correct the participant when wrong answers are given;</td>
86 + <td>Test how well the participant remember the music-activity pairs by counting the mistakes made;</td>
87 + <td>Test how well the participant remember the music-activity pairs by counting the mistakes made;</td>
71 71   </tr>
72 - <tr>
73 - <td>4</td>
74 - <td>Test how well participants remember the music-activity pairs by counting the mistakes made;</td>
75 - <td>Test how well participants remember the music-activity pairs by counting the mistakes made;</td>
76 - </tr>
77 - <tr>
78 - <td>5</td>
79 - <td>Participants fill in the questionnaire and give the feedback;</td>
80 - <td>Participants fill in the questionnaire and give the feedback;</td>
81 - </tr>
82 82  <table>
83 83  {{/html}}
84 84  
85 85  == Measures ==
86 86  
87 -Count the correct answer in the final test.
94 +During the experiment, count how many tries it takes the user to answer correctly
88 88  After the experiment, ask the user to fill in the system usability scale and the questionnaire regarding mood and satisfaction.
89 89  
90 90  == Procedure ==
... ... @@ -95,8 +95,12 @@
95 95  
96 96  == Material ==
97 97  
98 -Robot(NAO) with setting music, consent form, laptop
105 +Robot
99 99  
107 +The robot plays an important part in our experiment.
108 +
109 +Consent form
110 +
100 100  = Results =
101 101  
102 102  = Discussion =