Changes for page Test

Last modified by Andrei Stefan on 2022/04/04 13:38

From 16.1 to 17.1 From 67.1 to 68.1

From version

17.1

edited by Dongxu Lu
on 2022/03/05 23:40

Change comment: There is no comment for this version

To version

67.1

edited by Xinqi Li
on 2022/04/01 22:32

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (2 modified, 0 added, 0 removed)
Objects (0 modified, 1 added, 0 removed)
- XWiki.XWikiComments[0]

Details

Page properties

Author

@@ -1,1 +1,1 @@
--XWiki.dongxulu
++XWiki.mona98

Content

@@ -1,66 +1,83 @@
--= Method =
++Our robot aims to help delay the stage of dementia or slow down the deterioration of memory. The best situation is that we can test the robot with real PwD and in a relatively long time period to see if this robot really works, which is impossible for our project. So our evaluation performs in a group control way. Participants are divided into two groups, group A with the intelligent one, and group B with the dumb one.
--We are doing a mixed-method approach. We are producing qualitative data from focus groups by asking them how they liked to interact with the robot. By measuring how successfully we achieved our claims we will create questionnaires which will be quantitative data.
++= Problem statement and research questions =
--== Participants ==
++The main use cases that the evaluation focuses on are UC001: Daily todo list and UC005: Quiz. Based on the claims corresponding to those use cases, we derive the following research questions:
--Due to covid restrictions, we have to “simulate” our robot-human interaction with elderly people affected by dementia. For that reason, we will ask roughly eighteen people how will pretend to be people with different dementia types, the loved ones or the caregiver. We will create three groups / six people in each. In each group, one person will “play” the role of a caregiver, one plays the loved one, and the remaining four people will do the role of the person with dementia. In each group, the “onset of dementia played” should be different. In Group A, people act like they just have early-onset symptoms, but they are almost fully functioning. They sometimes get confused, but these moments swiftly pass and they are back to their true selves. In Group B, people should have a harder time keeping track of things, forgetting about tasks, people and memories should be common. These people’s life is constantly affected by the disease, but they sometimes have clear moments when they are back to their original selves before dementia. In Group C people have late-onset of dementia. Constant confusion is more common than moments of clarity which usually doesn't last long. People should have a hard time keeping track of anything, and remembering is not something that’s even possible anymore.
++1. Are PwD willing to play the quiz?
++1. Are PwD happy to listen to music?
++1. Are PwD happy if they get the correct answer?
++1. Does PwD enhance their memory of the association between music and activities?
--== Experimental design ==
++= Method =
--The experiment will be conducted by simulating the interaction between the patient, robot and other actors. The group of participants will be divided into 3 subgroups that simulate patients in different stages of dementia. The participants will be given artificial memory loss by forcing them to remember a large number of songs they have to associate with certain activities. From each group one of the participants will be asked to play the caregiver and another participant will take the roll of loved one. With these participants the interactions between the actors will be tested. The interactions are described in the design patterns.
++The control group evaluation is used. One group of participants interacts with a dumb robot and another group interacts with the intelligent robot. The only difference between these two groups is the independent variable - dumb or intelligent robot, which makes our result more reasonable.
--When the participant playing the role of patient has learned the association between the music pieces and activities the robot will start playing certain pieces of music. The participant has to recall the correct activity associated with the music piece. When this is wrong the loved one can step in and call to remind the
++Besides, Our group decided to use a mixed-method approach for the evaluation.
--== Tasks ==
++* Quantitative data will be derived during the experiment such as the number of mistakes the participant makes during the quiz.
++* Qualitative data expected to be gathered through questionnaires, such as to what extent participants are satisfied with using the robot, is also adopted for evaluation.
++By measuring these two types of data, we will manage to assess if our claims are achieved and the research questions are answered.
++== Participants ==
--=== Event: Activity ===
++We invited 19 participants. To validate our research question that the quiz will help people better memorize music-activity links, participants will be divided into two groups, Group A with the intelligent robot(9 participants) and Group B(10 participants) with the dumb robot.
++== Experimental design ==
++The experiment will be conducted to simulate the reinforcement learning process of musical memory related to daily activities and to investigate if the quiz is indeed able to help with the learning.
++All participants would sign a consent form that informed them of the usage of the collected data and our goal of evaluations. In our prototype, users can personalize the association between music and activities based on their existing intrinsic knowledge. But due to the limited time and requiring a comparable result between groups, in evaluation, we forced 6 pieces of music and activities. Participants listened to the music and were asked the remember the associated activities.
++In the end, the participants would take a quiz to see how much they remembered. They are also asked to fill in a questionnaire including the feeling of the robot and possible feedback.
--==== Patients ====
++1. How many questions did you answer correctly? (Points from 0-6)
++1. You feel the robot can help you remember the task. (Agree, Neutral, Disagree)
++1. You feel the robot is annoying. (Agree, Neutral, Disagree)
++1. Based on the given system usability scale, please give our robot a score. (0-100)
++Except for the previous questions, we also collect feedback from participants
++1. What did you like most about the robot?
++1. What did you dislike most about the robot?
++1. Do you have any further suggestions? (*optional)
++
++
++== Tasks ==
++
++**Event: Quiz**
++
  {{html}}
  <table>
      <tr>
          <td>No.</td>
--        <td>Group A</td>
--        <td>Group B</td>
--        <td>Group c</td>
++        <td>Group A with the intelligent robot</td>
++        <td>Group B with the dumb robot</td>
      </tr>
      <tr>
          <td>1</td>
--        <td>Memorize five pieces of music corresponding with different activities within three minutes;</td>
--        <td>Memorize seven pieces of music corresponding with different activities within three minutes;</td>
--        <td>Memorize ten pieces of music corresponding with different activities within three minutes;</td>
++        <td>Participants sign the consent form and read the instruction for the evaluation;</td>
++        <td>Participants sign the consent form and read the instruction for the evaluation;</td>
      </tr>
      <tr>
          <td>2</td>
--        <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music1;</td>
--        <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music1;</td>
--        <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music1;</td>
++        <td>Participants memorize six pieces of music corresponding with different activities;</td>
++        <td>Participants memorize six pieces of music corresponding with different activities;</td>
      </tr>
      <tr>
          <td>3</td>
--        <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music2;</td>
--        <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music2;</td>
--        <td>Say “I will do [activity_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music2;</td>
++        <td>Participants play quiz with the smart robot for three minutes, which will correct the participant when wrong answers are given;</td>
++        <td>Participants play quiz with the dumb robot for three minutes, which will not correct the participant when wrong answers are given;</td>
      </tr>
      <tr>
          <td>4</td>
--        <td>Ignore the music when hearing the robot playing music3;</td>
--        <td>Ignore the music when hearing the robot playing music3;</td>
--        <td>Ignore the music when hearing the robot playing music3;</td>
++        <td>Test how well participants remember the music-activity pairs by counting the mistakes made;</td>
++        <td>Test how well participants remember the music-activity pairs by counting the mistakes made;</td>
      </tr>
      <tr>
          <td>5</td>
--        <td>Say “I will do [task_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music3 again.</td>
--        <td>Say “I will do [task_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music3 again.</td>
--        <td>Say “I will do [task_name] now.”/ ”I don’t know.” to the robot after hearing the robot play music3 again.</td>
++        <td>Participants fill in the questionnaire and give the feedback;</td>
++        <td>Participants fill in the questionnaire and give the feedback;</td>
      </tr>
  <table>
  {{/html}}
@@ -67,21 +67,52 @@
  == Measures ==
--More details regarding the qualitative and quantitative analysis.
++Count the correct answer in the final test.
++After the experiment, ask the user to fill in the system usability scale and the questionnaire regarding mood and satisfaction.
--
  == Procedure ==
--do the task, consent form, questionnaire, detailed, practical explanation
++**Event: Quiz**
++{{html}}
++<table>
++    <tr>
++        <td>No.</td>
++        <td>Group A with the intelligent robot</td>
++        <td>Group B with the dumb robot</td>
++    </tr>
++    <tr>
++        <td>1</td>
++        <td>Participants sign the consent form and read the instruction for the evaluation;</td>
++        <td>Participants sign the consent form and read the instruction for the evaluation;</td>
++    </tr>
++    <tr>
++        <td>2</td>
++        <td>Participants memorize six pieces of music corresponding with different activities;</td>
++        <td>Participants memorize six pieces of music corresponding with different activities;</td>
++    </tr>
++    <tr>
++        <td>3</td>
++        <td>Participants play quiz with the smart robot for three minutes, which will correct the participant when wrong answers are given;</td>
++        <td>Participants play quiz with the dumb robot for three minutes, which will not correct the participant when wrong answers are given;</td>
++    </tr>
++    <tr>
++        <td>4</td>
++        <td>Test how well participants remember the music-activity pairs by counting the mistakes made;</td>
++        <td>Test how well participants remember the music-activity pairs by counting the mistakes made;</td>
++    </tr>
++    <tr>
++        <td>5</td>
++        <td>Participants fill in the questionnaire and give the feedback;</td>
++        <td>Participants fill in the questionnaire and give the feedback;</td>
++    </tr>
++<table>
++{{/html}}
++
  == Material ==
--Robot
++Robot(NAO) with setting music, consent form, laptop
--The robot plays an important part in our experiment.
--
--Consent form
--
  = Results =
  = Discussion =

XWiki.XWikiComments[0]

Author

...	...	@@ -1,0 +1,1 @@
	1	+Anonymous

Comment

...	...	@@ -1,0 +1,1 @@
	1	+Refer to the claims in the problem statement and research questions.

Date

...	...	@@ -1,0 +1,1 @@
	1	+2022-03-21 19:53:54.868