Changes for page 4. Evaluation Methods
Last modified by Manali Shah on 2023/04/10 12:28
From version 7.1
edited by Manali Shah
on 2023/04/10 12:22
on 2023/04/10 12:22
Change comment:
There is no comment for this version
To version 8.1
edited by Manali Shah
on 2023/04/10 12:28
on 2023/04/10 12:28
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -9,13 +9,20 @@ 9 9 10 10 **Research Question** 11 11 12 -" Is interactive storytellingmoreengagingand beneficialthanstorytellinginthethird personforpersons sufferingfromdementia?"12 +"Can personalized, interactive storytelling have a positive effect on the well-being of people with dementia?" 13 13 14 +Sub RQ1: Does it improve the patient’s mood? 15 +Sub RQ2: Does it spark interactions with other people? 16 +Sub RQ3: Does it motivate them to complete their daily activities? 17 +Sub RQ4: Does it promote memory retention? 18 +Sub RQ5: Does it improve the storytelling experience? 19 + 14 14 Thus, our control situation is the scenario of a robot narrating a story without any involvement of the patient, and the scenario we want to evaluate is the one where the robot narrates the same story while trying to engage and take inputs from the patient. With this, we aim to find whether it is beneficial and engaging for patients with dementia. 15 15 22 + 16 16 **The Within-Subject Design** 17 17 18 -As part of the experiment design, we chose the within subject design over between subject. This means that each participant will interact with the robot twice. This was done due to the limited number of participants, and to avoid any biases of participant preferences. 25 +As part of the experiment design, we chose the within subject design over between subject. This means that each participant will interact with the robot twice. This was done due to the limited number of participants, and to avoid any biases of participant preferences. However, we ensure that the order of talking to each robot changes with the participant, i.e, half the participants talk to the robot in the control situation first and then the robot in the experimental situation. For the other half this order is reversed. This was done to avoid carry over effects. 19 19 20 20 21 21 **Summative Evaluation** ... ... @@ -25,8 +25,10 @@ 25 25 26 26 **Questionnaire** 27 27 28 -We used a modified version of the Godspeed questionnaire for our evaluation [1]. It measures the anthropomorphism, animacy, likeability, intelligence, and safety of the robot. This uses a Likert scale where the user must rate questions as a number between 1 and 5; both numbers being at opposite poles. Tomeasurewhetherpatients with dementiacompletedthectivitytheyweremeanttodo, andtoevaluatewhether storytellingmade adifferencetotheirmeal, we addedthefollowing questions:35 +We used a modified version of the Godspeed questionnaire for our evaluation [1]. It measures the **anthropomorphism, animacy, likeability, intelligence, and safety** of the robot. This uses a Likert scale where the user must rate questions as a number between 1 and 5; both numbers being at opposite poles. We decided to go ahead with the Godspeed questionnaire, because in dealing with patients with dementia, it seemed relevant to measure the above mentioned 5 characteristics of the robot, as they play an important role in making the patient feel more comfortable and at ease. 29 29 37 +To measure whether patients with dementia completed the activity they were meant to do, and to evaluate whether storytelling made a difference to their meal, we added the following questions: 38 + 30 30 1. Please rate the question according to the following attributes. - Mood of the patient after the activity. (Scale of 1 to 5) 31 31 32 32 2. Please rate the question according to the following attributes. - Patient's feedback about the story experience (Scale of 1 to 5)