Project homeb. Test
1. Introduction
We aim to measure the effectiveness of a robot with interactive storytelling, which provides personalization and opportunities for interaction and activities with the family members of the patients. The control situation was a storytelling robot which narrates the story without any interaction or personalization. We aim to measure the claims made earlier using a modified Godspeed questionnaire. The questions added were:
1. The mood of the patient after the meal with storytelling.
2. The feedback of the patient for the story.
3. The enjoyment level of the patient (given by caregiver)
4. Was the meal completed? (given by caregiver)
5. Time taken to complete the meal: Too much time could mean the patient did not enjoy the meal, or that they were too engaged and hence it took longer. A critical analysis is needed to evaluate this measure.
The negative effects of Pepper were also measured in the questionnaire (covered in Godspeed)
1. Pepper was annoying.
2. Pepper was not human.
3. Pepper was disturbing.
2. Method
2.1 Participants
<N> TU Delft students participated in the study. There were <n1> male and <n2> female participants, with the average age of <>. Due to limited time, targeted users could not be included in the study, and all participants were from the course 'Socio Cognitive Engineering'.
2.2 Experimental design
The within-subject experimental design was chosen, due to the limited number of participants. So each participant was made to talk to the robot twice. The group was divided into half: the first half interacted with the robot with non-interactive storytelling first (control scenario), and then spoke to the robot with interactive storytelling. For the second half of the group, this order was reversed. This was done to balance any bias of talking to one robot before the other.
2.3 Tasks
The Pepper robot was powered on and connected to the laptop before the participants came in. The participants had to sign the consent form, talk to the robots (twice each) and fill in the questionnaire (twice each).
2.4 Measures
The experiment measured the differences between the non interactive storytelling robot (control situation) versus the interactive storytelling robot (experimental situation). After each interaction, the participant filled a questionnaire about how their experience with questions which could be answered on a scale of 1 to 5. The following questions were asked:
1. Was the patient in a better mood while eating?
2. Was the story interesting and engaging?
3. Did the patient enjoy their meal?
4. Did the patient completed their meal?
5. How much time did the patient take to complete their meal?
6. Was Pepper found to be annoying?
7. Was Pepper not human like?
8. Was Pepper disturbing?
The answers to these questions for both questionnaires were recorded, and the p-value was calculated to find the significance of the differences (if any).
2.5 Procedure
For the experiment, the following steps were performed for each participant:
1. Welcome the participant, and explain their tasks.
2. Make them sign the consent form, making them aware of the data being collected.
3. Power the robot version on depending on which group of participants they are in.
4. Make them interact with the first version of the robot.
5. Once completed, give them a questionnaire to document and fill their experience.
6. Power the second version of the robot they have to interact with.
7. Once completed, give them the same questionnaire to fill in their experience.
8. The experiment is now completed and they can leave.
The non interactive stories and interactive stories were hard-coded for now. The non interactive story was the robot narrating <S1>, while the interactive story was personalized based on a made-up scenario. This must be changed according to the patient's experiences.
2.6 Material
The following materials were used during the experiments:
1. Laptops for consent forms, questionnaires and the code.
2. The robot pepper.