b. Test

Version 4.1 by Manali Shah on 2023/03/16 18:23

1. Introduction

We aim to measure the effectiveness of a robot with interactive storytelling, which provides personalization and opportunities for interaction and activities with the family members of the patients. The control situation was a storytelling robot which narrates the story without any interaction or personalization. We aim to measure the claims made earlier:

1. The mood of the patient improves after the interactive storytelling session.

2. The patient eats their meals with more eagerness.

2. Method

2.1 Participants

<N> TU Delft students participated in the study. There were <n1> male and <n2> female participants, with the average age of <>. Due to limited time, targeted users could not be included in the study, and all participants were from the course 'Socio Cognitive Engineering'.

2.2 Experimental design

The within-subject experimental design was chosen, due to the limited number of participants. So each participant was made to talk to the robot twice. The group was divided into half: the first half interacted with the robot with non-interactive storytelling first (control scenario), and then spoke to the robot with interactive storytelling. For the second half of the group, this order was reversed. This was done to balance any bias of talking to one robot before the other.

2.3 Tasks

2.4 Measures

The experiment measured the differences between the non interactive storytelling robot (control situation) versus the interactive storytelling robot (experimental situation). After each interaction, the participant filled a questionnaire about how their experience with questions which could be answered on a scale of 1 to 5, with one being strongly disagree and 5 being strongly agree. The following questions were asked:

1. 

2.

The answers to these questions for both questionnaires were recorded, and the p-value was calculated to find the significance of the differences.

2.5 Procedure

For the experiment, the following steps were performed for each participant:

1. Welcome the participant, and explain their tasks.

2. Make them sign the consent form, making them aware of the data being collected.

3. Power the robot version on depending on which group of participants they are in.

4. Make them interact with the first version of the robot.

5. Once completed, give them a questionnaire to document and fill their experience.

6. Power the second version of the robot they have to interact with. 

7. Once completed, give them the same questionnaire to fill in their experience.

8. The experiment is now completed and they can leave.

The non interactive stories and interactive stories were hard-coded for now. The non interactive story was the robot narrating <S1>, while the interactive story was personalized based on a made-up scenario. This must be changed according to the patient's experiences.

2.6 Material

The following materials were used during the experiments:

1. Laptops for consent forms, questionnaires and the code.

2. The robot pepper.

3. Results

4. Discussion

5. Conclusions