Changes for page b. Test

Summary

• Page properties (1 modified, 0 added, 0 removed)

Details

Page properties

Content

...	...	@@ -40,7 +40,7 @@
40	40
41	41	The experiment measured the differences between the non interactive storytelling robot (control situation) versus the interactive storytelling robot (experimental situation). After each interaction, the participant filled a questionnaire about how their experience with questions which could be answered on a scale of 1 to 5. The link to the questionnaire is [[here>>https://tudelft.eu.qualtrics.com/jfe/preview/previewId/e0402219-f101-4c82-b651-98bbf7cdcc58/SV_8Gtn6s6loYOYXl4?Q_CHL=preview&Q_SurveyVersionID=current]].
42	42
43		-The answers to these questions for both questionnaires were recorded, and the p-value was calculated to find the significance of the differences (if any).
	43	+The answers to both questionnaires were recorded, and the p-value was calculated to find the significance of the differences (if any).
44	44
45	45	== 2.5 Procedure ==
46	46
...	...	@@ -74,8 +74,70 @@
74	74
75	75	= 3. Results =
76	76
	77	+With the answers from both questionnaires (i.e the ones in the control and experimental situations), the following means were observed for the questions with ratings on a 1 to 5 scale:
77	77
	79	+[[image:attach:QuestionnaireMeans.png||height="407" width="551"]]
	80	+
	81	+The x axis denotes the question number from the [[questionnaire>>https://tudelft.eu.qualtrics.com/jfe/preview/previewId/e0402219-f101-4c82-b651-98bbf7cdcc58/SV_8Gtn6s6loYOYXl4?Q_CHL=preview&Q_SurveyVersionID=current]] (these questions can also be seen in the table below) and the y axis denotes the mean rating of that question calculated from all participants. We can see that interactive storytelling has a higher mean in most questions than non interactive storytelling, which implies a more positive response from the participants towards the robot with interactive storytelling. This shows that the interactive storytelling robot might elicit a more positive response from patients with dementia.
	82	+
	83	+To further find if our results were significant, we performed a one tailed paired sample t test, and the table below summarizes the p values obtained for all the questions (robot characteristics).
	84	+
	85	+(% style="width:509px" summary="Table showing obtained p-values for all questions" %)
	86	+|=(% style="width: 47px;" %)Qs Num|=(% style="width: 279px;" %)Robot Characteristics (Questions from Questionnaire)|=(% style="width: 179px;" %)p-value
	87	+|(% style="width:47px" %)1|(% style="width:279px" %)//**1- Fake, 5- Natural**//|(% style="width:179px" %)//**0.04113**//
	88	+|(% style="width:47px" %)2|(% style="width:279px" %)1 - Machine Like, 5 - Human like|(% style="width:179px" %)0.20205
	89	+|(% style="width:47px" %)3|(% style="width:279px" %)1 - Unconscious, 5 - conscious|(% style="width:179px" %)0.14581
	90	+|(% style="width:47px" %)4|(% style="width:279px" %)1 - Artificial, 5 - Lifelike|(% style="width:179px" %)0.09371
	91	+|(% style="width:47px" %)5|(% style="width:279px" %)1 - Moving Rigidly, 5 - Moving elegantly|(% style="width:179px" %)0.15096
	92	+|(% style="width:47px" %)6|(% style="width:279px" %)1- Dead, 5- Alive|(% style="width:179px" %)0.5
	93	+|(% style="width:47px" %)7|(% style="width:279px" %)1 - Stagnant, 5 - Lively|(% style="width:179px" %)0.30576
	94	+|(% style="width:47px" %)8|(% style="width:279px" %)1 - Mechanical, 5 - Organic|(% style="width:179px" %)0.40923
	95	+|(% style="width:47px" %)9|(% style="width:279px" %)1 - Artificial, 5 - Lifelike|(% style="width:179px" %)0.26641
	96	+|(% style="width:47px" %)10|(% style="width:279px" %)//**1 - Inert, 5 - Interactive**//|(% style="width:179px" %)//**0.00495**//
	97	+|(% style="width:47px" %)11|(% style="width:279px" %)//**1- Apathetic, 5 - Responsive**//|(% style="width:179px" %)//**0.00759**//
	98	+|(% style="width:47px" %)12|(% style="width:279px" %)//**1- Dislike, 5- Like**//|(% style="width:179px" %)//**0.00143**//
	99	+|(% style="width:47px" %)13|(% style="width:279px" %)1 - Unfriendly, 5 - Friendly|(% style="width:179px" %)0.10392
	100	+|(% style="width:47px" %)14|(% style="width:279px" %)//**1 - Unkind, 5 - Kind**//|(% style="width:179px" %)//**0.02226**//
	101	+|(% style="width:47px" %)15|(% style="width:279px" %)//**1 - Unpleasant, 5 - Pleasant**//|(% style="width:179px" %)//**0.00845**//
	102	+|(% style="width:47px" %)16|(% style="width:279px" %)//**1 - Awful, 5 - Nice**//|(% style="width:179px" %)//**0.00329**//
	103	+|(% style="width:47px" %)17|(% style="width:279px" %)1- Ignorant, 5- Knowledgable|(% style="width:179px" %)0.13154
	104	+|(% style="width:47px" %)18|(% style="width:279px" %)//**1 - Irresponsible, 5 - Responsible**//|(% style="width:179px" %)//**0.01425**//
	105	+|(% style="width:47px" %)19|(% style="width:279px" %)1 - Unintelligent, 5 - Intelligent|(% style="width:179px" %)0.37610
	106	+|(% style="width:47px" %)20|(% style="width:279px" %)1 - Foolish, 5 - Sensible|(% style="width:179px" %)0.06823
	107	+|(% style="width:47px" %)21|(% style="width:279px" %)1- Anxious, 5- Relaxed|(% style="width:179px" %)0.16778
	108	+|(% style="width:47px" %)22|(% style="width:279px" %)1 - Agitated, 5 - Calm|(% style="width:179px" %)0.05548
	109	+|(% style="width:47px" %)23|(% style="width:279px" %)//**1 - Quiescent, 5 - Surprised**//|(% style="width:179px" %)//**0.04806**//
	110	+|(% style="width:47px" %)24|(% style="width:279px" %)1 - Demotivated, 5 - Motivated|(% style="width:179px" %)0.10392
	111	+|(% style="width:47px" %)25|(% style="width:279px" %)//**Mood of the patient after the activity.**//|(% style="width:179px" %)//**0.00055**//
	112	+|(% style="width:47px" %)26|(% style="width:279px" %)//**Patient's feedback about the story experience**//|(% style="width:179px" %)//**0.00037**//
	113	+|(% style="width:47px" %)27|(% style="width:279px" %)//**Patient's enjoyment**//|(% style="width:179px" %)//**0.00016**//
	114	+|(% style="width:47px" %)28|(% style="width:279px" %)Did the patient complete the activity?|(% style="width:179px" %)NA
	115	+|(% style="width:47px" %)29|(% style="width:279px" %)How many minutes did the patient take to complete the activity?|(% style="width:179px" %)NA
	116	+
	117	+
	118	+With a p-value chosen to be 0.05, the questions which received a p value less than this, have been highlighted in the table. We observe that 12/27 questions come out to be statistically significant, which include all 3 custom questions (Qs 25,26,27). We could not determine the results of the last two questions (i.e, whether the patient completed the activity or not, and the time taken to complete the activity) because of the limited scope of the experiment. The participants were neither dementia patients, nor were they actually eating: so it seemed irrelevant to base any results on these questions.
	119	+
	120	+The following graphs show the difference in means for the statistically significant questions:
	121	+
	122	+
	123	+[[image:https://lh6.googleusercontent.com/nTIJLrcxdbvmHRNU7AqEsBcRRH_29l73c4o1dbeVDAwvC9sKoupoUEHvoCqf3_LIAD2Uk51kRURT6jj5sMxTDnexvBHbWbyy9e-wSLmIyvowqEcNmeacWsCdbSXjGg0vVwtcPRg8hF_cSrtetKObNmITTg=s2048||height="361" width="509"]]
	124	+
	125	+Difference in means for Questions in Godspeed questionnaire
	126	+
	127	+
	128	+[[image:https://lh4.googleusercontent.com/I3voGI5LPNJH_jm41KqgOFHY1PixCJRBbZJosr0KlcuLrTlA7dC8dod_rU0Oex5kkjmADyc9e4rcNkhXsBV7IMPe-vVXj5gq2i7KOclqr_q5UdVijJe4f1dX9MWaejgSPdFkDlskEKrlG7djOYGMDFFUEg=s2048||height="312" width="518"]]
	129	+
	130	+Difference in means for custom questions
	131	+
78	78	= 4. Discussion =
79	79
	134	+From the above results, we do observe a difference between interactive and non interactive storytelling. Overall, the interactive storytelling robot was perceived to be more friendly and responsive, which could make a difference for patients with dementia. It was significantly more interactive than the non interactive storytelling robot, and promoted conversations between the patient and the family, which is beneficial for the patient. Though it was not significantly more intelligent than the robot in the control situation, the robot with interactive storytelling was perceived to be more amicable and human-like. As mentioned above, meal completion and time taken to complete the meal could not be judged due to limited scope of the experiment. Thus, these give answers to the research questions in an encouraging and hopeful direction.
	135	+
80	80
	137	+However, in the statistical testing we do not account for the fact that there are multiple questions, and the p-value might need to be changed in order to factor this in. In other words, we are testing multiple features on the same data, which increases the probability of atleast some features being significant (even if they are not). Hence, ideally we must divide the threshold p-value by 27 (for 27 questions) for a more accurate result. Another limitation lies in the fact that we could not experiment with actual patients: our participants were students who took the place of these patients. This could have affected judgements of the final results. Finally, the interactive storytelling requires templates of stories from the patient's life for an biographical story experience: this could raise privacy concerns. This also needs investment of time and work from the side of the family, as the patient with dementia might not be able to recall the stories of their past.
	138	+
	139	+All in all, factoring in the limitations, we do see promising results in this research towards the well-being of patients with dementia. More relevant experimentation would give more accurate results, and formative assessment at each stage could push the research in the direction which is most beneficial for the patients. In the future, more extensive research must be performed with patients, and using stories curated to their experiences. For most reliable results, the experiment should be organic, with the patient's family members involved, and in an environment where the robot will actually be deployed.
	140	+
81	81	= 5. Conclusions =
	142	+
	143	+In this report, we show performed research on how an intervention with robots can help patients with dementia. Stories about a patient's life and past can help promote memory retention and interaction about this with people around can help with mood management, and to connect with others. Using this, we built a robot for interactive biographical storytelling i.e, a robot which uses the patient's past experiences to spark conversations and interactions with family members. We conducted experiments using a non interactive storytelling robot as the control situation, and observe hopeful results towards the well-being of patients with dementia. These experiments have their limitations (as mentioned above) and can be improved in future work, but surely give an optimistic start to future research in the field.