Skip to Content
Last modified by Hrishita Chakrabarti on 2023/04/10 17:38
From version 5.8
edited by Hrishita Chakrabarti
on 2023/04/09 18:24
Change comment: There is no comment for this version
To version 6.2
edited by Hrishita Chakrabarti
on 2023/04/09 18:43
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -74,6 +74,22 @@
74 74  
75 75  == Week 6: ==
76 76  
77 -== Week 7: ==
77 +== Week 7: Evaluation ==
78 78  
79 -== Week 8: ==
79 +Due to the limited number of participants as well as the limited time available for evaluation, my team and I decided to conduct a within-study for our evaluation. We invited fellow students taking this course as well as other TU delft students to participate in our experiment. Each participant would be first asked to sign a consent form after which we explained to them how the evaluation would be conducted. The participant would first perform one story session with the robot and then report their evaluation in a modified Godspeed questionnaire and then perform another story session with the robot followed by the same questionnaire once again. In both scenarios, the participant took the role of the PwD while the roles of the formal caretaker and family member were performed by one of us within the team.
80 +
81 +There were two types of storytelling sessions which the participant had to participate in and evaluate:
82 +
83 +~1. Experiment scenario, wherein the robot narrated the story and in between asked questions to spark conversations
84 +
85 +2. Control Scenario, wherein the robot narrated the story and enacted conversations via voice modulations to portray different characters
86 +
87 +Half of the participants started with the control scenario and the other half started with the experiment scenario so that our results and analysis would not be influenced by the carry-over bias.
88 +
89 +We conducted a one-tailed sample t-test
90 +
91 +== Week 8: Final Presentation ==
92 +
93 +My teammates presented our project. They first began with a quick recap of our problem scenario and personas and then moved on to our design scenario elaborating on the theories on which we based our design. Then they explained our experiment and control scenarios, followed by our evaluation procedure and results, and finally wrapped up with our takeaways and limitations.
94 +
95 +We received some feedback on our choice of evaluation questionnaire and statistical analysis which we then added to our XWiki report as part of our critical analysis and takeaway for future projects.