Changes for page Simran - Self Reflection
Last modified by Simran Kaur on 2023/04/11 20:03
From version 9.1
edited by Simran Kaur
on 2023/04/11 18:17
on 2023/04/11 18:17
Change comment:
There is no comment for this version
To version 10.1
edited by Simran Kaur
on 2023/04/11 20:00
on 2023/04/11 20:00
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -89,25 +89,27 @@ 89 89 90 90 This week was quite informative and learning intensive in terms of all the factors, practical and ethical, that need to be considered while designing an evaluation for a system. 91 91 92 -=== Week 6: Prototype Implementation and InitialTesting ===92 +=== Week 6: Prototype Implementation, Pilot testing === 93 93 94 -==== Lecture: Ontologies ==== 94 +(% class="wikigeneratedid" id="HLecture:Ontologies" %) 95 +The focus of this week was implementing our prototype and testing it out within our group. We used Interactive Robots to program the Pepper robot with two pre-filled story templates - Picnic and Thanksgiving - for the testing of our Interactive Storytelling session use case. During this process, we built two versions of each story, non-interactive: one with simple narration and another, interactive: with inbuilt prompts to spark conversations. We planned to gauge the usefulness of the interaction design in our evaluations through comparison of the experimental interactive scenario with the control non-interactive scenario. 95 95 96 -= ===97 - Labsession:Implementing prototype,EvaluationStudyPlanning====97 +(% class="wikigeneratedid" %) 98 +With implementation, we faced some challenges with the Pepper robot in using its tablet and getting it to recognize our speech and touch input. We were able to mitigate them by coming up with alternatives such as touch action on remote laptop screen through clicks, in order to preserve the flow of interactions. Working with the Pepper robot and being able to self-test the functionality we envisioned to build was quite interesting and further helped refine the design we had been building through our incrementally iterative design process. 98 98 99 -We were given the time for the lab session to work on our prototype and planning our evaluation. 100 100 101 - 102 102 === Week 7: === 103 103 104 - ====Lecture: Human-Agent/RobotTeamwork====103 +The focus of this week was conducting the evaluation for our prototype with participants and analyzing the results. We had prepared the participation consent form and the measurements questionnaire along with the prototype on the Pepper robot. Since we had limited time and a limited number of participants, we decided to conduct a within-study evaluation, wherein we would have each participant evaluate both the control and the experiment scenario. We also decided that for half of the total evaluation sessions, we would present the participant with the control scenario first, and for the other half, we would present the experimental scenario first. This strategy was employed in order to mitigate carry-over bias. 105 105 106 -==== 107 -Lab session: Conducted Evaluation ==== 105 +For each evaluation session, the participants first signed the consent form. Then they engaged in the first storytelling session, filled in the questionnaire, engaged in the second storytelling session, and filled in the questionnaire again. It was really interesting and informative to see how the participants responded to our interaction design, and how our system was perceived by them. Further, participating in other groups’ evaluation sessions also provided a broader view of the kind of effects our peers were trying to have with their design and what they considered worthwhile to measure. 108 108 109 -We u sed the labsession to prepare ourevaluation.107 +With the evaluation completed, we analyzed the results through a statistical test to determine significant results. With this, our claims around improving the mood of the person with dementia through interactive storytelling were confirmed. The entire process taught me a lot about how to assess a system design in terms of the claims it makes for the effects it wants to achieve. 110 110 111 111 === Week 8: Group Presentation - Endterm === 112 112 113 -==== ==== 111 +(% class="wikigeneratedid" id="H" %) 112 +We compiled our project work and the results from the evaluation and I along with two of my teammates presented them to the class. We received interesting questions from our peers and the professors, which further helped us critically reflect on our design decisions. I also had an interesting discussion about designing the system in a way such that it minimises the possible negative effects that it could also have. 113 + 114 +(% class="wikigeneratedid" %) 115 +To conclude, designing a robotic intervention for people with dementia took us through the entire SCE process. It was a fruitful journey in which we learned by experimenting, analyzing and reflecting.