Changes for page Simran - Self Reflection
Last modified by Simran Kaur on 2023/04/11 20:03
From version 10.1
edited by Simran Kaur
on 2023/04/11 20:00
on 2023/04/11 20:00
Change comment:
There is no comment for this version
To version 5.1
edited by Simran Kaur
on 2023/04/10 23:35
on 2023/04/10 23:35
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -34,7 +34,7 @@ 34 34 We also discussed in detail about our personas and their associated value stories, in order to inform our design decisions better. 35 35 Then we were introduced to scenario-based design and its benefits in reflecting the current situation (problem scenario) and the envisioned future (design scenario). We used our personas and value stories to formulate the problem and design scenario which would then be formalized into our main Use Case. 36 36 37 -We focused on defining our environment and stakeholders and further developing our personas and enhancing the problem and design scenarios for the rest of the week. Building the scenarios helped me to reflect on the reasons why we were building a human-robot interaction system in the first place, and allowed for visualizin ghow we would want the interactions to flow.37 +We focused on defining our environment and stakeholders and further developing our personas and enhancing the problem and design scenarios for the rest of the week. Building the scenarios helped me to reflect on the reasons why we were building a human-robot interaction system in the first place, and allowed for visualization how we would want the interactions to flow. 38 38 39 39 40 40 === Week 3: PAL project, Specification === ... ... @@ -55,7 +55,7 @@ 55 55 === Week 4: Group Presentation - Midterm === 56 56 57 57 (% class="wikigeneratedid" %) 58 -My teammates presented the Foundation and Specification of our project. Our presentation was focused on detailing the environment, stakeholders, and persons for our system. We further dived into our problem and design scenarios, and our design plan for a robotic intervention for people with dementia through interactive storytelling, back edby scientific sources. The question/answer session helped provide a third-person view of how our design was perceived by others and how we could improve it. We got valuable feedback for the presentation, specially around designing our evaluation study for what was feasible for our scope.58 +My teammates presented the Foundation and Specification of our project. Our presentation was focused on detailing the environment, stakeholders, and persons for our system. We further dived into our problem and design scenarios, and our design plan for a robotic intervention for people with dementia through interactive storytelling, back by scientific sources. The question/answer session helped provide a third-person view of how our design was perceived by others and how we could improve it. We got valuable feedback for the presentation, specially around designing our evaluation study for what was feasible for our scope. 59 59 60 60 (% class="wikigeneratedid" id="H" %) 61 61 I was also inspired a lot by attending the other groups' presentations and getting to know how they were approaching the design for their use cases. ... ... @@ -63,53 +63,30 @@ 63 63 We used the rest of the week to reflect on the midterm feedback and incorporate it into our design. 64 64 65 65 66 -=== Week 5: Design Specifications===66 +=== Week 5: Evaluation === 67 67 68 -==== Lecture: Design Patterns, Design Rationale====68 +==== Lecture: ==== 69 69 70 -(% class="wikigeneratedid" %) 71 -This week we learnt about Team Design Patterns and Interaction Design Patterns which provided important concepts and tools for designing the interactions between actors for our system. 72 - 73 -(% class="wikigeneratedid" %) 74 -We explored the design questions for our system that would help address a general, broader issue. We also focused on supporting our design decisions with scientific theory and argumentation to fortify our design rationale. 75 - 76 -(% class="wikigeneratedid" %) 77 -We worked on building the IDP by exploring how the different actors in our scenario could and should interact with each other. This shaped the TDP for our main use case of the interactive storytelling session. Through this process, I learnt the importance of pattern-based design in identifying recurrent/generalizable problems within a context and defining structured descriptions for the solution to it. 78 - 79 79 ==== 80 -Lab session: P lanning Evaluations====71 +Lab session: Prototype ==== 81 81 82 -We also learnt about how evaluations should be planned for our prototype. The purpose of the evaluations is to assess the claims at the task level and check the usability of the interaction design. We were introduced to various approaches, like qualitative analysis to formulate hypothesis and quantitative analysis to test the hypothesis. 83 83 84 - Weexplored the formative and summative evaluations that could be conducted for our system.Wedecidedtofocuson the summative evaluation to assess the overall effects of the system. Also, a formative evaluation would not have been feasible within the limited time.74 +=== Week 6: === 85 85 86 - Forour measurements and metrics, we usedthe Godspeed questionnairefor a standardized assessmentof our robotic agent. It address factors likebeing interactive, inert,animate,etcwhich were relevant for our use case. For the effects, we prioritizedmeasuringthe following:the mood of the patient post activity (subjective) and whetherthe patient finished their mealand in how much time (objective). However, we identified that due to the practical issueof not being able to test with actual dementia patients, the objective measures would not be collected accurately.76 +==== Lecture: Intersectionality, Inclusive Design, Universal Access ==== 87 87 88 -We wanted to host our questionnaires for online experimentation. For collecting the responses to our questionnaires, we decided to use the GDPR compliant Qualtrix survey tool. 78 +==== 79 +Lab session: Evaluation Study Planning ==== 89 89 90 -This week was quite informative and learning intensive in terms of all the factors, practical and ethical, that need to be considered while designing an evaluation for a system. 91 91 92 -=== Week 6:PrototypeImplementation, Pilot testing===82 +=== Week 7: === 93 93 94 -(% class="wikigeneratedid" id="HLecture:Ontologies" %) 95 -The focus of this week was implementing our prototype and testing it out within our group. We used Interactive Robots to program the Pepper robot with two pre-filled story templates - Picnic and Thanksgiving - for the testing of our Interactive Storytelling session use case. During this process, we built two versions of each story, non-interactive: one with simple narration and another, interactive: with inbuilt prompts to spark conversations. We planned to gauge the usefulness of the interaction design in our evaluations through comparison of the experimental interactive scenario with the control non-interactive scenario. 84 +==== Lecture: Human-Agent/Robot Teamwork ==== 96 96 97 - (% class="wikigeneratedid"%)98 - With implementation, we faced some challenges with the Pepper robotin using its tablet and getting it to recognize ourspeech and touch input. We were able to mitigate them by coming up with alternativessuch as touch actionon remote laptop screen through clicks, in order to preserve the flow of interactions. Working with the Pepper robot and being able to self-test the functionality we envisionedto buildwas quite interesting and further helped refine the design we had been building through our incrementallyiterative design process.86 +==== 87 +Lab session: Evaluation Study ==== 99 99 100 100 101 -=== Week 7: === 102 - 103 -The focus of this week was conducting the evaluation for our prototype with participants and analyzing the results. We had prepared the participation consent form and the measurements questionnaire along with the prototype on the Pepper robot. Since we had limited time and a limited number of participants, we decided to conduct a within-study evaluation, wherein we would have each participant evaluate both the control and the experiment scenario. We also decided that for half of the total evaluation sessions, we would present the participant with the control scenario first, and for the other half, we would present the experimental scenario first. This strategy was employed in order to mitigate carry-over bias. 104 - 105 -For each evaluation session, the participants first signed the consent form. Then they engaged in the first storytelling session, filled in the questionnaire, engaged in the second storytelling session, and filled in the questionnaire again. It was really interesting and informative to see how the participants responded to our interaction design, and how our system was perceived by them. Further, participating in other groups’ evaluation sessions also provided a broader view of the kind of effects our peers were trying to have with their design and what they considered worthwhile to measure. 106 - 107 -With the evaluation completed, we analyzed the results through a statistical test to determine significant results. With this, our claims around improving the mood of the person with dementia through interactive storytelling were confirmed. The entire process taught me a lot about how to assess a system design in terms of the claims it makes for the effects it wants to achieve. 108 - 109 109 === Week 8: Group Presentation - Endterm === 110 110 111 -(% class="wikigeneratedid" id="H" %) 112 -We compiled our project work and the results from the evaluation and I along with two of my teammates presented them to the class. We received interesting questions from our peers and the professors, which further helped us critically reflect on our design decisions. I also had an interesting discussion about designing the system in a way such that it minimises the possible negative effects that it could also have. 113 - 114 -(% class="wikigeneratedid" %) 115 -To conclude, designing a robotic intervention for people with dementia took us through the entire SCE process. It was a fruitful journey in which we learned by experimenting, analyzing and reflecting. 92 +==== ====