Last modified by Hrishita Chakrabarti on 2023/04/10 17:38

From version 6.1
edited by Hrishita Chakrabarti
on 2023/04/09 18:26
Change comment: There is no comment for this version
To version 7.3
edited by Hrishita Chakrabarti
on 2023/04/10 16:59
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -10,6 +10,22 @@
10 10  
11 11  Talked further in detail in next week's guest lecture.
12 12  
13 +==== ReJAM: ====
14 +
15 +Targeted for elderly residents of Pieter Van Foreest suffering from dementia
16 +
17 +The ReJAM project is designed to stimulate the patients socially, cognitively, affectively, and physically through music-related activities
18 +
19 +Some examples of activities:
20 +
21 +- Playing the patient's favourite music and asking them if it reminds them of something (reminiscence)
22 +
23 +- Asking the patient to follow the robot's movement to dance along with it (physical rehab)
24 +
25 +- Playing music bingo (memory practice)
26 +
27 +The robot would also act as a social actor and be a companion to the elderly patients by chatting with them, singing songs together, playing games, etc
28 +
13 13  ==== Learning with Charlie: ====
14 14  
15 15  Targeted for children suffering from Type 1 diabetes and their parents and caregivers.
... ... @@ -20,10 +20,12 @@
20 20  
21 21  ==== Lab Activity: ====
22 22  
23 -Formed teams and discussed a possible use case for developing a system of robot intervention for aiding a Person with Dementia (PwD).
39 +Formed teams and discussed a possible use case for developing a system of robot intervention for aiding a Person with Dementia (PwD). We learnt about the different robots available for the project - Nao, Pepper, and Miro.
24 24  
25 -My team and I decided to focus on mealtime, especially during dinner when a PwD at the moderate stage of dementia suffers from confusion, anxiety and irritability due to Sundown Syndrome. We created three personas to develop our use-case scenario - Georgina (the PwD), Eleana (formal caretaker), and Sam (family member). We received positive feedback for our chosen problem scenario so we decided to conduct further research into existing literature about the use case for better understanding and consequent system design.
41 +My team and I decided to focus on mealtime, especially during dinner when a PwD at the moderate stage of dementia suffers from confusion, anxiety and irritability due to Sundown Syndrome. We created three personas to develop our use-case scenario - Georgina (the PwD), Eleana (formal caretaker), and Sam (family member). After discussions within the team, we decided that the Pepper robot would be the best suited for our use case as it can narrate stories and display pictures on the screen attached to its torso. While both Nao and Pepper are humanoid robots capable of holding conversations, we decided to stick with Pepper as our use case did not require too much movement by the robot, and the height of the Pepper robot was also better suited for this use case such that it could stand in front or around the PwD while narrating the story.
26 26  
43 +We received positive feedback for our chosen problem scenario so we decided to conduct further research into existing literature about the use case for better understanding and consequent system design.
44 +
27 27  == Week 2: Dementia, Memory and Music as an Intervention ==
28 28  
29 29  ==== Cognitive change is natural: ====
... ... @@ -70,10 +70,36 @@
70 70  
71 71  At the end of the presentation, we received some feedback and questions which we then used to improve our design for our implementation.
72 72  
73 -== Week 5: ==
91 +== Week 5: Design Specifications ==
74 74  
75 -== Week 6: ==
76 76  
94 +== Week 6: Implementation and Initial Testings ==
95 +
96 +This week we focused on finalising our system design and implementing our design using the Interactive Robots platform. For our evaluation, we decided on testing our robot in two scenarios - one where it encouraged conversation while narrating a story from the patient's past; the second where it only narrated the story as the patient had their meal. To avoid any bias from the story's content, we decided that the story narrated in both scenarios would be the same but we still would like the patient/caretaker to have some choices when it comes to which story they would like to hear to avoid monotony.
97 +
98 +The team and I then brainstormed on short but nostalgic stories and came up with two stories - a picnic outing with family and a Thanksgiving dinner with family. We fleshed out the story with the dialogues and prompts and then implemented the story flow on the Interactive Robots platform. During the implementation, we realised that using Interactive Robots we couldn't connect to Pepper's tablet so we modified the prompts such that the prompts would appear on the device held by the caretaker. We first tested out the motions and flow of the story on the virtual robot and once we were satisfied we booked a slot for testing it on the Pepper robot.
99 +
100 +While testing with Pepper we realised the audio inputs weren't very accurate and often the robot failed to pick up the trigger word so we modified the triggers such that the robot would respond to speech or an alternative touch/remote action such that the flow of conversation is not interrupted during the actual evaluation.
101 +
77 77  == Week 7: Evaluation ==
78 78  
104 +Our hypothesis was that **a more interactive i.e conversational robot (experiment scenario) would be better at improving the PwD's mood as well as creating a more immersive and enjoyable storytelling session which would motivate the PwD to finish their meal enthusiastically.**
105 +
106 +Due to the limited number of participants as well as the limited time available for evaluation, my team and I decided to conduct a **within-study** for our evaluation. We invited fellow students taking this course as well as other TU delft students to participate in our experiment. Each participant would be first asked to sign a consent form after which we explained to them how the evaluation would be conducted. The participant would first perform one story session with the robot and then report their evaluation through a questionnaire and then perform another story session with the robot followed by the same questionnaire once again. In both scenarios, the participant took the role of the PwD while the roles of the formal caretaker and family member were performed by one of us within the team.
107 +
108 +There were two types of storytelling sessions which the participant had to participate in and evaluate:
109 +
110 +~1. Experiment scenario, wherein the robot narrated the story and in between asked questions to spark conversations
111 +
112 +2. Control Scenario, wherein the robot narrated the story and enacted conversations via voice modulations to portray different characters
113 +
114 +
115 +We were able to perform the experiment with 14 participants. Half of the participants started with the control scenario and the other half started with the experiment scenario so that our results and analysis would not be influenced by the carry-over bias. The questionnaire used for evaluation was based on the Godspeed questionnaire which tests of perceived anthropomorphism, animacy, safety and the threat of the robot. We modified the questionnaire to also evaluate the mood of the patient (participant) after each story session as well as how much they enjoyed the story.
116 +
117 +We conducted a **one-tailed paired test (dependent t-test)** to test for the statistical significance of our results. All three of our added questions were significant proving that the conversational robots **significantly improved the patient's mood** in comparison to the non-conversational robot. Some other significant differences between the conversational robot and non-conversational robot were that the patients in general perceived the conversational robot to be **more natural and responsible** and they also **liked** the conversational robot more than the non-conversational robot.
118 +
79 79  == Week 8: Final Presentation ==
120 +
121 +My teammates presented our project. They first began with a quick recap of our problem scenario and personas and then moved on to our design scenario elaborating on the theories on which we based our design. Then they explained our experiment and control scenarios, followed by our evaluation procedure and results, and finally wrapped up with our takeaways and limitations.
122 +
123 +We received some feedback on our choice of evaluation questionnaire and statistical analysis which we then added to our XWiki report as part of our critical analysis and takeaway for future projects.