1.Interactive Storytelling

Last modified by Anagha Magadi Rajeev on 2023/03/21 09:27

In our scenario, the robot distracts Georgina (the patient) and helps her deal with Sundown Syndrome through interactive storytelling. The robot understands the patient's mood based on her responses and tries to engage her by providing prompts and keeping her active, alert and also distracted from any negative thoughts throughout the storytelling process. This helps cheer her up and improves memory recall. This technology aids memory recollection, boosts confidence and combats depression among people living with dementia. 

We aim to use familiar stories or life experiences to prompt memories and encourage conversation through digital storytelling on the display interface of the pepper robot. This can allow patients to access a range of multimedia content, including photos, videos, and audio recordings, which can be used to prompt memories and spark conversations. We aim to improve the story-telling AI by adding background (or foreground) music to support the storytelling. By using soundtracks that the patient is familiar with, we can boost memory recall and help them associate certain stories with past experiences. This helps them identify themselves with something specific and keeps them grounded in their sense of self. Additionally, music helps in emotional regulation. So, using calming music while narrating a story can help the patient alleviate anxiety.

We would like to involve the family members, specifically Sam (informal caregiver), to engage in conversations with his mother and bolster their communication and relationship through a reminiscence group activity.  This can provide a social and supportive environment in which Georgina feels closer to her son and is able to cherish the time she was able to spend with him. 

Example Scenario:

The nurse and son have noticed that the patient has become increasingly agitated and uninterested in mealtimes. They use Pepper to try an interactive storytelling activity during dinner to engage her and encourage her to eat.

  1. First, they set the table with Georgina's favourite dish and utensils, and prepare to eat together as a family.
  2. During the meal, Pepper begins to tell a story about a memorable family picnic from Georgina's past. It describes the food, the company, and any special traditions or memories associated with the meal.
  3. Georgina may not remember the specific event, but the act of talking about a happy memory and sharing a meal together can create a positive and engaging atmosphere.
  4. As they eat, Pepper can continue to prompt the patient with questions and prompts related to the story. For example, it might ask the patient if she remembers a favourite family recipe, or if she has any special traditions or memories associated with mealtimes.
  5. Throughout the activity, the nurse and Sam can provide emotional support and encouragement, and create a warm and welcoming atmosphere that helps Georgina feel connected and engaged.

Overall, the goal of the interactive storytelling activity is to create a positive and enjoyable experience for the patient during mealtimes, which can improve her overall well-being and encourage her to eat. By incorporating familiar memories and traditions, the nurse and son can help the patient feel more connected to her past experiences and her family, and create a sense of comfort and security during a potentially stressful time of day.