Design Patterns
Team design pattern I: Basic
Figure 1: Design Pattern
Overview
The design pattern above demonstrates the interactions between Nao and the PwD. The top pattern concerns UC01, the mealtime discourse. The bottom pattern concerns UC02, the mealtime reminder. In this section, the design pattern will be explained step by step.
First, it should be mentioned that UC01 and UC02 will follow after one another, meaning: if the conclusion from the mealtime discourse (UC01) is that the PwD has not yet had a certain meal, the mealtime reminder will start (UC02). At the next preprogrammed time, UC01 the mealtime discourse will start again, possibly once again causing the UC02 the mealtime reminder to start.
Purpose
The purpose of this design pattern is to show first how the mealtime discourse (UC01) works. Secondly, this design pattern aims to show how the meatime reminder (UC02) works step by step.
Steps Breakdown
UC01: The mealtime discourse
- Robot greets PwD by playing “start music”.
This way the robot gets the attention from the PwD, without startling the PwD too much. - Robot aks if PwD has eaten
- PwD answers question 2) from Robot
- Option a - PwD answers question 2) positively: Robot asks what PwD has eaten & plays “stop music” to finish the interaction
Option b - PwD answers question 2) negatively: UC02 starts
UC02: The mealtime reminder
- Robot encourages PwD to eat something and suggests the PwD to prepare the food. Consequently, the PwD will walk to the kitchen/food preparation area.
- Robot plays “Food preparation music”.
This way, after a couple interaction sessions, the PwD might link the food preparation music to the idea to go and eat something. - Robots asks PwD to tap the Robot’s head when the food is prepared.
This way, the robot hands over the lead to the PwD to continue the interaction. - PwD prepares the food.
- PwD taps the robot’s head to let the robot know the food is prepared.
This is a que for the robot to go to the next step of the interaction. - Robot now stops playing the “Food preparation music”.
- Robot compliments the food and wish the PwD a pleasant meal.
This is a way to reward the PwD’s job and to once again stress that eating is good for you. - PwD starts eating the food the PwD just prepared.
- Robot starts playing “Eating playlist”.
This change in music is meant to create the association between the music and the eating. After a given amount of time, the next step in the interaction commences: the water check. - Robot asks PwD if he/she is having a drink.
- PwD answers question 10) from robot.
- Option a - PwD answers question 10) positively: Robot compliments PwD for staying healthy and hydrated.
Option b - PwD answers question 10) negatively: Robot encourages PwD to have a drink. - PwD drinks his/her drink.
The completion of step 12) and the drinking of the PwD in step 13) are the ques for the robot to commence with the next step in the interaction: the company check. - Robot asks PwD asks whether he/she has company.
- Option a - PwD answers question 14) positively: Robot compliments PwD.
Option b - PwD answers question 14) negatively: comforts and supports PwD. - Robot salutes PwD and optionally plays “Stop music”.
This way, the PwD is made aware of the fact that the interaction has finished.
Team design pattern I addition: Caregiver as supervisor
Figure 2: Updated Pattern Design
Overview
In the design pattern below, we have updated the previously explained design pattern demonstrates how the caregiver can interfere in the interaction between the robot and the PwD. As the updates are only suggestions, we marked those sections of the design patterns with a dotted line.
Purpose
The purpose of this design pattern is to first show how the caregiver of the PwD could possibly confirm or reject the start of both the UC01 and the UC02. This opportunity could be of use if the caregiver is at home with the PwD and would like to have the mealtime discourse with the PwD his/herself and does not want the robot to have that conversation at that moment.
Secnodly, if UC02 has commenced, another purpose of this updated overview is to show that the caregiver can impact each phase of the UC02 in any step of the interaction of the Robot with the PwD.
One of the advantages of this updated overview, which sees the caregiver as a supervisor of the PwD-Robot interaction, is that the supervisor could also alarm the robot if the PwD is not answering the robot’s questions correctly/truthfully. Also, if the PwD does not know what to answer to the robot’s questions, the supervisor can help the PwD.
Steps Breakdown
UC Preparation
- Robot asks the supervisor if she wants UC01/UC02/neither of the use cases to commence.
- Supervisor answers the robot’s question.
- Supervisor could alternatively answer the robot’s question by tapping the robot’s had.
For instance: tapping the robot’s had could represent the stimulation of the start sign for UC01 or UC02. Not tapping the robot’s had within a couple seconds might be the sign for the robot that the robot can commence UC01 or UC02.
The supervisor
This design addition suggestion does not consist of clearly defined steps, but is just intended to demonstrate that the caregiver, as supervisor, could have the opportunity to impact the mealtime reminder interaction between the robot and the PwD. However, in the interaction design patterns, the interaction between the supervisor, the PwD and the robot will be further explained.
Interactions
In the section below, we will elaborate on the basis of the interactions between the robot and the end-user of the system, the PwD.
Robot gets PwD’s attention
Why: to start both UC01 and consequently UC02, the robot has to get the PwD’s attention, without startling the PwD.
To get the PwD’s attention by the robot, the following types of interaction are used:
• The Robot plays start playing music that suggests that a Use Case is about to commence.
• The Robot greets the PwD.
• The Robot asks the PwD introductory questions to gently start the conversation between the Robot and the PwD like: “How are you doing?”, “How are you feeling?”
The same interaction types can be used in case the Robot aims to finish the interaction with the PwD.
Robot stimulates the PwD to self-reflect
Why: it has been shown that, by stimulating a PwD to reflect on their day, the PwD’s brain is triggered to stay active. This gives the sense for the PwD to be less alone. Furthermore, reflecting on one’s day has proven to be an effective form of memory training. If the self-reflection is effective, in our Use Cases, the PwD might even come to the idea to eat or have a drink him-/herself.
In the end, the information gathered in the self-reflection interactions can be used to determine what’s healthiest for the PwD in terms of feeding him/herself.
To stimulate the PwD to self-reflect, the following can be done by the Robot:
• The Robot asks the PwD questions about his/her day like: “What have you been doing today?”
• The Robot asks the PwD questions, linking specifically to a certain activity, like: “Did you have breakfast?”
• The Robot asks the PwD questions that link to the previously asked question, like: “What did you have for breakfast?”
• The Robot asks the PwD questions to stimulate the PwD to do something, like: “Isn’t it time for you prepare lunch?”
• The Robot plays music to make the PwD reminisce
Context
The self-reflection interaction can be used in the following situations:
• The mealtime discourse: the Robot can check if the PwD has eaten something
• The water check: the Robot can check if the PwD his having a drink
• The company check: the Robot can check if the PwD is having company
Robot calms the PwD
Why: as described in previous sections, many people with dementia might experience negative emotions such as anger and agitation during mealtimes. Therefore, interactions between the Robot and the PwD to calm the PwD are developed.
For the robot to calm the PwD, the Robot can do the following:
• The Robot plays music to the PwD: it has been shown that music can affect a person’s mood.
• The Robot can verbally calm the PwD by saying calming words like: “It’s okay, I am here for you.”
Context
The calming of the PwD can be applied in the following contexts:
• While the PwD is eating the food he/she prepared
• While the PwD is having a drink
• While the PwD is made aware of the fact that the Robot is keeping the PwD company
PwD answers the Robot
Why: To determine the next step in the conversations between the PwD and the Robot, the PwD has to answer the Robot’s questions.
The PwD can answer the Robot’s questions and suggestions in the following ways:
• The PwD answers the Robot’s questions verbally
• The PwD taps the Robot. This can for instance be done after the PwD has finished a certain task or if the PwD would like the music to stop.
• The PwD can do nothing. In this case the interaction will stop after a given amount of time.