Storyboard
We thought of 2 different storyboards that we believe nicely show the intended use cases of the system. They show the different paths the system can take in interaction and illustrate what the system can be expected to do in similar situations. They are shown and described in detail below.
Scene 1
|
The first situation we considered is the case where a person with dementia is under the impression that they are in a different period in their life and will not be convinced otherwise by the system. In the first frame, we can see the person with dementia (Gretchen) tell the robot (Pepper) that she is on her way to a lecture - which Pepper knows is not the case, as she retired before being admitted to the care home. In the second frame, Pepper attempts to convince Gretchen to stay with an argument applicable to her perceived situation. It also suggests an alternative that can be performed inside the care home, in this case solving a puzzle. Pepper would also softly start playing calm music at this point to try to get Gretchen back to reality and make her realise by herself that she is retired. However, Gretchen responds negatively to these stimuli, stating that Pepper should leave her alone and let her go about her day. Pepper in turn responds to this by trying to calm Gretchen. It does so by playing calming music associated with an activity, and explicitly suggesting that Gretchen takes part in the activity, as displayed in frame 3. Gretchen still responds negatively to this and even becomes noticeably agitated. After this, in frame 4, Pepper recognises its intervention is not improving the situation, and it decides to ask the caretaker to help. The caretaker arrives in frame 5 and successfully takes Gretchen back to a different room.
|
Scene 2
|
The second situation considered is the one where the person with dementia is aware of their current situation but confused in a different way. As can be seen in the first frame of the image, the person with dementia (Robert) walks up to the robot (Pepper) convinced that it is evening and he will shortly be picked up by his family. This is, however, not the case, as it is early in the afternoon. In the second frame, Pepper decides the easiest way to convince Robert is to bring him back to reality by telling him it is not evening yet. Robert appears to be convinced but still needs an additional push, which pepper provides in the third frame. It tells Robert that it is lunchtime, and accompanies this with auditory and visual signals Robert associates with lunch. As a result, Robert walks to the kitchen where a caretaker prepares lunch for him (not shown).
|
TDP
Problem | The caretaker of a person with dementia (PwD) might not always be around to prevent a user from going out wandering and to locate them and bring them back if they do. To still be able to provide safe environments for all PwDs, a humanoid robot will try to take care of such situations. This will relieve the caretakers from a number of these burdens. There might, however, be cases where the robot cannot do enough, and thus needs to alert a caretaker that can interfere. |
Solution structure |  |
Solution description | In the event that a PwD wants to leave the building, the robot will interact with them. The goal of this interaction is to convince the PwD to stay inside. This can be done by asking certain questions to identify the intentions and mental state of the PwD, and responding with certain arguments or alternatives. If this is unsuccessful and the PwD goes out nonetheless, the robot will alert a caretaker of this event, transitioning from Scene A to Scene B. The caretaker will respond to this as soon as possible to prevent the PwD from going too far or getting into too many dangerous situations. The caretaker will go after the PwD, track them down and bring them back inside safely, after which the setting returns to Scene A. |
Human RQ | The caretaker needs to be available to respond in a relatively small amount of time and needs to be able to track down the PwD faster than they can wander. |
Robot RQ | The robot needs to be able to signal the caretaker to take over at the right time (RQ007), and initiate the design pattern once the PwD nears the door (RQ001/RQ002). Other aspects are covered by the other design patterns which can be seen as concrete examples of Scene A. |
IDP1
Problem | Sometimes, a person with dementia (PwD) might want to go out for a very trivial reason - for example, they might want to go to a doctor's appointment, do groceries or have coffee with the neighbours. In such cases, a rather simple counterargument might be more than enough to have these people stay inside. Alternatively, a different activity might be a reason for them to stay in as well. In such situations, the robot should be able to provide these counterarguments or activities. |
Solution structure |  |
Solution description | Once the PwD tries to leave the building, the robot will ask what the PwD is planning on doing. This response will most likely be of the form presented in the upper arrow, stating that they will be doing some activity. Based on the nature of the activity, the robot will try to find an appropriate response. For example, in the case of a non-existent appointment, the robot will tell the user this appointment is on some other day, errands will be said to be covered by others, and people that are unwise to visit will be said to be on vacation or at work. In addition, and as a fallback in cases where no more appropriate response can be found, the robot will think of an alternative to the activity to occupy the PwD and tell the PwD they will miss this activity if they leave now. The robot will also play some music that the PwD associates with the activity so that the PwD is convinced to stay inside. These arguments should, at least in some cases, be enough to keep the person in. |
Human RQ | The PwD needs to be able to state their intent and listen to what the robot has to say. |
Robot RQ | The robot should be able to comprehend what the PwD is saying in order to respond appropriately and give them good reasons on why they must not go out (RQ004, RQ005). It should also be able to speak in a human-like way so that the PwD listen to it (RQ003). The PwD should be able to play some music that is associated with the activity (RQ006). |
IDP2
Problem | Sometimes, a person with dementia (PwD) might want to go out for a very trivial reason - for example, they might want to go to a doctor's appointment, do groceries or have coffee with the neighbours. A robot would say some simple counterarguments to persuade them to stay inside, but in some cases, the PwD insists on going out and becoming agitated, then the robot will play music to make the PwD calm down, if this still doesn't work and they still have to go out, then the robot will call the caretaker immediately. |
Solution structure |  |
Solution description | If the PwD still wants to go out and becomes agitated, after the robot provides some counterarguments, then the robot will play some specific agitation-relieving music to make the PwD calm down. If it works, then the PwD keeps staying inside. |
Human RQ | The PwD needs to be able to state their intent and listen to what the robot has to say. |
Robot RQ | The robot should be able to play some specific agitation-relieving music (RQ006). It should also be able to respond to the PwD and understand what he/she is saying (RQ004). |
IDP3
Problem | Sometimes, a person with dementia (PwD) might want to go out for a very trivial reason - for example, they might want to go to a doctor's appointment, do groceries or have coffee with the neighbours. A robot would say some simple counterarguments to persuade them to stay inside, but in some cases, the PwD leaves the room directly without talking to the Robot or ignoring the counterarguments provided by the robot, then the robot will call the caretaker immediately. |
Solution structure |  |
Solution description | When the PwD ignores the robot's counterarguments and walks out of the room, or doesn't talk to the robot at all and walks out of the room directly, then the robot will call the caretaker. |
Human RQ | The PwD needs to be able to state their intent |
Robot RQ | The robot should be able to understand the PwD and try and engage in a conversation with them (RQ004). The robot should also be able to call the caretaker (RQ007) |
IDP4
Problem | There may be moments when a person with dementia (PwD) wants to simply take a walk to get some fresh air. This is not convenient to do alone, but can easily be done under the supervision of a caretaker. |
Solution structure |  |
Solution description | When the user requests to take a walk, a caretaker is notified to accompany them |
Human RQ | The PwD needs to be able to request to take a walk |
Robot RQ | The robot should be able to understand the PwD (RQ004). The robot should also be able to call the caretaker (RQ007) |