Skip to Content

Team Design Patterns

Last modified by Varun Singh on 2023/04/05 19:05

TDP: Human-Robot Painting Management

1680714329204-155.png

1678811636369-126.png

Overview
The human-robot painting management design pattern depicts the flow of interactions between Pepper and the PwD with respect to the flow of the interaction that has been entered into Pepper's system. We describe two scenarios in which painting management could possibly happen in a care home. First, we consider a scenario where only one PwD has to be assisted in the painting activity, we detail the flow of the scenario and the interactions by linking it with our use cases. However, in most cases, the pepper robot would be used to assist a lot of PwDs with painting and it would be infeasible to have an individual robot for each. So we also consider the scenario with multiple PwDs and detail how the interaction then would take place. Below we describe the TDP in further detail.


Purpose
The purpose of this TDP is to demonstrate the flow of painting interaction firstly for an individual patient and then how it can be extended for a group of PwD. Often times it becomes challenging for patients with dementia to do tasks that require dedicated focus and attention since they are prone to get distracted easily. With many PwD as a group, it is not easy for the caregiver to make sure every patient is doing well and whether they require some attention or not. Specifically, in this case, Pepper will be able to help the caregiver by handling the painting activity during the break time such as asking patients whether they would like to paint and helping them with tips and suggestions.  We see assisting the PwD with such activity as a meaningful addition to their daily life. The aim is to have Pepper guide the PwD through the steps of the painting activity and pay attention to the PwD throughout the whole process to analyze whether everything went smoothly.

Painting Management
Although each of the IDPs contained in this TDP is described in great detail in the Interactive Design Patterns section, below is a short overview of it divided into Scene A and Scene B: 

1. Scene A: Active with 1 PwD

  • As a prerequisite, we assume the painting apparatus has been set up by the caretaker.
  • Reminder: Pepper then reminds and asks the PwD during their break time whether they would like to paint today.
  • Recommend: If the PwD agrees to paint, Pepper then recommends a picture which could be related to the patient's past life.
  • Assist: Pepper then assists the PwD during painting by providing helpful suggestions and tips.
  • Save: Once the painting is done, Pepper takes a screenshot of the painting, saves it to a database and sends it to the PwD's family members.

2. Scene B: Active with Scene multiple PwD

  • Approach a PwD and start the scenario in Scene A till the first interval is encountered. This signals that Pepper should then move to another PwD and start the process anew from there.
  • We need Pepper to move around between the execution of Scene A because now there are multiple PwD's to be looked after, and it wouldn't be practical to wait for one complete interaction to happen and then move to another patient.
  • Pepper will keep a track of the progress of all the patients so that when it approaches another patient it knows what stage they are at and is able to accurately assist them at that point.
  • This process will be looped until the painting activity ends or all patients have finished with their painting.

Due to time constraints, we will not be able to implement Scene B, instead, we will focus fully on Scene A.