Prototype

Flow chart of the interaction between Pwd and prototype

Future Improvements

Our prototype still has some room for improvement.

• Create a separate conversation path for promoting Pwd to drink instead of incorporating very brief conversations that prompt Pwds to drink water in
    meal discourse. Enrich the dialogue of promoting drinking water and enrich the corresponding expressions and postures of our prototype, Elevate this
    conversation to a level as important as meal discourse.

• Our current prototype only could automatically react to answers with specific keywords which are easy to be recognized, such as "Yes", "No",
    and"Great", and we use remotely manually control for open questions, like "How did you feel?", "How are you today?" and "What have you eaten
    today?". We would like to make some improvements to the prototype, in order to let it automatically recognize more content in Pwd utterances.

• Improving the speech quality of our prototype, making it more clear and easy to understand for the PwD. By doing this, We would slow down the
    speed some parts of the prototype utterances and improve the pronunciation quality of our prototype.

• Let the robot have a certain reasoning ability so that it can infer whether the Pwd has eaten, drank water, and had specific emotions, in case if
    Pwd forgot they had eaten and drank, or couldn't express their emotion well. By doing this, we hope to come up with more rich forms of interactions
    between our prototype and Pwd to gather more information from Pwds and give robots enough data to reason about.

Implemented Interactions

The interaction described above consists of smaller different interactions which are presented below:

Greeting discourse
- Nao: slow start chill music
- Nao: "Hi, how are you today? " (with greeting gesture, arms wave)
  (If Pwd feels good today)
- Nao: "Great! I also have a good time."
  (If Pwd doesn't feel good today.)
- Nao: "What was going on?"
- Nao: Attract Pwd's attention, and play a dance to make the Pwd happy.

Meal discourse if Pwd has already eaten
- Nao: Have you already eaten?
- Pwd: Yes
 (Nao will make some casual conversation.)
- Nao: That's great, What did you have?  
- Nao: "Did you enjoy it?"
- Nao: "Did someone join you?"
 At the end of the casual conversation,
- Nao: "Let's relax for a while. Tap me on the head when you want to stop the music."
- Nao will sit as it takes a rest.
- And playing a piece of music until the Pwd tap'Nao's head to stop the music.
- (When the music stops, Nao will make conversation as follow)
- Nao will stand up.
- Nao: "What else did you do today."
- Nao: "Sounds good."
- Nao: "See you later."

Meal discourse if Pwd hasn't eaten
- Nao: "That's ok, are you feeling hungry? "
- Nao will touch its head to react as it wants to know whether the Pwd has eaten or not.
  (if Pwd feels hungry)  
- Pwd: "Yes"
- Nao: "You should probably eat something."
- Nao: "There are snacks/foods for you"
- Nao: "Is someone joining you?"
  (If there is someone joining the meal with Pwd)
   Nao: "Oh, That's nice. I am happy that someone is joining you."
  (If there is no one joining the mean with Pwd)
   Nao: "I am here to keep you company."
- Nao: "Bon apetite."
- Nao: "Let's play some music!"
- Nao: "Tap me on the head when you want to stop the music."
- Nao will sit as it takes a rest.
  (when the music stop)
- Nao will stand up.
- goto -> Stay hydrated discourse 1 

  (If Pwd doesn't feel hungry)
- goto ->  Stay hydrated discourse 2
- (When the music stops, Nao will make conversation as follow)
- Nao: "What else did you do today."
- Nao: "Sounds good."
- Nao: "See you later."

Stay hydrated 1
- Nao: "Are you having a drink also?"
  (If Pwd has had a drink.)
- Pwd: "Yes"
- Nao will respond with a proud emotion.
  (If Pwd hasn't had a drink.)
- Nao: "Wouldn't a glass of water goes well with this."
- Nao: "Let's get a glass of water."
- Nao: "Cheers."

Stay hydrated 2
- Nao: "Would you want to have a drink?"
  (If Pwd want to have a drink)
- Pwd: "Yes."
- Nao will respond with proud emotion.
- Nao: "What drink would you like?"
- Nao: "That's sounds good."
- Nao will respond with happy emotion.
  (If Pwd doesn't want to have a drink)
- Pwd: "No."
- Nao: "Ok, but remember to get a drink at some point."

Remark: our Robot Nao will have different gestures and emotions regarding Pwd's response, which for having better empathy with Pwd.