Wiki source code of Prototype
Last modified by Sofia Kostakonti on 2022/04/05 16:55
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | == Flow chart of the interaction between Pwd and prototype == | ||
| 2 | |||
| 3 | |||
| 4 | [[image:flow_chart.png]] | ||
| 5 | |||
| 6 | == Future Improvements == | ||
| 7 | |||
| 8 | Our prototype still has some room for improvement. | ||
| 9 | |||
| 10 | * Create a separate conversation path for promoting Pwd to drink instead of incorporating very brief conversations that prompt Pwds to drink water in | ||
| 11 | meal discourse. Enrich the dialogue of promoting drinking water and enrich the corresponding expressions and postures of our prototype, Elevate this | ||
| 12 | conversation to a level as important as meal discourse. | ||
| 13 | |||
| 14 | * Our current prototype only could automatically react to answers with specific keywords which are easy to be recognized, such as "Yes", "No", | ||
| 15 | and"Great", and we use remotely manually control for open questions, like "How did you feel?", "How are you today?" and "What have you eaten | ||
| 16 | today?". We would like to make some improvements to the prototype, in order to let it automatically recognize more content in Pwd utterances. | ||
| 17 | |||
| 18 | * Improving the speech quality of our prototype, making it more clear and easy to understand for the PwD. By doing this, We would slow down the | ||
| 19 | speed some parts of the prototype utterances and improve the pronunciation quality of our prototype. | ||
| 20 | |||
| 21 | * Let the robot have a certain reasoning ability so that it can infer whether the Pwd has eaten, drank water, and had specific emotions, in case if | ||
| 22 | Pwd forgot they had eaten and drank, or couldn't express their emotion well. By doing this, we hope to come up with more rich forms of interactions | ||
| 23 | between our prototype and Pwd to gather more information from Pwds and give robots enough data to reason about. | ||
| 24 | |||
| 25 | == Implemented Interactions == | ||
| 26 | |||
| 27 | The interaction described above consists of smaller different interactions which are presented below: | ||
| 28 | |||
| 29 | **Greeting discourse** | ||
| 30 | - Nao: slow start chill music | ||
| 31 | - Nao: "Hi, how are you today? " (with greeting gesture, arms wave) | ||
| 32 | (If Pwd feels good today) | ||
| 33 | - Nao: "Great! I also have a good time." | ||
| 34 | (If Pwd doesn't feel good today.) | ||
| 35 | - Nao: "What was going on?" | ||
| 36 | - Nao: Attract Pwd's attention, and play a dance to make the Pwd happy. | ||
| 37 | |||
| 38 | **Meal discourse if Pwd has already eaten** | ||
| 39 | - Nao: Have you already eaten? | ||
| 40 | - Pwd: Yes | ||
| 41 | (Nao will make some casual conversation.) | ||
| 42 | - Nao: That's great, What did you have? | ||
| 43 | - Nao: "Did you enjoy it?" | ||
| 44 | - Nao: "Did someone join you?" | ||
| 45 | At the end of the casual conversation, | ||
| 46 | - Nao: "Let's relax for a while. Tap me on the head when you want to stop the music." | ||
| 47 | - Nao will sit as it takes a rest. | ||
| 48 | - And playing a piece of music until the Pwd tap'Nao's head to stop the music. | ||
| 49 | - (When the music stops, Nao will make conversation as follow) | ||
| 50 | - Nao will stand up. | ||
| 51 | - Nao: "What else did you do today." | ||
| 52 | - Nao: "Sounds good." | ||
| 53 | - Nao: "See you later." | ||
| 54 | |||
| 55 | **Meal discourse if Pwd hasn't eaten** | ||
| 56 | - Nao: "That's ok, are you feeling hungry? " | ||
| 57 | - Nao will touch its head to react as it wants to know whether the Pwd has eaten or not. | ||
| 58 | (if Pwd feels hungry) | ||
| 59 | - Pwd: "Yes" | ||
| 60 | - Nao: "You should probably eat something." | ||
| 61 | - Nao: "There are snacks/foods for you" | ||
| 62 | - Nao: "Is someone joining you?" | ||
| 63 | (If there is someone joining the meal with Pwd) | ||
| 64 | Nao: "Oh, That's nice. I am happy that someone is joining you." | ||
| 65 | (If there is no one joining the mean with Pwd) | ||
| 66 | Nao: "I am here to keep you company." | ||
| 67 | - Nao: "Bon apetite." | ||
| 68 | - Nao: "Let's play some music!" | ||
| 69 | - Nao: "Tap me on the head when you want to stop the music." | ||
| 70 | - Nao will sit as it takes a rest. | ||
| 71 | (when the music stop) | ||
| 72 | - Nao will stand up. | ||
| 73 | - goto -> Stay hydrated discourse 1 | ||
| 74 | |||
| 75 | (If Pwd doesn't feel hungry) | ||
| 76 | - goto -> Stay hydrated discourse 2 | ||
| 77 | - (When the music stops, Nao will make conversation as follow) | ||
| 78 | - Nao: "What else did you do today." | ||
| 79 | - Nao: "Sounds good." | ||
| 80 | - Nao: "See you later." | ||
| 81 | |||
| 82 | |||
| 83 | **Stay hydrated 1** | ||
| 84 | - Nao: "Are you having a drink also?" | ||
| 85 | (If Pwd has had a drink.) | ||
| 86 | - Pwd: "Yes" | ||
| 87 | - Nao will respond with a proud emotion. | ||
| 88 | (If Pwd hasn't had a drink.) | ||
| 89 | - Nao: "Wouldn't a glass of water goes well with this." | ||
| 90 | - Nao: "Let's get a glass of water." | ||
| 91 | - Nao: "Cheers." | ||
| 92 | |||
| 93 | |||
| 94 | |||
| 95 | **Stay hydrated 2** | ||
| 96 | - Nao: "Would you want to have a drink?" | ||
| 97 | (If Pwd want to have a drink) | ||
| 98 | - Pwd: "Yes." | ||
| 99 | - Nao will respond with proud emotion. | ||
| 100 | - Nao: "What drink would you like?" | ||
| 101 | - Nao: "That's sounds good." | ||
| 102 | - Nao will respond with happy emotion. | ||
| 103 | (If Pwd doesn't want to have a drink) | ||
| 104 | - Pwd: "No." | ||
| 105 | - Nao: "Ok, but remember to get a drink at some point." | ||
| 106 | |||
| 107 | Remark: our Robot Nao will have different gestures and emotions regarding Pwd's response, which for having better empathy with Pwd. |