Skip to Content

Changes for page Social Robot

Last modified by Fedde Jorritsma on 2025/04/25 10:23
From version 16.1
edited by Fedde Jorritsma
on 2025/04/25 10:23
Change comment: There is no comment for this version
To version 7.1
edited by Fedde Jorritsma
on 2025/04/22 18:26
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,16 +1,5 @@
1 -Initially, we wanted to use Navel as a robot to take care of different patients in the middle of the night. After the first presentation, we realized that the project we had planned to do was too broad. Therefore, the idea of the project was changed from one robot that can help different PWD in the middle of the night to each elderly person having their own robot. The robot can sit next to the elderly while they are sleeping, and a robot that can move around is not needed. We also thought that NAO has a friendlier look, while Navel could look scary in the middle of the night, as can be seen in Figure 1. Even though Navel is a more advanced robot, NAO still has all the necessary features to communicate with PWD and comfort them.
1 +(% style="line-height:100%" %)Goals:
2 2  
3 -NAO features multiple sensors such as a camera, microphones, and touch sensors. Besides that, it has articulated limbs for expressive movement and a speaker that can be used to communicate. The goals that NAO aims to solve through its actions are listed below, together with what NAO can perceive to understand the elderly's emotions.
4 -
5 -
6 -
7 -[[image:1745495934548-244.png||height="378" width="354"]]
8 -
9 -//Figure 1: Nao, Navel and Pepper//
10 -
11 -
12 -(% style="line-height:100%" %)**Goals:**
13 -
14 14  * (((
15 15  (% style="line-height:100%" %)Make sure the elderly feel comfortable when they wake up in the middle of the night
16 16  )))
... ... @@ -21,26 +21,23 @@
21 21  (% style="line-height:100%" %)Provide assurance
22 22  )))
23 23  
24 -(% style="line-height:100%" %)**Actions:**
13 +(% style="line-height:100%" %)Actions:
25 25  
26 26  * (((
27 -(% style="line-height:100%" %)Have a chat with the elderly
16 +(% style="line-height:100%" %)Have a chat with the elderly (LLM)
17 +
18 +(% style="line-height:100%" %)Listen to the elderly (recognise the voice)
28 28  )))
29 29  * (((
30 -(% style="line-height:100%" %)Listen to the elderly
31 -)))
32 -* (((
33 33  (% style="line-height:100%" %)Play familiar music to the elderly so they feel comfortable and at home
34 34  )))
35 -
36 36  * (((
37 37  (% style="line-height:100%" %)Get staff involved when necessary:
38 38  
39 -
40 40  
41 41  )))
42 42  
43 -(% style="line-height:100%" %)**Emotions:**
29 +(% style="line-height:100%" %)Emotions:
44 44  
45 45  * (((
46 46  **Fear**: They may feel disoriented and not know where they are. This can confuse them and they can have trouble distinguishing between day and night. This is a common phenomenon for people with Alzheimer's.
... ... @@ -61,24 +61,23 @@
61 61  **Fear of the unknown**: People with Alzheimer's may not understand why they woke up in the middle of the night, making them feel anxious about the situation, especially if they have no sense of time.
62 62  )))
63 63  
64 -(% style="line-height:100%" %)**Beliefs:**
50 +(% style="line-height:100%" %)Beliefs:
65 65  
66 66  * (((
67 67  (% style="line-height:100%" %)The elderly’s state of mind
68 68  )))
69 69  
70 -(% style="line-height:100%" %)**Percepts**
56 +(% style="line-height:100%" %)Percepts
71 71  
72 72  * (((
73 -(% style="line-height:100%" %)The overal posture of the elderly
59 +(% style="line-height:100%" %)The overal posture of the elderly (Vision language model)
74 74  )))
75 75  * (((
76 -(% style="line-height:100%" %)Facial expression
62 +(% style="line-height:100%" %)Facial expression (Vision Language Model)
63 +
64 +The voice of the elderly (Speech regnition model)
77 77  )))
78 78  * (((
79 -The voice of the elderly
80 -)))
81 -* (((
82 82  (% style="line-height:100%" %)Heart rate (bracelet)
83 83  )))
84 84  * (((
... ... @@ -85,8 +85,6 @@
85 85  (% style="line-height:100%" %)sleep (bracelet)
86 86  )))
87 87  
88 -(((
89 -
90 -)))
73 +**Technology**
91 91  
92 -
75 +The technology that is planned on being used consists of several parts. Firstly, the PwD are equipped with bracelets that provide information about their sleep cycle during sleep. The acquired information is then processed by the Navel Robot which then predicts which patients are restless or awake. When restless patients are recognized, Navel is sent to the location and is assigned with calming down and sending back to bed the patients or alerting the staff. Patients are recognized using voice and facial recognition and expressions are also checked. A LLM is used to communicate with the patients. 
1745495934548-244.png
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.fjorritsma
Size
... ... @@ -1,1 +1,0 @@
1 -621.7 KB
Content