Skip to Content

Social Robot

Version 7.1 by Fedde Jorritsma on 2025/04/22 18:26

Goals:

  • Make sure the elderly feel comfortable when they wake up in the middle of the night

  • Make sure the elderly goes back to sleep

  • Provide assurance

Actions:

  • Have a chat with the elderly (LLM)

    Listen to the elderly (recognise the voice)

  • Play familiar music to the elderly so they feel comfortable and at home

  • Get staff involved when necessary:

     

Emotions:

  • Fear: They may feel disoriented and not know where they are. This can confuse them and they can have trouble distinguishing between day and night. This is a common phenomenon for people with Alzheimer's.

  • Loss of security: The elderly can feel unsafe when they wake up in an unfamiliar environment, such as a hospital when they don't remember where they are.

  • Sadness and loneliness: They can feel lonely without their loved ones nearby, this can lead to feelings of sadness or loneliness.

  • Restlessness: Some people with Alzheimer's may experience feelings of restlessness or agitation, especially if they wake up suddenly and feel confused or lost.

  • Fear of the unknown: People with Alzheimer's may not understand why they woke up in the middle of the night, making them feel anxious about the situation, especially if they have no sense of time.

Beliefs:

  • The elderly’s state of mind

Percepts

  • The overal posture of the elderly (Vision language model)

  • Facial expression (Vision Language Model)

    The voice of the elderly (Speech regnition model)

  • Heart rate (bracelet)

  • sleep (bracelet)

Technology

The technology that is planned on being used consists of several parts. Firstly, the PwD are equipped with bracelets that provide information about their sleep cycle during sleep. The acquired information is then processed by the Navel Robot which then predicts which patients are restless or awake. When restless patients are recognized, Navel is sent to the location and is assigned with calming down and sending back to bed the patients or alerting the staff. Patients are recognized using voice and facial recognition and expressions are also checked. A LLM is used to communicate with the patients.