Skip to Content

Changes for page c. Technology

Last modified by William OGrady on 2024/03/25 20:12
From version 4.1
edited by Kris van Melis
on 2024/02/29 18:34
Change comment: There is no comment for this version
To version 6.1
edited by Kris van Melis
on 2024/02/29 18:47
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,9 +1,24 @@
1 -To aid individuals with dementia in recalling their familial and social connections, we propose a two-phase methodology.
1 +To enhance the lives of individuals with dementia, we propose a structured two-phase methodology aimed at improving their recall of familial and social connections.
2 2  
3 -**Phase 1: Establishing knowledge base**
4 -In the initial phase, we aim to construct a comprehensive knowledge base through interactive sessions between a robot and a person with early-stage dementia. During these sessions, the robot will engage the individual in a conversation to gather essential information. This information is about their family, including children, partners, and close friends, as well as pertinent details regarding their occupations, relationships, and other significant aspects of their lives. Utilizing speech-to-text technology, all collected information will be encoded and stored in a vector database, forming a personalized and accessible repository of their personal connections and experiences.
5 5  
6 -**Phase 2: Memory retention support**
7 -The second phase focuses on leveraging the established knowledge base to reinforce the individual's memory concerning their relationships and family. When the person poses a question, it is converted into text and utilized as a search query within the vector database. This database then retrieves all relevant information snippets, which a large language model processes to construct a coherent and contextually appropriate response. Through text-to-speech technology, this response is vocalized, providing the individual with the information they sought. This system not only aids in memory retention but also fosters a sense of independence and emotional well-being by enabling individuals to reconnect with their personal histories and relationships.
4 +**Phase 1: Setup Phase**
8 8  
9 -[[image:1709228070128-463.png]]
6 +//Sub-phase 1a: Information Collection//
7 +
8 +This initial phase involves a detailed survey process, wherein a guardian inputs vital information about the individual's family members, such as children, partners, and close friends, into a digital encyclopedia. This includes key details about their occupations, relationships, and other important life events. All gathered data is then securely encoded and stored in a vector database, creating a personalized, easily accessible repository of the individual's personal connections and experiences.
9 +
10 +
11 +**//Sub-phase 1b: Interactive Knowledge Building//**
12 +
13 +The next step involves interactive sessions between the subject and Nao. During these sessions, Nao engages the subject in meaningful conversations to identify and fill any information gaps, enhancing the initial knowledge base. This process is facilitated by speech-to-text technology, ensuring a comprehensive understanding of the individual’s social and familial ties.
14 +
15 +
16 +**Phase 2: Accustoming Phase and Phase 3: Operational Phase**
17 +
18 +The subsequent phases are focused on utilizing the established knowledge base to strengthen the subject's memory regarding their relationships and family history. In these phases, any query posed by the subject is converted into text and used to search the vector database, which then presents relevant information snippets. Leveraging episodic memory and a large language model, the system constructs coherent, contextually appropriate responses. Through text-to-speech technology, these responses are vocalized, aiding the individual in retrieving memories and fostering a sense of independence and emotional well-being. This approach allows individuals to reconnect with their personal histories and relationships.
19 +
20 +
21 +In Phase 2, the knowledge base remains dynamic, allowing for updates and refinements as new gaps in memory are identified. In Phase 3, updates to the knowledge base are restricted and can only be made by the guardian, ensuring the integrity and security of the personal information.
22 +
23 +
24 +[[image:1709228599585-121.png]]
1709228599585-121.png
Author
... ... @@ -1,0 +1,1 @@
1 +xwiki:XWiki.KrisVanMelis
Size
... ... @@ -1,0 +1,1 @@
1 +117.1 KB
Content