Project homeWiki source code of 2. Technical Setup
Last modified by Kris van Melis on 2024/04/09 00:23
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | To enhance the lives of individuals with dementia, we propose a structured methodology of three phases aimed at improving their recall of familial and social connections. | ||
| 2 | |||
| 3 | == Phase 1: Setup Phase == | ||
| 4 | |||
| 5 | === Sub-phase 1a: Information Collection === | ||
| 6 | |||
| 7 | This initial phase involves a detailed survey process, wherein a guardian inputs vital information about the PwDs family members, such as their siblings, partners, children, parents, grandchildren, and close friends into a digital database.This includes key details about their occupations, relationships, and other important life events. All gathered data is then securely encoded and stored in a vector database. | ||
| 8 | |||
| 9 | === Sub-phase 1b: Interactive Knowledge Building === | ||
| 10 | |||
| 11 | The next step involves interactive sessions between the subject and NAO. During these sessions, NAO engages the subject in meaningful conversations to identify and fill any information gaps, enhancing the initial knowledge base. This process is facilitated by speech-to-text technology, ensuring a comprehensive understanding of the individual’s social and familial ties. | ||
| 12 | |||
| 13 | == Phase 2: Accustoming Phase == | ||
| 14 | |||
| 15 | The subsequent phases are focused on utilizing the established knowledge base to strengthen the subject's memory regarding their relationships and family history. In these phases, any query posed by the subject is converted into text and used to search the vector database, which then presents relevant information snippets. Leveraging episodic memory and a large language model, the system constructs coherent, contextually appropriate responses. Through text-to-speech technology, these responses are vocalized, aiding the individual in retrieving memories and fostering a sense of independence and emotional well-being. This approach allows individuals to reconnect with their personal histories and relationships. | ||
| 16 | |||
| 17 | In Phase 2, the knowledge base remains dynamic, allowing for updates and refinements as new gaps in memory are identified. In Phase 3, updates to the knowledge base are restricted and can only be made by the guardian, ensuring the integrity and security of the personal information. | ||
| 18 | |||
| 19 | == Phase 3: Operational Phase == | ||
| 20 | |||
| 21 | Phase 3 is exactly the same as phase 2, however the knowledge base is locked so that the person with dementia cannot accidentally add incorrect information. The guardian still has access to change the knowledge base. | ||
| 22 | |||
| 23 | [[image:1712615032364-803.png]] |