Skip to Content

Changes for page b. Test

Last modified by Jean-Paul Smit on 2024/04/09 15:23
From version 1.1
edited by Ruud de Jong
on 2024/02/12 12:34
Change comment: Imported from XAR
To version 11.1
edited by Jean-Paul Smit
on 2024/03/26 12:29
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -b. Test
1 +c. Test
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.RuuddeJong
1 +xwiki:XWiki.jeanpaulsmit
Content
... ... @@ -1,33 +1,71 @@
1 -= 1. Introduction =
1 +=== 1. Introduction ===
2 2  
3 -<include a short summary of the claims to be tested, i.e., the effects of the functions in a specfic use case>
3 +This study aims to evaluate the effectiveness of the Nao robot in aiding memory retrieval through the use of a between-subjects design with a test group and a control group. We will simulate conditions of early-stage dementia in student participants to test whether interactions with Nao enhance the retrieval of memories fabricated created by us, mimicking lost memories typical of individuals with dementia.
4 4  
5 +Recall the image from the [[3. Evaluation Methods>>Main.b\. Human Factors.Measuring Instruments.WebHome]] in the [[1. Foundation>>Main.WebHome]] as in the figure below. The first two concepts, that of Autonomy and Relatedness and the memory self-efficacy, will be tested by using validated surveys. The memory recall will be tested by a custom survey that was catered to be used with the robot in the domain of interest, that is of using the NAO as an encyclopedia for recalling familiar people.
5 5  
6 -= 2. Method =
7 +[[image:Main.b\. Human Factors.Measuring Instruments.WebHome@Socio-Cognitive Engineering - Frame 1(4).jpg||height="421" width="735"]]
7 7  
8 8  
9 -== 2.1 Participants ==
10 +=== 2. Method ===
10 10  
12 +==== 2.1 Participants ====
11 11  
12 -== 2.2 Experimental design ==
14 +As actual PwDs are not available for this research, the participants will consist of several student volunteers. These will be divided into two groups: those using the Nao robot for memory retrieval (the test group) and those using text-based prompts (the control group).
13 13  
14 14  
15 -== 2.3 Tasks ==
17 +==== 2.2 Materials ====
16 16  
19 +Materials for the test group include the NAO robot, an OpenAI chatbot running on a mobile phone, and a laptop to control the human-like movements of NAO, as described in the [[prototype>>doc:3\. Evaluation.a\. Prototype.WebHome]]. The control group requires written out text prompts instead.
20 +Both groups require a set of fabricated memories, memory quizzes, writing materials, and evaluation forms for feedback. ** **
17 17  
18 -== 2.4 Measures ==
19 19  
23 +==== 2.3 Measures ====
20 20  
21 -== 2.5 Procedure ==
25 +Memory retrieval success will be measured using a quiz based on the fabricated memories. Participant feedback and observational notes will also be collected to assess the user experience and interaction effectiveness.
26 +We will evaluate the recall and memory-efficacy of both groups and try to relate the given answers to values **(link to evaluation in foundation) **such as autonomy and relatedness.
22 22  
28 +**TODO: More info here once we have the actual evaluation forms (knowledge quiz + emotional questionnaire)**
23 23  
24 -== 2.6 Material ==
25 25  
31 +==== 2.4 Procedure ====
26 26  
27 -= 3. Results =
33 +Participants will receive an overview of their role as a PwD and undergo a session with either Nao or text prompts to retrieve memories. Following the session, they will complete the memory quiz. Feedback will be gathered post-interaction.
28 28  
35 +//**Phase 1: Preparation**//
29 29  
30 -= 4. Discussion =
37 +1. **NAO Robot Setup**: Confirm that Nao is fully operational and our team is equipped to facilitate the interactions by doing a pre-test/trial run with our prototype.
38 +1. **Recruitment and Consent**: Recruit a diverse group of student volunteers, ensuring informed consent for participation.
39 +1. **Training**: Brief participants on their roles and the concept of simulated memory loss without revealing specific details of the fabricated memories.
31 31  
41 +//**Phase 2: Baseline Assessment**//
32 32  
33 -= 5. Conclusions =
43 +1. **Pre-test**: Optionally, assess the students’ ability to recall general information unrelated to the fabricated memories to establish a baseline.
44 +1. **Documentation**: Record responses to analyze as a baseline for later comparison.
45 +
46 +//**Phase 3: Memory Recall**//
47 +
48 +1. **Introduction**: Introduce participants in the test group to the NAO robot, explaining its purpose, and provide the control group with their first text-based memory prompt.
49 +1. **Simulation**: Conduct sessions where the test group interacts with Nao aiming to recall a set of fabricated memories.
50 +1. **Analog control group simulation: **Conduct sessions with an analog encyclopedia with equally complex information on relatives.
51 +1. **Memory Quiz**: Following each session, provide a written quiz to both groups based on the memories they were asked to retrieve.
52 +1. **Documentation**: Collect the completed quizzes, which will serve as the primary documentation of memory retrieval.
53 +
54 +//**Phase 4: Evaluation**//
55 +
56 +1. **Scoring**: Assess the memory quizzes from both groups to evaluate the quantity and accuracy of retrieved memories.
57 +1. **Analysis**: Compare the effectiveness of memory retrieval between the NAO-assisted group and the text-prompt group.
58 +1. **Participant Feedback**: Gather feedback from all participants regarding their experience with the memory retrieval process through a questionnaire.
59 +1. **Observer Notes**: Collect observations from staff regarding the interaction between participants and the Nao robot or text prompts.
60 +
61 +//**Phase 5: Feedback and Improvement**//
62 +
63 +1. **Participant Reflections**: Review participant feedback for insights into the memory retrieval process and suggestions for improvement.
64 +1. **Staff and Observer Insights**: Analyze observations from staff and observers for additional perspectives on the effectiveness and emotional impact of the interactions.
65 +1. **Improvement Strategies**: Based on the feedback and results, develop a plan to enhance the memory retrieval capabilities of the Nao robot and the overall test design.
66 +
67 +== //**Ethical Considerations**// ==
68 +
69 +We commit to high ethical standards, respecting the sensitive nature of simulating dementia conditions, and ensuring the well-being and dignity of all participants throughout the study. To ensure this we present a form containing the ethical considerations to each participant. **TODO: put in link to ethics form?**
70 +
71 +