Skip to Content

Changes for page b. Test

Last modified by Jean-Paul Smit on 2024/04/09 15:23
From version 30.1
edited by Pravesha Ramsundersingh
on 2024/04/08 11:02
Change comment: There is no comment for this version
To version 24.1
edited by Jean-Paul Smit
on 2024/04/07 00:10
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.PraveshaRamsundersingh
1 +xwiki:XWiki.jeanpaulsmit
Content
... ... @@ -67,18 +67,12 @@
67 67  
68 68  Twenty University students participated in the controlled experiment (M= 45%, F=55%). After gaining consent through the consent form, all participants were briefed to act as if experiencing the interaction from the viewpoint of a PwD. From the sample, half were asked to interact with the NAO and half were only using a voice-based version of the encyclopedia prototype.
69 69  
70 -The main finding of the experiment is on Relatedness as can be seen in Table 1: the increase of affect in both Arousal and Valence dimensions during the experiment with the test group was higher than the experiment with the control group. The control group mean values in arousal and valence show no significant change at all.
70 +The main finding of the experiment can be seen in Table 1: the increase of affect in both Arousal and Valence dimensions during the experiment with the test group was higher than the experiment with the control group. The control group mean values in arousal and valence show no significant change at all.
71 71  
72 72  
73 73  [[Figure 3: Pie chart showing the gender distribution of our sample. ~| Figure 4: Boxplot chart showing the familiarity with robots and the attitude towards technology.>>image:gender & familiarity.png]]
74 74  
75 75  
76 -
77 -Competence. No significant effect on using the NAO (p > 0.05)
78 -
79 -Covariates. had no significant influence on recall score (p > 0.05)
80 -
81 -
82 82  For other analyses, most resulting p values had an alpha above 0.05 and thus were not significant enough.
83 83  
84 84  [[Table 1: showing the Affect variables>>image:Table of means.png||height="214" width="737"]]
... ... @@ -85,9 +85,6 @@
85 85  
86 86  === 4. Discussion ===
87 87  
88 -The NAO may positively affects participant’ s affective state. Yet the other results were not significant enough to make a valid decision about. There are a few possible reasons why that is that will be elaborated upon in this section.
89 -
90 -
91 91  **Sample Group and Size impact validity of the study**
92 92  
93 93  The ecological validity of the study is impacted by the fact that there were no PwD in our sample. The scope of the experiment was limited to TU Delft University students. That means that future research may benefit from a closer approach to an experiment which is closer to the experience of PwD. Moreover, the controlled experiment was restricted to a cohort of 20 participants, underscoring the potential for enhancing result validity through the utilization of a larger sample size
... ... @@ -108,19 +108,10 @@
108 108  //Another limitation of the evaluation is with the GPT Assistant's ability to consistently elaborate on any question posed by the participant.//
109 109  
110 110  
111 -(% class="wikigeneratedid" id="HEthicalConsiderations" %)
112 -//**Ethical Considerations**//
113 113  
114 -We commit to high ethical standards, respecting the sensitive nature of simulating dementia conditions, and ensuring the well-being and dignity of all participants throughout the study. To ensure this we present a form containing the ethical considerations to each participant.
115 -
116 -
117 117  === 5. Conclusions ===
118 118  
119 -===== //**Final Remarks**// =====
105 +===== //**Ethical Considerations**// =====
120 120  
121 -With regards to our final insights, there were some areas of improvement. For example, relating to the validity of the testing procedure, we had a relatively small sample size and none of the participants had dementia. This means that the target group for this NAO system was not tested. It was also only a specific group of people, namely students with the age range of 20-25. There was also a level of ambiguity in the point system of the evaluation and with regards to the LLM model focus, we found deviations from the GPT regarding the main objective. However, although these were a few of the limitations throughout the process, we were still able to evaluate the NAO system and could recognise that the NAO may positively affects participant’ s affective state.
107 +We commit to high ethical standards, respecting the sensitive nature of simulating dementia conditions, and ensuring the well-being and dignity of all participants throughout the study. To ensure this we present a form containing the ethical considerations to each participant.
122 122  
123 -
124 -===== **//Potential Future Work//** =====
125 -
126 -As mentioned, there were some limitations, which could be taken into consideration if wishing to continue work on the Personal Encyclopaedia. For future work, testing can be done on the correct target group, the GPT could be optimised to avoid deviations, and more focus could be placed on our last stage (Extension Phase) to see if additional functionalities are needed!
Test group data.jpg
Author
... ... @@ -1,1 +1,0 @@
1 -xwiki:XWiki.jeanpaulsmit
Size
... ... @@ -1,1 +1,0 @@
1 -157.5 KB
Content