Changes for page Test
Last modified by Laura Ottevanger on 2022/04/05 14:02
From version
45.1


edited by Tim Huisman
on 2022/04/05 10:49
on 2022/04/05 10:49
Change comment:
There is no comment for this version
To version
47.1


edited by Laura Ottevanger
on 2022/04/05 11:49
on 2022/04/05 11:49
Change comment:
There is no comment for this version
Summary
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. Tim_Huisman21 +XWiki.LauraOttevanger - Content
-
... ... @@ -1,11 +1,11 @@ 1 -In this section, we will introduce our experimental test set 1 +In this section, we will introduce our experimental test setup and motivate our research questions. 2 2 3 3 = Problem statement and research questions = 4 4 5 -People with dementia face challenges that were not present in their life before being affected by their condition. This is also influenced by their living situation, since they may live in care homes or dementia centers. To ensure that people with dementia stay safe, activities are usually le ad by a caretaker. However, staff has limited time available to spend with each individual person. Group activities or caretaker-lead activities may affect the feeling of autonomy of the person with dementia. Autonomy is one of the key psychological needs described in self-determination theory, which describes how feeling fulfilled is influenced by how much a person feels in control of their own actions. It is important to the mental well-being of people with dementia to keep a sense of autonomy.6 -With our research, we aim to provide support to Patients with Dementia (PwD) who currently are dependent on their caretakers and significant other to go for walks. This is outlined in more detail in the Objectives section. The presumed baseline is that PwD walk under supervision of their loved ones or caretakers. To reach our objective and support our claims, we would like to put forward the following research question: 5 +People with dementia face challenges that were not present in their life before being affected by their condition. This is also influenced by their living situation, since they may live in care homes or dementia centers. To ensure that people with dementia stay safe, activities are usually led by a caretaker. However, the staff has limited time available to spend with each individual person. Group activities or caretaker-led activities may affect the feeling of autonomy of the person with dementia. Autonomy is one of the key psychological needs described in self-determination theory, which describes how feeling fulfilled is influenced by how much a person feels in control of their own actions. It is important to the mental well-being of people with dementia to keep a sense of autonomy. 6 +With our research, we aim to provide support to Patients with Dementia (PwD) who currently are dependent on their caretakers and significant other to go for walks. This is outlined in more detail in the Objectives section. The presumed baseline is that PwD walks under the supervision of their loved ones or caretakers. To reach our objective and support our claims, we would like to put forward the following research question: 7 7 8 -//Does walking with WAF increase the perceived autonomy of people with dementia, compared to walking under guidance of a caretaker?// 8 +//Does walking with WAF increase the perceived autonomy of people with dementia, compared to walking under the guidance of a caretaker?// 9 9 10 10 To answer this question, we use the following subquestions: 11 11 ... ... @@ -14,7 +14,7 @@ 14 14 15 15 = Method = 16 16 17 -To this effect, we would like to invite users to participate in a usability study. In the study, we will assess our research question by dividing the participants into two groups: one with a //caretaker// and one with //WAF//. The former group will enact the activity of walking in the current setting and the latter group will do the equivalent with the robot. Afterward s, both groups are assessed by means of Likert-scales to measure the increase. The difference in scores between the caretaker and the WAF setting will then be subjected to a Wilcoxon [[(Conover, 1998, p. 250)>>https://www-wiley-com.tudelft.idm.oclc.org/en-nl/Practical+Nonparametric+Statistics%2C+3rd+Edition-p-9780471160687]] test to determine whether the increase is statistically significant. If the significance has been demonstrated, then we can reject the null hypothesis: walking with the WAF will not provide an increased feeling of autonomy compared to walking with a caretaker.17 +To this effect, we would like to invite users to participate in a usability study. In the study, we will assess our research question by dividing the participants into two groups: one with a //caretaker// and one with //WAF//. The former group will enact the activity of walking in the current setting and the latter group will do the equivalent with the robot. Afterward, both groups are assessed by means of Likert-scales to measure the increase. The difference in scores between the caretaker and the WAF setting will then be subjected to a Wilcoxon [[(Conover, 1998, p. 250)>>https://www-wiley-com.tudelft.idm.oclc.org/en-nl/Practical+Nonparametric+Statistics%2C+3rd+Edition-p-9780471160687]] test to determine whether the increase is statistically significant. If the significance has been demonstrated, then we can reject the null hypothesis: walking with the WAF will not provide an increased feeling of autonomy compared to walking with a caretaker. 18 18 19 19 20 20 == Participants == ... ... @@ -45,11 +45,11 @@ 45 45 46 46 == Measures == 47 47 48 -To measure the effectiveness of our solution, we use a questionnaire. Since people with dementia may experience difficulties with expressing themselves in a conversation, this questionnaire is le ad by an interviewer [[(Neerincx et al., to appear)>>]]. A caretaker may also be present to help the person with dementia accurately express themselves.48 +To measure the effectiveness of our solution, we use a questionnaire. Since people with dementia may experience difficulties with expressing themselves in a conversation, this questionnaire is led by an interviewer [[(Neerincx et al., to appear)>>]]. A caretaker may also be present to help the person with dementia accurately express themselves. 49 49 50 50 == Procedure == 51 51 52 -The procedure is that the person with dementia is walking with WAF. The PwD is given WAF and the proximity, WAF has a pre-programmed route to walk. The PwD is asked to walk with the dog. While they are walking the dog, they are observed by a separate observer, carefully noting down any remarkable events. The emotional state of the PwD is actively monitored by looking at facial expressions. Furthermore, the researchers will actively check how easily the PwD interact with WAF to check the familiarity. When the PwD is done walking, some small questions will be asked to check the satisfaction, autonomy and familiarity. 52 +The procedure is that the person with dementia is walking with WAF. The PwD is given WAF and the proximity, WAF has a pre-programmed route to walk. The PwD is asked to walk with the dog. While they are walking the dog, they are observed by a separate observer, carefully noting down any remarkable events. The emotional state of the PwD is actively monitored by looking at facial expressions. Furthermore, the researchers will actively check how easily the PwD interacts with WAF to check the familiarity. When the PwD is done walking, some small questions will be asked to check the satisfaction, autonomy, and familiarity. 53 53 54 54 Functions like when an elderly person falls or when they walk in the wrong direction will not forcibly be tested with PwD as this might create a dangerous situation. These functions will be tested in advance with the use of "Dogfeeding". Other people from the development team will test these functions. 55 55 ... ... @@ -62,7 +62,7 @@ 62 62 63 63 = Results = 64 64 65 -We asked participants about their sense of being in charge, happiness, safety and trust when walking with WAF and with the caretaker. In the graphs below we show each sense compared between the two guiding agents. 65 +We asked participants about their sense of being in charge, happiness, safety, and trust when walking with WAF and with the caretaker. In the graphs below we show each sense compared between the two guiding agents. 66 66 67 67 {{html}} 68 68 <table width='80%'> ... ... @@ -101,12 +101,20 @@ 101 101 </table> 102 102 {{/html}} 103 103 104 +We performed the Wilcoxon test on the questions that were asked to the participants where both WAF and the caretaker were evaluated. With the Wilcoxon test, we are able to determine if there is any significant difference between WAF and the caretaker. Unfortunately, due to the low amount of participants, there is no possibility to create a normal distribution and thus causing the p-value to be less reliable. 104 104 106 +The first question is whether the PwD feels in charge while walking with the caretaker or WAF. The resulting z-value was -0.3145. The value of W is 9. The critical value for W at N = 6 (p < .05) is 2. The test concluded that the result for this question is not significant at p < .05. Thus there is no significant difference between either walking with the caretaker or walking with WAF. 105 105 108 +The second question is whether the PwD feels happy while walking with the caretaker or with WAF. 5 out of the 8 test answers showed no difference in either WAF or the caretaker, they gave exactly the same answers. This caused the test answers to be reduced to 3 which is too small to perform the Wilcoxon test on. 109 + 110 +The third question is whether the PwD feels safe while walking with the caretaker or with WAF. This test had a z-value of -2.3664 and a W-value of 0. The result is significant with p < .05. There was a strong preference for walking with the caretaker in regards to feeling safe. 111 + 112 +The final question is whether the PwD trusts the WAF or the caretaker while walking. The z-value resulted in -2.3664 which resulted in the same W-value as the third question: 0. The result was again significant with p < .05. Again there was a strong preference for walking with the caretaker. The caretaker was considered more trustworthy than the WAF. 113 + 106 106 = Discussion = 107 107 108 -Through this test, we aim to answer the question: "Does walking with theWAF increase the perceived autonomy of people with dementia, compared to walking under guidance of a caretaker?"109 -We see that in the current state of our prototype, this is not the case. The caretaker is preferred when asked if the user feels in charge, feels safe, and feels trustworthy. However, we note that WAF does slightly outperform the caretaker in regard to happiness. We think that further development is needed to accurately gauge if walking with WAF will eventually score equal lyor better compared to walking with a caretaker.116 +Through this test, we aim to answer the question: "Does walking with WAF increase the perceived autonomy of people with dementia, compared to walking under the guidance of a caretaker?" 117 +We see that in the current state of our prototype, this is not the case. The caretaker is preferred when asked if the user feels in charge, feels safe, and feels trustworthy. However, we note that WAF does slightly outperform the caretaker in regard to happiness. We think that further development is needed to accurately gauge if walking with WAF will eventually score equal or better compared to walking with a caretaker. 110 110 We see flaws in the limited testing setup that was available to us. With only eight participants, it is nearly impossible to draw conclusions from the experiment. Additionally, these participants were actors and not real people with dementia, which may have caused bias in our results. Finally, while we intended to have the participants walk through a hallway accompanied by WAF, we only had a meeting room available to conduct the experiment in. 111 111 112 112