Skip to Content

Changes for page b. Test

Last modified by Demi Breen on 2023/04/09 15:10
From version 53.1
edited by Maya Elasmar
on 2023/04/07 14:52
Change comment: There is no comment for this version
To version 58.1
edited by Hugo van Dijk
on 2023/04/08 17:18
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.MayaElasmar
1 +XWiki.hjpvandijk
Content
... ... @@ -1,6 +1,6 @@
1 1  = 1. Introduction =
2 2  
3 -For our research, we are looking into the effect of either using goal-based motivation or emotion-based motivation in promoting PwD for physical activity. Two systems will thus be designed; one motivating using emotion-based explanations and the other using goal-based motivation. The product will motivate the PwD to go for a walk in the park stimulating the amount of physical activity. It has been shown that physical activity, an increase in emotional stability and more goal-based activities can increase the mental and physical health of the PwD. Since 70% of the PwD have a lack of motivation, apathy and lack of interest in activities this project could have a great influence on the lives of these people.
3 +For our research, we are looking into the effect of either using goal-based motivation or emotion-based motivation in promoting PwD for physical activity. Two systems will thus be designed; one motivating using emotion-based explanations and the other using goal-based motivation. The product will motivate the PwD to go for a walk in the garden stimulating the amount of physical activity. It has been shown that physical activity, an increase in emotional stability and more goal-based activities can increase the mental and physical health of the PwD. Since 70% of the PwD have a lack of motivation, apathy and lack of interest in activities this project could have a great influence on the lives of these people.
4 4  
5 5  Thus our research question is:
6 6  **What is the effect of goal-based and emotion-based explanations in prompting PwD for physical activity?**
... ... @@ -16,11 +16,11 @@
16 16  
17 17  = 2. Method =
18 18  
19 -Sadly enough we are not able to experiment on PwD in a real-time situation and over a longer time. The experiment will take place on one single day and thus the long-term effect of either goal-based or emotion-based motivation cannot be seen. However the difference in motivation can still five different results in a single experiment and these results can already show some promising results for further research.
19 +Sadly enough we are not able to experiment on PwD in a real-time situation and over a longer time. The experiment will take place on one single day and thus the long-term effect of either goal-based or emotion-based motivation cannot be seen. However, the difference in motivation can still give different results in a single experiment and these results can already show some promising results for further research.
20 20  
21 21  == 2.1 Participants ==
22 22  
23 -The test will be with students from the University of Delft that are also following this course. For the results to be valid 15 participants in a research is the minimum amount as presented by researcher Marc Brysbaert [1]. Since the decision was made for in-between subject design, which will be elaborated more in the Experimental Design section, there are thus 30 participants necessary. Due to the time constraint and the number of students in the course, 30 participants will probably not be reachable for this experiment so fewer students will participate. Also, the use of a control group is not within reach because of the lack of resources.
23 +The test will be with students from the Delft University of Technology that are also following the Socio-Cognitive course. For the results to be valid 15 participants in a study is the minimum amount as presented by researcher Marc Brysbaert [1]. Since the decision was made for in-between subject design, which will be elaborated more in the Experimental Design section, there are thus 30 participants necessary. Due to the time constraint and the number of students in the course, 30 participants will probably not be reachable for this experiment so fewer students will participate. Also, the use of a control group is not within reach because of the lack of resources.
24 24  
25 25  The participants are all young and do not have any form of dementia. The results of the research can thus not be seen as sufficient for a real-life implementation of the prototype. The students will be familiar with the robot and thus further explanation of the working of the robot is less relevant. Also, the students will feel more comfortable with the robot from the start. This might be very different to the PwD which might be a little hesitant in interacting with the robot. The integration of that aspect will be of great importance before real implementation.
26 26  
... ... @@ -28,13 +28,13 @@
28 28  
29 29  **Methodological set-up:**
30 30  
31 -Pepper will be turned on and will start a conversation with the participant. It will ask the participant to go on a walk and based on the answer Pepper will go on the walk immediately or will try to motivate the PwD to go on a walk with him. During the walk, Pepper will ask the participant questions to keep the participant engaged and keep continuing on the walk. So for the experiment, a Pepper robot, the Choregraphe software and also freedom of movement are needed. The full step-by-step schedule of the experiment is given in the attachments for both the [[goal-based motivation>>attach:Ontology & robot design - goal-based.pdf]] and the [[emotion-based motivation>>attach:Ontology & robot design - emotion-based.pdf]].
31 +Pepper will be turned on and will start a conversation with the participant. It will ask the participant to go on a walk and based on the answer Pepper will go on the walk immediately or will try to motivate the PwD to go on a walk with him. During the walk, Pepper will ask the participant questions to keep the participant engaged and keep continuing on the walk. So for the experiment, a Pepper robot, the Choregraphe software, and also freedom of movement are needed. The full step-by-step schedule of the experiment is given in the attachments for both the [[goal-based motivation>>attach:Ontology & robot design - goal-based.pdf]] and the [[emotion-based motivation>>attach:Ontology & robot design - emotion-based.pdf]].
32 32  
33 33  **Conditions**:
34 34  
35 35  The interaction will take place in a TU Delft facility. The experiment will be held in the Insyght lab. Unfortunately, the space of the room is small compared to an actual garden. The robot needs some space to move, hence we will make sure to move everything moved out of the way and that other students (who are not experimenting at the moment) wait in the room next. Also, the walk will not be as long as it would be in the actual garden.
36 36  
37 -The room also has a different surface than an actual park. However, our experiment focused more on the motivation to go outside than the walk itself. The difference in surrounding, a room instead of a garden, might have a little effect on the experience of the participant. However, the motivation will probably not be affected by the surroundings as much.
37 +The room also has a different surface than an actual garden. However, our experiment focused more on the motivation to go outside than the walk itself. The difference in surrounding, a room instead of a garden, might have a little effect on the experience of the participant. However, the motivation will probably not be affected by the surroundings as much.
38 38  
39 39  **Subject design:**
40 40  
... ... @@ -143,37 +143,26 @@
143 143  
144 144  = 4. Discussion =
145 145  
146 -- In terms of the research question, no significant differences were found. It could be that this is true in general, but it is very likely that this is influenced by the circumstances surrounding the design and the evaluation.
146 +In terms of the research question, no significant differences were found between the two different motivational methods. This is however very likely influenced by the circumstances surrounding the design and the evaluation. The design is unfortunately rather limited and with limited capabilities, due to time constraints. Speech recognition didn't always work properly and was not as flexible as desired which made the interactions less realistic for the participant. Things such as elaborating, which would be something that would be a natural part of a leisurely conversation were made very difficult as the robot could not comprehend conversation to the fullest extent.  Since participants were also prompted to give shorter answers and try to keep to things like "yes" and "no" it greatly influenced how participants interacted with the robot.
147 147  
148 -- The design is rather limited and with limited capabilities, due to time constraints. Speech recognition didn't always work properly and was not as flexible as desired which made the interactions less realistic for the participant.
148 +There were also other constraints to the interaction, which had to be given as instructions to the participant before testing. These things included at what distance to stay from the robot, when to join the robot's side when it's time for the walk, how long to wait to speak after a certain prompt, etc. This further made it unnatural but was necessary for the system to perform properly. Ideally, an individual would be able to join the robot's side at any given moment and the robot's movement would not be impacted by the fact that the participant stands too close. Further, one component that has a very significant effect on the results was that it was not possible to test the design with PwD. This was attempted to be resolved by providing a persona description for participants to keep in mind during the testing, but it is difficult to simulate conditions of dementia. Only one participant ended up embodying this character to the fullest extent which was very valuable for the sake of the evaluation but was not enough to explore the concept entirely.
149 149  
150 -- There are also other constraints to the interaction, which have to be given as instructions to the participant before testing, such as at what distance to stay from the robot, when to join the robot's side, how long to wait to speak after a certain prompt, etc. This further made it unnatural but was necessary for the system to perform properly.
150 +This highlights the fact that the results may have been different if participants outside of the course were used since we are all very familiar with these robots and systems. On one hand, it could be positive, since we have all researched dementia and have gained a lot of knowledge within this which could make us better at simulating appropriate behavior with the robot or testing the systems in a reasonable way. But since participants also have an idea of how the robot works prior to the evaluation, based on their own experiences of working with the robot, perhaps some mistakes or issues went undetected. For example, a completely inexperienced user could potentially show other faults in the design that appear only if the system is entirely foreign to the user, which is likely what it would be like with a PwD. Of course, knowing about dementia is not the same thing as actually suffering from the diagnosis, so many aspects have most likely gone undetected there for that reason also.
151 151  
152 -- Since participants were also prompted to give shorter answers and try to keep to things like "yes" and "no" it greatly influenced the way participants interacted with the robot.
152 +The results could also be influenced by the sheer amount of participants, which concluded at 8 participants per group (8 for the goal-oriented approach, and 8 for the emotional approach). Perhaps with more participants, the results would differ to a greater extent between the two approaches. Due to time constraints, it was not possible to include more participants in this particular study. Further, participants who started the interaction with a pre-disposed idea of what they wanted to do, like the participant mentioned above in the "Observations" section, definitely influenced the outcome, since this was no longer about listening to the prompts the robot was giving but more so acting according to a pre-disposed agenda.
153 153  
154 -- Further, it was (obviously) not possible to test the design with PwD. This was attempted to be resolved by providing a persona description for participants to keep in mind during the testing. Only one participant ended up embodying this character.
154 +It is also highly interesting to consider if participants are perhaps inclined to be positive in general, particularly because the users are other students of the course who tend to want to stay positive towards their peers and therefore feel inclined to reply positively or give positive feedback to the study overall. This could cloud the results, while it is still understandable behavior given the context.
155 155  
156 -- Results may have been different if participants outside of the course were used since we are all very familiar with these robots and systems. On one hand it could be positive, since we have all researched dementia and have gained a lot of knowledge within this we could be better at simulating appropriate behaviour with the robot or testing the systems in a reasonable way. But since participants also have an idea of how the robot works perhaps some mistakes or issues went undetected which could have appeared with individuals that are not familiar with the robot. Of course, knowing about dementia is not the same thing as actually suffering from the diagnosis, so many aspects have most likely gone undetected there.
156 +A rather central aspect is also of course that the robot should really take a walk outside and not inside the lab room. Preferably, the test should have been performed in an actual garden in order to be able to assess its capabilities in the appropriate terrain. This would also make it possible to make the walk more elaborate and longer since observations during the evaluation show that participants would have rather had a longer and more extensive walk, which was not possible in the lab environment.
157 157  
158 -- Results could also be influenced by the sheer amount of participants, which concluded at 8 participants per group (8 for the goal-oriented approach, and 8 for the emotional approach). Perhaps with more participants, the results would differ to a greater extent between the two approaches. Due to time constraints, it was not possible to include more participants.
158 +In future studies, the number of participants should be considered, as well as testing the design on PwD and in an actual garden or at the very least a bigger space. The walk should preferably be more extensive and perhaps incorporate aspects of the garden or the environment into the conversation to make the experience more immersing, for example by referring to the flowers that are blooming in the garden and trying to draw PwD's attention to these aspects and create conversations from this. Hopefully, adjustments like these would improve the overall quality of the walk. Further improvements to speech recognition are needed, as well as the smoothness of the walking and the aspect of the participant's distance to the robot. Perhaps if the less realistic aspects discussed above are minimized, a robot that feels more realistic would result in participants listening to the actual prompts given to a larger extent, rather than going into the experiment with a predisposed idea of what they are going to do or answer and would also perhaps deter the participants from tending to reply positively. Further, the motivational prompts were certainly customized to the persona, but further customization could have been considered. For example, it would of course be far greater if the robot has some ability to adapt to the conversation more or less "in real time" by taking in the information given by the PwD and replying in an appropriate manner. Further, intonation could be interpreted and perhaps also shape the responses and prompts of the robot. These things are rather difficult and due to limitations in the current hardware and software may be hard to implement, but it is essential to consider these aspects for future work.
159 159  
160 -- Further participants who started the interaction with a pre-disposed idea of what they wanted to do, like the participant mentioned above in the results section, definitely influenced the outcome, since this was no longer about listening to the prompts the robot was giving.
161 -
162 -- Interesting to consider if participants are perhaps inclined to be positive, or feel like they need to be in such a project evaluation and if ideas like these also ended up affecting the outcome. ?
163 -
164 -- Normally, a robot should really take a walk outside. It should have been tested how a robot will do in an actual garden, totally another surface then the room we did the experiment. Unfortunately, we could not do that, because we are not allowed to move th robot from the room.
165 -
166 -- In future studies the amount of participants should be considered, as well as testing the design on PwD and in a garden. Further improvements to the speech recognition are needed, as well as the smoothness of the walking and the distances travelled and the aspect of the participant's distance to the robot. Perhaps if the less realistic aspects discussed above are minimized, a robot that feels more realistic would result in participants listening to the actual prompts given, rather than going into the experiment with a predisposed idea of what they are going to do or answer and would also perhaps deter the participants from tending to reply positively.
167 -
168 -
169 -**ADD FUTURE WORK**
170 -
171 -
172 -
173 173  = 5. Conclusions =
174 174  
175 -Both systems were deemed enjoyable and fascinating, and little rejections were made to both types of persuasions. No significant difference was found in any of the measures between the two groups.
176 176  
163 +1. The participants found the designed systems enjoyable and the robot useful.
164 +1. No significant difference between emotion-based and goal-based persuasion.
165 +1. The participants would not have gone for a walk if the robot didn’t ask them to.
177 177  
178 178  == References ==
179 179