Changes for page Measuring Instruments

Summary

• Page properties (2 modified, 0 added, 0 removed)

Details

Page properties

Author

...	...	@@ -1,1 +1,1 @@
1		-XWiki.Tim_Huisman2
	1	+XWiki.LauraOttevanger

Content

...	...	@@ -1,38 +1,38 @@
1	1	In this section, we will outline the measuring instruments used to evaluate our prototype and a motivation for using each of them. During the lecture on evaluation, we were presented with the **DECIDE** [[(Preece et al., 2015, Chapter 13)>>http://oro.open.ac.uk/29638/]] framework and the IMPACT (Benyon et al., 2005) framework. Firstly, we will briefly explain how we incorporated the **DECIDE** framework into our own project. Secondly, we will mostly elaborate on the intentions from the **IMPACT** framework as the other letters of the acronym are delineated across this XWiki.
2	2
3		-= **DECIDE** =
	3	+== **DECIDE** ==
4	4
5		-== **D**etermine the goals ==
	5	+=== **D**etermine the goals ===
6	6	Our aim is to develop a robot that can assist PwD living in a care home on their daily walks. The idea is that PwD will perceive a higher level of autonomy when they walk with a robot dog, assuming it is tailored to their needs, compared to walking with a caretaker. PwDs do not want to put the burden on their loved ones and caretakers to assist them with conducting their daily activities in general.
7	7
8		-== **E**xplore the questions ==
	8	+=== **E**xplore the questions ===
9	9	The research questions are defined in our [[Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Test/]] section and include a motivation. To consider different people's attitude towards walking with a robot dog, we have constructed multiple [[personas>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Foundation/Operational%20Demands/Personas/]] and set up various value stories for the direct [[stakeholders>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Foundation/Operational%20Demands/Stakeholders/]] to help guide us in our development.
10	10
11		-== **C**hoose evaluation approach and methods ==
	11	+=== **C**hoose evaluation approach and methods ===
12	12	The evaluation methods are described in our [[Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Test/]] section. Briefly, we aim to obtain quantative data to answer our research questions. In addition, during the experiment, we will observe the participants casually and note any remarkable behavior. For the PwD who is prone to falling, we will test its effectiveness by means of //dogfooding// as this would be difficult if not unethical to evaluate empirically.
13	13
14		-== **I**dentify practical issues ==
	14	+=== **I**dentify practical issues ===
15	15	We already foresee due to the scope of the course and the current COVID-19 situation that it will be impossible to evaluate our prototype with our intended target group. We account for this problem in our experiment by instructing participants to act like persons with early-to-mid stage dementia. Naturally, the confounding factor that will influence the outcome is that participants, from our class, may interpret the role of the persona they enact very differently and will answer questions depending on their interpretation.
16	16
17		-== **D**ecide on ethical issues ==
	17	+=== **D**ecide on ethical issues ===
18	18	Any ethical issues that may arise are described in [[Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Test/]] section. To sum it up, we plan to let participants fill out a consent form and inform them that they are allowed to withdraw from the experiment at any time no questions asked. Moreover, we aim to debrief the participants properly, but also allow for a debriefing in textual form when the participant fills out the final questionnaire.
19	19
20		-== **E**valuate, analyze, interpret and present the data ==
	20	+=== **E**valuate, analyze, interpret and present the data ===
21	21	We aim to conduct an experiment that is reliable and valid. However, as will be mentioned in limitations under Future Work/Conclusions, we were able to set up a reliable experiment (albeit a bit long per participant), but not necessarily valid as the questions of the survey did not accurately capture the autonomy of the participant at each stage. We acknowledge that the experiment was biased towards people who have more affinity with technology and understand the affordances of robots in general. In addition, there is a bias for participants who have a knack for acting or //at least// playing the role of someone else that is not themselves. After completion of the experiment, we are prudent to draw any conclusions about generalization and increasing the scope of the findings due to the numerous limitations and cofounding factors aforementioned.
22	22
23	23	Preferably, one would conduct this experiment as a field study in a PwD's natural environment (i.e. the care home) with multiple sessions to account for sudden mood changes in PwD. So, the fact that the participants were students and the experiment was held in a meeting room did influence the findings a little. We predict that participants would experience higher degrees of freedom in an actual care home would hallways and rooms to explore compared to a meeting room where the participant was confined between the four walls of the meeting room. Therefore, we acknowledge that the experiment may not be ecologically valid.
24	24
25		-= **IMPACT** =
	25	+== **IMPACT** ==
26	26
27		-== **I**ntention ==
	27	+=== **I**ntention ===
28	28
29		-Our intention is to study the overall effects of our prototype. As such, we opted for a *summative evaluation* where we compare between the experience of walking with a caretaker and walking with a robot dog as independent variables.
	29	+Our intention is to study the overall effects of our prototype. As such, we opted for a **summative evaluation** where we compare between the experience of walking with a caretaker and walking with a robot dog as independent variables.
30	30
31		-== **M**etrics ==
	31	+=== **M**etrics ===
32	32
33	33	The detailed metrics are outlined in our [[Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Test/]] section. We intend to use mostly subjective measures, since the main aim is to measure an increase in perceived autonomy. Most of the questions on our questionnaire are ordinal in nature. For instance, there is a clear order from **no** autonomy to **full** autonomy, but there is no relative degree of difference between these levels.
34	34
35		-== **P**eople, **A**ctivities, **C**ontext and **T**echnologies (PACT) ==
	35	+=== **P**eople, **A**ctivities, **C**ontext and **T**echnologies (PACT) ===
36	36
37	37	Our PACT analysis is mentioned in our [[Environments>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2022group02/view/Foundation/Operational%20Demands/Environments/]] section.
38	38