Changes for page Test

Summary

• Page properties (2 modified, 0 added, 0 removed)

Details

Page properties

Author

...	...	@@ -1,1 +1,1 @@
1		-XWiki.haoranwang
	1	+XWiki.Mathieu

Content

...	...	@@ -1,5 +3,3 @@
1		-= Ideal Evaluation (actual research) =
2		-
3	3	== Problem statement and research questions ==
4	4
5	5	This project uses a Social Cognitive Engineering (SCE) approach to guide the design and research process. The SCE method provides a systematic approach to our study of robots for PwDs. The main goal of our application is to improve the well-being of the person with dementia (PwD) and of those living with them.
...	...	@@ -75,84 +75,3 @@
75	75	* Ecological validity: Yes. Since we compare "without Pepper" (BEFORE) and "with Pepper" (AFTER) in a similar environment (i.e., for everything but Pepper), the results are not dependent on the environment.
76	76
77	77	== Conclusions ==
78		-
79		-
80		-
81		-= Feasible evaluation (students) =
82		-
83		-== Problem statement and research questions ==
84		-
85		-This project uses a Social Cognitive Engineering (SCE) approach to guide the design and research process. The SCE method provides a systematic approach to our study of robots for PwDs. The main goal of our application is to improve the well-being of the person with dementia (PwD) and of those living with them.
86		-
87		-For the prototype that we have designed now, these are some research questions that we want to address.
88		-
89		-1. Are the different stakeholders able to use our prototype smoothly?
90		-1. Does the prototype allow the PwD greater autonomy in their day-to-day life?
91		-1. Does the prototype improve the emotional state of the PwD and their relatives?
92		-
93		-== Method ==
94		-
95		-As people with dementia have very specific situations (and because our prototype is built to deal with that aspect of customizability), we do not go for an identical experiment for all of them. Instead, the global setup is very similar, although Pepper is customized for the needs of every patient. Our evaluation can therefore be assimilated (with some reserve) to a within-subject evaluation. We also do pre-test and post-test.
96		-Our main evaluation method is summative evaluation: we are trying to determine whether the robot has an impact and improves the frequency of "yes" in our yes-no driving questions.
97		-
98		-== Participants ==
99		-
100		-For this study, we simulate the real research by including 20 students in our class. To avoid too much gender imbalance, there will be at least five men and five women. All participants will be asked to pretend to be a demented person and to make the simulation as real as possible.
101		-
102		-== Experimental design ==
103		-Since our evaluating process is relatively short, we use within-subject, which means each participant goes through all conditions. In this way, our experiments tend to have more statistical power and less variability. Furthermore, every PwD may have different issues in their day-to-day life, while also not having the same living conditions (alone, living with husband, family, etc), thus would require a different treatment. But in our setting, we use the same home setting for every participant.
104		-
105		-== Tasks ==
106		-
107		-All participants will go through our designed testing process, which includes medication/meal/activity reminder and activity breakdown.
108		-
109		-Medication/meal/activity reminder: The robot will remind the patient of daily activities, through which we can see the effectiveness according to their reactions.
110		-Activity breakdown: In this part, the robot will break down some complex tasks into a list of simple tasks and PwDs can follow the steps to accomplish complex tasks.
111		-
112		-== Measures ==
113		-
114		-We are planning to make behavioural and emotional measurements.
115		-Behavioral measurements are the actions that the PwD is going to perform during the week, so it can be considered as subjective quantitative data. This will involve the relatives, the HPC and the PwD themselves to quantify whether the use of Pepper did actually result in an increase in autonomy for the PwD.
116		-Emotional measurements are more related to state of mind, change of expression and mood, so it can be considered as qualitative data. This can be measured by frequent talks with the PwD, either by the relatives or the HPC.
117		-Measures will be done by oral discussions with the PwD, HPC and relatives.
118		-
119		-== Procedure ==
120		-
121		-At the start of the evaluation, all participants will be gathered in the same room, together with the researchers and relatives. We will explain the whole evaluation process, provide simple instructions, explain that participation in the evaluations is voluntary, and participants are free to stop the evaluation at any time. Then, we will explain how the gathered data will be analyzed and help us to improve our prototype. All data will be kept private. We will also emphasize that if there is anything the participants dislike, they should let us know. The purpose of the study is to find out what they think of the prototype, and their honesty is greatly appreciated. Then, we will ask them to sign the consent form.
122		-We will simulate a home setting, which is the most common scenario for PwDs. All PwDs are going to complete the evaluation separately.
123		-
124		-Our robot will give corresponding prompts. For example, “It’s time to have lunch”, “Medicine time!”, “Today is your birthday. Happy Birthday!”.
125		-We will record the reaction and behavior of participants after they heard the prompts.
126		-To test the activity breakdown function, our robot will choose a relatively complex task to perform, such as making a paper plane, doing some exercise. Our robot will break it down into simple steps.
127		-Record the reactions of participants and evaluate how is the activity accomplished.
128		-
129		-== Material ==
130		-
131		-1. Consent form. To protect the privacy of participants and ensure the evaluation process goes smoothly, we will ask participants to sign a consent form, indicating they are willing to take part in the evaluation and the data gathered from the experiment will be analyzed by researchers.
132		-1. Pepper robot. Our robot is programmed using Choregraphe. The robot will have the same behaviour for every participant. However, the input data will be entered by the HPC (and potentially the relatives).
133		-
134		-== Results ==
135		-
136		-Since each PwD has its own state of dementia and personal issues, it is very difficult to get uniform results, especially since they are collected orally.
137		-Getting very nice, fully robust and reliable results, is merely a hope and a dream.
138		-However, we can try to consider the main trends that we are interested in.
139		-Thus, the results wil be mainly focused on:
140		-- How much autonomy did the PwD gain?
141		-→ what did the HPC, relatives and PwD report
142		-→ how many tasks did they perform that they didn't do previously
143		-→ did the relatives feel they had more time for themselves
144		-- Did their emotional state improve?
145		-→ feelings from the PwD themselves
146		-→ reports from relatives and HPC
147		-These results will most likely never be yes-no results, but more like clues or hints that show whether some things worked on not, which will be the point of our discussion.
148		-NB: This part explains what we expect as kind of results, it will be replaced by actual results after we perform an experiment with the class. There may also be interesting points we did not think about.
149		-
150		-== Discussion ==
151		-
152		-* Reliability: Yes. One could replicate the same experiment with other patients.
153		-* Validity: TBD.
154		-* Biases: TBD.
155		-* Scope: No. It would be very difficult to generalize the results, since each prototype is built for a special patient. However, if the results conclude that the customized prototypes did improve the well-being of the people, then similar effort to customize Pepper for more patients should produce similar effects.
156		-* Ecological validity: Yes. Since we compare "without Pepper" (BEFORE) and "with Pepper" (AFTER) in a similar environment (i.e., for everything but Pepper), the results are not dependent on the environment.
157		-
158		-== Conclusions ==