Skip to Content

Changes for page 3. Evaluation

Last modified by Diederik Heijbroek on 2024/04/06 11:37
From version 10.1
edited by William OGrady
on 2024/03/25 14:14
Change comment: There is no comment for this version
To version 13.1
edited by William OGrady
on 2024/03/26 12:37
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -8,67 +8,14 @@
8 8  [[a. Prototype>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/a.%20Prototype/]]
9 9  
10 10  (% class="wikigeneratedid" %)
11 -b[[. Pilot Study>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/Pilot%20study/]]
11 +[[b. Pilot Study>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/Pilot%20study/]]
12 12  
13 13  (% class="wikigeneratedid" %)
14 -c[[. Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/b.%20Test/]]
14 +[[c. Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/b.%20Test/]]
15 15  
16 16  === ===
17 17  
18 -=== Setup ===
18 +=== ===
19 19  
20 -**Concrete Assignment: **The experiment will consist of groups of 3-4 people that will be given the opportunity to interact with NAO in a time-slot of 10 mins. In this time, the participants will be tasked to retrieve certain information. Due to time and language constraints of the NAO, we are unable to test Dutch PwDs. To simulate the effect of early-stage dementia symptoms, the NAO consists of data with a pre-defined persona. The participants will be tasked to retrieve key elements of the persona by interacting with the NAO. Seeing as this is not their own history, it will be as if they have 'forgotten' this information. After the 10 minutes of interaction with NAO, the test group will be given two evaluation surveys. The first evaluation survey is to see how much of the information was retained and discovered of the persona through the use of the NAO. The second evaluation survey is to allow the participant to indicate the emotional experience with the NAO.
21 21  
22 -
23 -NOTES;
24 -
25 -
26 -We are testing out use-case 2.
27 -
28 -
29 -Setup:
30 -
31 -We get random test persons. The person get the role of someone with early stage dementia who has forgotten relationship (we might have to specifically focus on memory).
32 -
33 -
34 -the person's goal is to find out as much information as possible from the memory bank of a person don't know.
35 -
36 -
37 -we mainly test if the robot and the implemtation is effective in memory retrieval.
38 -
39 -
40 -We ONLY test with students, not PwD.
41 -
42 -
43 -PILOT STUDY!!!
44 -
45 -
46 -
47 -
48 -Task list:
49 -
50 -0. What do we want to evaluate?
51 -
52 - a. work out what use case we want to evaluate and what assumptions/claim we want to test.
53 -
54 -
55 -~1. Write down test proposal & content
56 -
57 - a. introduction information
58 -
59 - b. how it gets processed
60 -
61 - c. informed consent and they can leave any time etc
62 -
63 - d. questions for evaluation of system
64 -
65 - e. data analysis we are going to do
66 -
67 -2. Ethical approval from that one board at the TU Delft
68 -
69 -3. implement test for robot
70 -
71 -4. evaluate with students
72 -
73 -
74 74