Skip to Content

Changes for page 3. Evaluation

Last modified by Diederik Heijbroek on 2024/04/06 11:37
From version 4.1
edited by Kris van Melis
on 2024/03/11 17:06
Change comment: There is no comment for this version
To version 13.1
edited by William OGrady
on 2024/03/26 12:37
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.KrisVanMelis
1 +xwiki:XWiki.WilliamOGrady
Content
... ... @@ -1,52 +1,21 @@
1 -NOTES;
1 +=== In //Evaluation, //we describe a study to evaluate the effectiveness of the system's information retrieval capabilities. ===
2 2  
3 3  
4 -We are testing out use-case 2.
4 +(% class="wikigeneratedid" %)
5 +__Contents:__
5 5  
7 +(% class="wikigeneratedid" %)
8 +[[a. Prototype>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/a.%20Prototype/]]
6 6  
7 -Setup:
10 +(% class="wikigeneratedid" %)
11 +[[b. Pilot Study>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/Pilot%20study/]]
8 8  
9 -We get random test persons. The person get the role of someone with early stage dementia who has forgotten relationship (we might have to specifically focus on memory).
13 +(% class="wikigeneratedid" %)
14 +[[c. Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/b.%20Test/]]
10 10  
16 +=== ===
11 11  
12 -the person's goal is to find out as much information as possible from the memory bank of a person don't know.
18 +=== ===
13 13  
14 14  
15 -we mainly test if the robot and the implemtation is effective in memory retrieval.
16 -
17 -
18 -We ONLY test with students, not PwD.
19 -
20 -
21 -PILOT STUDY!!!
22 -
23 -
24 -
25 -
26 -Task list:
27 -
28 -0. What do we want to evaluate?
29 -
30 - a. work out what use case we want to evaluate and what assumptions/claim we want to test.
31 -
32 -
33 -~1. Write down test proposal & content
34 -
35 - a. introduction information
36 -
37 - b. how it gets processed
38 -
39 - c. informed consent and they can leave any time etc
40 -
41 - d. questions for evaluation of system
42 -
43 - e. data analysis we are going to do
44 -
45 -2. Ethical approval from that one board at the TU Delft
46 -
47 -3. implement test for robot
48 -
49 -4. evaluate with students
50 -
51 -
52 52