Skip to Content

Changes for page 3. Evaluation

Last modified by Diederik Heijbroek on 2024/04/06 11:37
From version 17.1
edited by Diederik Heijbroek
on 2024/04/06 11:37
Change comment: There is no comment for this version
To version 4.1
edited by Kris van Melis
on 2024/03/11 17:06
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -xwiki:XWiki.DiederikHeijbroek
1 +xwiki:XWiki.KrisVanMelis
Content
... ... @@ -1,22 +1,52 @@
1 -=== In //Evaluation, //we describe a study to evaluate the effectiveness of the system's information retrieval capabilities. ===
1 +NOTES;
2 2  
3 3  
4 -(% class="wikigeneratedid" %)
5 -__Contents:__
4 +We are testing out use-case 2.
6 6  
7 -(% class="wikigeneratedid" %)
8 -[[a. Prototype>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/a.%20Prototype/]]
9 9  
10 -* [[Database>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/a.%20Prototype/sheets/]]
7 +Setup:
11 11  
12 -(% class="wikigeneratedid" %)
13 -[[b. Test>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/b.%20Test/]]
9 +We get random test persons. The person get the role of someone with early stage dementia who has forgotten relationship (we might have to specifically focus on memory).
14 14  
15 -* [[Quiz>>https://xwiki.ewi.tudelft.nl/xwiki/wiki/sce2024group01/view/3.%20Evaluation/b.%20Test/Quiz/]]
16 16  
17 -=== ===
12 +the person's goal is to find out as much information as possible from the memory bank of a person don't know.
18 18  
19 -=== ===
20 20  
15 +we mainly test if the robot and the implemtation is effective in memory retrieval.
21 21  
17 +
18 +We ONLY test with students, not PwD.
19 +
20 +
21 +PILOT STUDY!!!
22 +
23 +
24 +
25 +
26 +Task list:
27 +
28 +0. What do we want to evaluate?
29 +
30 + a. work out what use case we want to evaluate and what assumptions/claim we want to test.
31 +
32 +
33 +~1. Write down test proposal & content
34 +
35 + a. introduction information
36 +
37 + b. how it gets processed
38 +
39 + c. informed consent and they can leave any time etc
40 +
41 + d. questions for evaluation of system
42 +
43 + e. data analysis we are going to do
44 +
45 +2. Ethical approval from that one board at the TU Delft
46 +
47 +3. implement test for robot
48 +
49 +4. evaluate with students
50 +
51 +
22 22