Changes for page Measuring Instruments

Last modified by Xin Wan on 2022/03/02 12:06

From version Icon 5.1 Icon
edited by Xin Wan
on 2022/03/02 10:59
Change comment: There is no comment for this version
To version Icon 15.1 Icon
edited by Xin Wan
on 2022/03/02 11:12
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -1,12 +1,73 @@
1 1  
2 -==== GOOD EVALUATION ====
3 3  
3 +
4 +== Basics==
5 +
6 +=== Decide framework===
7 +
8 +==== DETERMINE THE GOALS====
9 +
10 +* What are the high-level goals of the evaluation?
11 +* Who wants it and why?
12 +* The goals influence the approach used for the study.
13 +
14 +
15 +==== EXPLORE THE QUESTIONS====
16 +
17 +Define (sub)goals & (sub)research questions.
18 +
19 +
20 +==== CHOOSE EVALUATION APPROACH & METHODS====
21 +
22 +The evaluation approach influences the methods used, and in turn,
23 +how data is collected, analyzed and presented
24 +
25 +
26 +==== IDENTIFY PRACTICAL ISSUES====
27 +
28 +* Intention: Clarify objectives and hypotheses/claims
29 +* Metrics & measures: What, how and why
30 +* People: Target group & participants
31 +* Activities: Derive activities from use cases
32 +* Context: Social, ethical, physical, etc. aspects
33 +* Technologies: Hardware and software
34 +
35 +
36 +For example:
37 +* Select users.
38 +* Stay on budget.
39 +* Stay on schedule.
40 +* Find participants.
41 +* Select equipment.
42 +Perform a pilot (trial) study!
43 +
44 +
45 +==== DECIDE ABOUT ETHICAL ISSUES====
46 +
47 +
48 +
49 +==== EVALUATE, ANALYZE, INTERPRET AND PRESENT THE DATA====
50 +
51 +
52 +The approach and methods used influence how data
53 +is evaluated, analyzed, interpreted and presented.
54 +
55 +
56 +=== IMPACT framework===
57 +
58 +
59 +
60 +== GOOD EVALUATION ==
61 +
4 4  * Establishing convincing arguments for your design solution
63 +
5 5  * By conducting complementary and regular evaluations at different stages
6 6  of your design process using the appropriate evaluation methods
7 7  (e.g. summative, formative, expert-based, observational, ...)
67 +
8 8  * Evaluations should result in insights regarding possible problems and
9 9  their causes in order to support refinement of your design specification
70 +
10 10  * Look at user experience in its full breadth: Effectiveness, efficiency,
11 11  satisfaction, learnability, mood, connectedness, ...
12 12