Changes for page Measuring Instruments

Last modified by Xin Wan on 2022/03/02 12:06

From version Icon 2.1 Icon
edited by Xin Wan
on 2022/03/02 10:57
Change comment: There is no comment for this version
To version Icon 20.1 Icon
edited by Xin Wan
on 2022/03/02 11:50
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -1,5 +1,86 @@
1 1  
2 -=== Heading 3===
3 -GOOD EVALUATION IS:
4 4  
5 5  
4 +== Basics==
5 +
6 +=== Decide framework===
7 +
8 +==== DETERMINE THE GOALS====
9 +
10 +* What are the high-level goals of the evaluation?
11 +* Who wants it and why?
12 +* The goals influence the approach used for the study.
13 +
14 +
15 +==== EXPLORE THE QUESTIONS====
16 +
17 +Define (sub)goals & (sub)research questions.
18 +
19 +
20 +==== CHOOSE EVALUATION APPROACH & METHODS====
21 +
22 +The evaluation approach influences the methods used, and in turn,
23 +how data is collected, analyzed and presented
24 +
25 +
26 +==== IDENTIFY PRACTICAL ISSUES====
27 +
28 +For example:
29 +* Select users.
30 +* Stay on budget.
31 +* Stay on schedule.
32 +* Find participants.
33 +* Select equipment.
34 +Perform a pilot (trial) study!
35 +
36 +
37 +==== DECIDE ABOUT ETHICAL ISSUES====
38 +
39 +
40 +
41 +==== EVALUATE, ANALYZE, INTERPRET AND PRESENT THE DATA====
42 +
43 +
44 +The approach and methods used influence how data
45 +is evaluated, analyzed, interpreted and presented.
46 +
47 +
48 +=== IMPACT framework===
49 +* Intention: Clarify objectives and hypotheses/claims
50 +* Metrics & measures: What, how and why
51 +* People: Target group & participants
52 +* Activities: Derive activities from use cases
53 +* Context: Social, ethical, physical, etc. aspects
54 +* Technologies: Hardware and software
55 +
56 +
57 +
58 +==== Formative evaluation====
59 +
60 +Focuses on the various processes of the human-
61 +technology interaction
62 +
63 +==== Summative evaluation====
64 +
65 + Focuses on the overall effects of the human-
66 +technology interaction
67 +
68 +== GOOD EVALUATION ==
69 +
70 +* Establishing convincing arguments for your design solution
71 +
72 +* By conducting complementary and regular evaluations at different stages
73 +of your design process using the appropriate evaluation methods
74 +(e.g. summative, formative, expert-based, observational, ...)
75 +
76 +* Evaluations should result in insights regarding possible problems and
77 +their causes in order to support refinement of your design specification
78 +
79 +* Look at user experience in its full breadth: Effectiveness, efficiency,
80 +satisfaction, learnability, mood, connectedness, ...
81 +
82 +
83 +
84 +
85 +
86 +