Changes for page Measuring Instruments

Last modified by Xin Wan on 2022/03/02 12:06

From version Icon 1.2 Icon
edited by Xin Wan
on 2022/03/02 10:57
Change comment: There is no comment for this version
To version Icon 25.1 Icon
edited by Xin Wan
on 2022/03/02 11:58
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Content
... ... @@ -1,5 +1,91 @@
1 1  
2 -=== Heading 3===
3 -GOOD EVALUATION IS:
4 4  
5 5  
4 +== Basics==
5 +
6 +=== Decide framework===
7 +
8 +==== DETERMINE THE GOALS====
9 +
10 +* What are the high-level goals of the evaluation?
11 +* Who wants it and why?
12 +* The goals influence the approach used for the study.
13 +
14 +
15 +==== EXPLORE THE QUESTIONS====
16 +
17 +Define (sub)goals & (sub)research questions.
18 +
19 +
20 +==== CHOOSE EVALUATION APPROACH & METHODS====
21 +
22 +The evaluation approach influences the methods used, and in turn,
23 +how data is collected, analyzed and presented
24 +
25 +
26 +==== IDENTIFY PRACTICAL ISSUES====
27 +
28 +For example:
29 +* Select users.
30 +* Stay on budget.
31 +* Stay on schedule.
32 +* Find participants.
33 +* Select equipment.
34 +Perform a pilot (trial) study!
35 +
36 +
37 +==== DECIDE ABOUT ETHICAL ISSUES====
38 +
39 +
40 +
41 +==== EVALUATE, ANALYZE, INTERPRET AND PRESENT THE DATA====
42 +
43 +
44 +The approach and methods used influence how data
45 +is evaluated, analyzed, interpreted and presented.
46 +
47 +
48 +=== IMPACT framework===
49 +* Intention: Clarify objectives and hypotheses/claims
50 +* Metrics & measures: What, how and why
51 +* People: Target group & participants
52 +* Activities: Derive activities from use cases
53 +* Context: Social, ethical, physical, etc. aspects
54 +* Technologies: Hardware and software
55 +
56 +
57 +
58 +==== Formative evaluation====
59 +Focuses on the various processes of the human-technology interaction.
60 +Derive open questions from your design specification.
61 +==== Summative evaluation====
62 +Focuses on the overall effects of the human-technology interaction.
63 +
64 +
65 +==== Qualitative Data====
66 +• Words
67 +• Drawings
68 +
69 +==== Quantitative====
70 +• Numbers
71 +• Statistics
72 +
73 +== GOOD EVALUATION ==
74 +
75 +* Establishing convincing arguments for your design solution
76 +
77 +* By conducting complementary and regular evaluations at different stages
78 +of your design process using the appropriate evaluation methods
79 +(e.g. summative, formative, expert-based, observational, ...)
80 +
81 +* Evaluations should result in insights regarding possible problems and
82 +their causes in order to support refinement of your design specification
83 +
84 +* Look at user experience in its full breadth: Effectiveness, efficiency,
85 +satisfaction, learnability, mood, connectedness, ...
86 +
87 +
88 +
89 +
90 +
91 +