Changes for page Measuring Instruments
Last modified by Xin Wan on 2022/03/02 12:06
Summary
Details
- Page properties
-
- Content
-
... ... @@ -1,5 +1,75 @@ 1 1 2 -=== GOOD EVALUATION IS:=== 3 3 4 4 4 +== Basics== 5 5 6 +=== Decide framework=== 7 + 8 +==== DETERMINE THE GOALS==== 9 + 10 +* What are the high-level goals of the evaluation? 11 +* Who wants it and why? 12 +* The goals influence the approach used for the study. 13 + 14 + 15 +==== EXPLORE THE QUESTIONS==== 16 + 17 +Define (sub)goals & (sub)research questions. 18 + 19 + 20 +==== CHOOSE EVALUATION APPROACH & METHODS==== 21 + 22 +The evaluation approach influences the methods used, and in turn, 23 +how data is collected, analyzed and presented 24 + 25 + 26 +==== IDENTIFY PRACTICAL ISSUES==== 27 + 28 +For example: 29 +* Select users. 30 +* Stay on budget. 31 +* Stay on schedule. 32 +* Find participants. 33 +* Select equipment. 34 +Perform a pilot (trial) study! 35 + 36 + 37 +==== DECIDE ABOUT ETHICAL ISSUES==== 38 + 39 + 40 + 41 +==== EVALUATE, ANALYZE, INTERPRET AND PRESENT THE DATA==== 42 + 43 + 44 +The approach and methods used influence how data 45 +is evaluated, analyzed, interpreted and presented. 46 + 47 + 48 +=== IMPACT framework=== 49 +* Intention: Clarify objectives and hypotheses/claims 50 +* Metrics & measures: What, how and why 51 +* People: Target group & participants 52 +* Activities: Derive activities from use cases 53 +* Context: Social, ethical, physical, etc. aspects 54 +* Technologies: Hardware and software 55 + 56 + 57 +== GOOD EVALUATION == 58 + 59 +* Establishing convincing arguments for your design solution 60 + 61 +* By conducting complementary and regular evaluations at different stages 62 +of your design process using the appropriate evaluation methods 63 +(e.g. summative, formative, expert-based, observational, ...) 64 + 65 +* Evaluations should result in insights regarding possible problems and 66 +their causes in order to support refinement of your design specification 67 + 68 +* Look at user experience in its full breadth: Effectiveness, efficiency, 69 +satisfaction, learnability, mood, connectedness, ... 70 + 71 + 72 + 73 + 74 + 75 +