Wiki source code of Measuring Instruments
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | |||
| 2 | |||
| 3 | |||
| 4 | == Basics== | ||
| 5 | |||
| 6 | === Decide framework=== | ||
| 7 | |||
| 8 | ==== DETERMINE THE GOALS==== | ||
| 9 | |||
| 10 | * What are the high-level goals of the evaluation? | ||
| 11 | * Who wants it and why? | ||
| 12 | * The goals influence the approach used for the study. | ||
| 13 | |||
| 14 | |||
| 15 | ==== EXPLORE THE QUESTIONS==== | ||
| 16 | |||
| 17 | Define (sub)goals & (sub)research questions. | ||
| 18 | |||
| 19 | |||
| 20 | ==== CHOOSE EVALUATION APPROACH & METHODS==== | ||
| 21 | |||
| 22 | The evaluation approach influences the methods used, and in turn, | ||
| 23 | how data is collected, analyzed and presented | ||
| 24 | |||
| 25 | |||
| 26 | ==== IDENTIFY PRACTICAL ISSUES==== | ||
| 27 | |||
| 28 | * Intention: Clarify objectives and hypotheses/claims | ||
| 29 | * Metrics & measures: What, how and why | ||
| 30 | * People: Target group & participants | ||
| 31 | * Activities: Derive activities from use cases | ||
| 32 | * Context: Social, ethical, physical, etc. aspects | ||
| 33 | * Technologies: Hardware and software | ||
| 34 | |||
| 35 | |||
| 36 | For example: | ||
| 37 | * Select users. | ||
| 38 | * Stay on budget. | ||
| 39 | * Stay on schedule. | ||
| 40 | * Find participants. | ||
| 41 | * Select equipment. | ||
| 42 | Perform a pilot (trial) study! | ||
| 43 | |||
| 44 | |||
| 45 | ==== DECIDE ABOUT ETHICAL ISSUES==== | ||
| 46 | |||
| 47 | |||
| 48 | |||
| 49 | ==== EVALUATE, ANALYZE, INTERPRET AND PRESENT THE DATA==== | ||
| 50 | |||
| 51 | |||
| 52 | The approach and methods used influence how data | ||
| 53 | is evaluated, analyzed, interpreted and presented. | ||
| 54 | |||
| 55 | |||
| 56 | === IMPACT framework=== | ||
| 57 | |||
| 58 | |||
| 59 | |||
| 60 | == GOOD EVALUATION == | ||
| 61 | |||
| 62 | * Establishing convincing arguments for your design solution | ||
| 63 | |||
| 64 | * By conducting complementary and regular evaluations at different stages | ||
| 65 | of your design process using the appropriate evaluation methods | ||
| 66 | (e.g. summative, formative, expert-based, observational, ...) | ||
| 67 | |||
| 68 | * Evaluations should result in insights regarding possible problems and | ||
| 69 | their causes in order to support refinement of your design specification | ||
| 70 | |||
| 71 | * Look at user experience in its full breadth: Effectiveness, efficiency, | ||
| 72 | satisfaction, learnability, mood, connectedness, ... | ||
| 73 | |||
| 74 | |||
| 75 | |||
| 76 | |||
| 77 |