Wiki source code of Measuring Instruments
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | |||
| 2 | |||
| 3 | |||
| 4 | == Basics== | ||
| 5 | |||
| 6 | === Decide framework=== | ||
| 7 | |||
| 8 | ==== DETERMINE THE GOALS==== | ||
| 9 | |||
| 10 | * What are the high-level goals of the evaluation? | ||
| 11 | * Who wants it and why? | ||
| 12 | * The goals influence the approach used for the study. | ||
| 13 | |||
| 14 | |||
| 15 | ==== EXPLORE THE QUESTIONS==== | ||
| 16 | |||
| 17 | Define (sub)goals & (sub)research questions. | ||
| 18 | |||
| 19 | |||
| 20 | ==== CHOOSE EVALUATION APPROACH & METHODS==== | ||
| 21 | |||
| 22 | The evaluation approach influences the methods used, and in turn, | ||
| 23 | how data is collected, analyzed and presented | ||
| 24 | |||
| 25 | |||
| 26 | ==== IDENTIFY PRACTICAL ISSUES==== | ||
| 27 | |||
| 28 | For example: | ||
| 29 | * Select users. | ||
| 30 | * Stay on budget. | ||
| 31 | * Stay on schedule. | ||
| 32 | * Find participants. | ||
| 33 | * Select equipment. | ||
| 34 | Perform a pilot (trial) study! | ||
| 35 | |||
| 36 | |||
| 37 | ==== DECIDE ABOUT ETHICAL ISSUES==== | ||
| 38 | |||
| 39 | |||
| 40 | |||
| 41 | ==== EVALUATE, ANALYZE, INTERPRET AND PRESENT THE DATA==== | ||
| 42 | |||
| 43 | |||
| 44 | The approach and methods used influence how data | ||
| 45 | is evaluated, analyzed, interpreted and presented. | ||
| 46 | |||
| 47 | |||
| 48 | === IMPACT framework=== | ||
| 49 | |||
| 50 | |||
| 51 | |||
| 52 | ==== GOOD EVALUATION ==== | ||
| 53 | |||
| 54 | * Establishing convincing arguments for your design solution | ||
| 55 | |||
| 56 | * By conducting complementary and regular evaluations at different stages | ||
| 57 | of your design process using the appropriate evaluation methods | ||
| 58 | (e.g. summative, formative, expert-based, observational, ...) | ||
| 59 | |||
| 60 | * Evaluations should result in insights regarding possible problems and | ||
| 61 | their causes in order to support refinement of your design specification | ||
| 62 | |||
| 63 | * Look at user experience in its full breadth: Effectiveness, efficiency, | ||
| 64 | satisfaction, learnability, mood, connectedness, ... | ||
| 65 | |||
| 66 | |||
| 67 | |||
| 68 | |||
| 69 |