Basics
Decide framework
DETERMINE THE GOALS
- What are the high-level goals of the evaluation?
- Who wants it and why?
- The goals influence the approach used for the study.
EXPLORE THE QUESTIONS
Define (sub)goals & (sub)research questions.
CHOOSE EVALUATION APPROACH &
METHODS
The evaluation approach influences the methods used, and in turn,
how data is collected, analyzed and presented
For example:
▪Select users.
▪Stay on budget.
▪Stay on schedule.
▪Find participants.
▪Select equipment.
Perform a pilot (trial) study!
GOOD EVALUATION
- Establishing convincing arguments for your design solution
- By conducting complementary and regular evaluations at different stages
of your design process using the appropriate evaluation methods
(e.g. summative, formative, expert-based, observational, ...)
- Evaluations should result in insights regarding possible problems and
their causes in order to support refinement of your design specification
- Look at user experience in its full breadth: Effectiveness, efficiency,
satisfaction, learnability, mood, connectedness, ...