Frameworks

DECIDE

Determine the goals
- What are the high-level goals? Who wants it and why? The goals influence the approach of the study

Explore the questions
- Define the goals and reseach questions

Choose evaluation approach and methods
- Influences the data collection, analysis and presentation
- Exploratory research => qualitative data, observational study, 

Identify practical issues
- Users, budget, schedule, equipment etc.
- Pilot study important

Decide about ethical issues
- Adhere to ethical procedure
- User rights! Explain the goals (before/after), methodology etc.

Evaluate, analyze, interpret, present data
- Reliable results: Can the results be replicated?
- Validity: Is the data related to the hypothesis?
- Bias: Are the results unbiased?
- Scope: Can this be generalised?
- Ecological validity: Is the environment influencing the results?

IMPACT

Intention: Present the objectives and claims

Measures and metrics: "What, how and why"

People: Define the participants

Activities: Use cases into activities

Context: Social, ethical, physical, etc. environment definition

Technologies: Hardware and software