Measuring Instruments

Quantitative data

In our experiments, we will only collect quantitative data, which will be condensed into a summative evaluation. Thus, we aim to focus on the effects that different designs have on the success rate of completing the task presented during the experiment, as well as the user's feelings while interacting with the system. To facilitate this, we have created a set of research questions and hypotheses which will be tested (presented in Evaluation - Test)

Objective measurements

In terms of objective measurements, we will simply count how many mistakes the user makes. In the evaluation, we plan on using a smarter robot, and a less smart robot. by comparing the number of mistakes between the two, we can quantify whether or not the "smarter" robot is actually so. In this context, the robot's "smartness" is an independent variable, and the number of mistakes is the variable which (we assume) depends on it.

Subjective measurements

Since there are already many tried and true methods of subjective evaluation, we will make use of those to evaluate the system. The system usability scale [citation] will be uses to assess how usable the users find the system to be. As a way of measuring whether the users are satisfies with the outcome, and to check how the interaction affects their mood, we will use a short, custom-made questionnaire which asks a few questions related to this.