Skip to Content

Changes for page Measuring Instruments

Last modified by Mathieu Jung-Muller on 2022/04/04 13:37
From version Icon 9.1
edited by Mathieu Jung-Muller
on 2022/04/04 13:37
Change comment: There is no comment for this version
To version Icon 7.1 Icon
edited by Haoran Wang
on 2022/03/17 09:59
Change comment: There is no comment for this version

Summary

Details

Icon Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.Mathieu
1 +XWiki.haoranwang
Content
... ... @@ -2,10 +2,8 @@
2 2  
3 3  Evaluation is an important part of product design and it can last from the beginning to the very end. In the Human-Computer Interaction field, product evaluation can help researchers to identify good and bad designs, determine how usable features are, discover new features that were neglected before, and compare design choices to assist us in making decisions.
4 4  
5 -= Frameworks =
6 -
7 -== DECIDE Framework ==
8 -
5 += Frameworks=
6 +=== DECIDE Framework===
9 9  **D**etermine the goals
10 10  
11 11  * What are the high-level goals of the evaluation?
... ... @@ -13,7 +13,7 @@
13 13  * The goals influence the approach used for the study.
14 14  In our evaluation, our goals are to check if the different stakeholders are able to use our prototype smoothly. Investigate how Pepper affects stakeholders' lives and try to use evaluation to improve our prototype.
15 15  
16 -**E**xplore the questions
14 +**E**xplore the questions ====
17 17   Define goals and research questions. Our research questions are:
18 18  
19 19  * Are the different stakeholders able to use our prototype smoothly?
... ... @@ -20,20 +20,20 @@
20 20  * Does the prototype allow the PwD greater autonomy in their day-to-day life?
21 21  * Does the prototype improve the emotional state of the PwD and their relatives?
22 22  
23 -**C**hoose the evaluation approach and methods
21 +**C**hoose the evaluation approach and methods ====
24 24   The evaluation approach influences the methods used, and in turn, how data is collected, analyzed, and presented.
25 25  
26 26  
27 -**I**dentify the practical issues
25 +**I**dentify the practical issues ====
28 28   In our case, the most important practical issue is to gather our classmates to do the evaluation. We do not have any real dented people to evaluate. Besides, we have to make a schedule about when to evaluate our prototype.
29 29  
30 -**D**ecide how to deal with ethical issues
28 +**D**ecide how to deal with ethical issues ====
31 31   Ethical issues are the basis of the evaluation. We would inform all participants about practical issues and make sure to get their consent before starting the evaluation. Users have the right to know their tasks, know what will happen to the collected data, stop participation and leave when they wish.
32 32  
33 -**E**valuate, analyze, interpret and present the data
31 +**E**valuate, analyze, interpret and present the data ====
34 34   How data is evaluated, analyzed, interpreted, and presented. To make the results reliable and valid, we have to consider biases, reliability, validity, scope, and ecological validity.
35 35  
36 -== IMPACT Framework ==
34 +=== IMPACT Framework===
37 37  **I**ntention: Clarify objectives and hypotheses/claims
38 38  **M**etrics & Measures: What, how and why
39 39  **P**eople: Target group & participants
... ... @@ -42,19 +42,18 @@
42 42  **T**echnologies: Hardware and software
43 43  
44 44  
45 -== Formative Evaluation ==
43 +===Formative Evaluation===
46 46  Focus on the various processes of the human-technology interaction
47 47  Derive open questions from the design specification.
48 48  
49 -== Summative Evaluation ==
47 +===Summative Evaluation===
50 50  Focuses on the overall effects of the human-technology interaction
51 51  Specify research questions and hypotheses based on claims.
52 52  
53 -
54 -= Data =
55 -
56 -== Qualitative Data ==
51 +===Data===
52 +====Qualitative Data====
57 57  Explore, discover, instruct
54 +
58 58  * Understand and interpret interactions
59 59  * Gain insight into views and perspectives
60 60  * Open-ended, like interviews and participant observations
... ... @@ -61,7 +61,7 @@
61 61  * Try to identify patterns, features, themes
62 62  * Study groups tend to be smaller
63 63  
64 -== Quantitative Data ==
61 +====Quantitative Data====
65 65  Describe, explain, predict
66 66  * Measure outcomes, test hypotheses, and make predictions
67 67  * Precise measurements
... ... @@ -68,8 +68,8 @@
68 68  * Identify statistical relationships
69 69  * Larger number of participants
70 70  
71 -= Experimental Design =
72 -== Within-subjects ==
68 +===Experimental Design===
69 +====Within-subjects====
73 73  Each participant, all conditions
74 74  * Few subjects needed
75 75  * Reduced variability
... ... @@ -76,7 +76,7 @@
76 76  * More statistical power
77 77  * Practice/fatigue effects
78 78  
79 -== Between-subjects ==
76 +====Between-subjects====
80 80  Each participant, one condition
81 81  * Simplicity
82 82  * Less chance of practice/fatigue effects