Changes for page SCE FAQ

Last modified by Dongxu Lu on 2023/03/21 12:20

From version 2.1
edited by Bart Vastenhouw
on 2022/08/24 20:54
Change comment: There is no comment for this version
To version 1.1
edited by Bart Vastenhouw
on 2022/08/24 20:52
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,138 +1,250 @@
1 -{{{<!DOCTYPE html>
2 -<html>
3 - <head>
4 - <title>SCE Guide : FAQ</title>
5 - <link rel="stylesheet" href="" type="text/css" />
6 - <META http-equiv="Content-Type" content="text/html; charset=UTF-8">
7 - </head>
1 += SCE Guide : FAQ =
8 8  
9 - <body class="theme-default aui-theme-default">
10 - <div id="page">
11 - <div id="main" class="aui-page-panel">
12 - <div id="main-header">
13 - <div id="breadcrumb-section">
14 - <ol id="breadcrumbs">
15 - <li class="first">
16 - <span><a href="">SCE Guide</a></span>
17 - </li>
18 - <li>
19 - <span><a href="">SCE Guide Home</a></span>
20 - </li>
21 - </ol>
22 - </div>
23 - <h1 id="title-heading" class="pagetitle">
24 - <span id="title-text">
25 - SCE Guide : FAQ
26 - </span>
27 - </h1>
28 - </div>
3 +Created by Mark Neerincx, last modified on 27 May, 2020
29 29  
30 - <div id="content" class="view">
31 - <div class="page-metadata">
32 -
33 -
34 -
35 -
36 -
37 -
38 -
39 - Created by <span class='author'> Mark Neerincx</span>, last modified on 27 May, 2020
40 - </div>
41 - <div id="main-content" class="wiki-content group">
42 - <p><style type='text/css'>/*<![CDATA[*/
43 -div.rbtoc1661366879474 {padding: 0px;}
44 -div.rbtoc1661366879474 ul {list-style: disc;margin-left: 0px;padding-left: 8px;}
45 -div.rbtoc1661366879474 li {margin-left: 0px;padding-left: 0px;}
46 46  
47 -/*]]>*/</style><div class='toc-macro rbtoc1661366879474'>
48 -<ul class='toc-indentation'>
49 -<li><span class='TOCOutline'>1</span> <a href=''>Workflow</a>
50 -<ul class='toc-indentation'>
51 -<li><span class='TOCOutline'>1.1</span> <a href=''>What should I do during a SCRUM sprint in a SCE process?</a></li>
52 -<li><span class='TOCOutline'>1.2</span> <a href=''>How do I know if my idea is relevant given the entire Research &amp; Development (R&amp;D) project?</a></li>
53 -</ul>
54 -</li>
55 -<li><span class='TOCOutline'>2</span> <a href=''>Confluence &amp; SCE</a>
56 -<ul class='toc-indentation'>
57 -<li><span class='TOCOutline'>2.1</span> <a href=''>On the meaning of Confluence and SCE concepts</a>
58 -<ul class='toc-indentation'>
59 -<li><span class='TOCOutline'>2.1.1</span> <a href=''>General</a>
60 -<ul class='toc-indentation'>
61 -<li><span class='TOCOutline'>2.1.1.1</span> <a href=''>What is SCE?</a></li>
62 -<li><span class='TOCOutline'>2.1.1.2</span> <a href=''>What is the System?</a></li>
63 -<li><span class='TOCOutline'>2.1.1.3</span> <a href=''>What is the Problem?</a></li>
64 -</ul>
65 -</li>
66 -<li><span class='TOCOutline'>2.1.2</span> <a href=''>Foundation</a>
67 -<ul class='toc-indentation'>
68 -<li><span class='TOCOutline'>2.1.2.1</span> <a href=''>What is the Foundation?</a></li>
69 -<li><span class='TOCOutline'>2.1.2.2</span> <a href=''>What are the Operational Demands?</a></li>
70 -<li><span class='TOCOutline'>2.1.2.3</span> <a href=''>What are the Stakeholders?</a></li>
71 -<li><span class='TOCOutline'>2.1.2.4</span> <a href=''>What are the Tasks?</a></li>
72 -<li><span class='TOCOutline'>2.1.2.5</span> <a href=''>What are the Personas?</a></li>
73 -<li><span class='TOCOutline'>2.1.2.6</span> <a href=''>What is the Problem Scenario?</a></li>
74 -<li><span class='TOCOutline'>2.1.2.7</span> <a href=''>What are the Human Factors?</a></li>
75 -<li><span class='TOCOutline'>2.1.2.8</span> <a href=''>What is the Human Factors Knowledge?</a></li>
76 -<li><span class='TOCOutline'>2.1.2.9</span> <a href=''>What are Measures?</a></li>
77 -<li><span class='TOCOutline'>2.1.2.10</span> <a href=''>What are the Design Patterns?</a></li>
78 -<li><span class='TOCOutline'>2.1.2.11</span> <a href=''>What is Technology?</a></li>
79 -</ul>
80 -</li>
81 -<li><span class='TOCOutline'>2.1.3</span> <a href=''>Specification</a>
82 -<ul class='toc-indentation'>
83 -<li><span class='TOCOutline'>2.1.3.1</span> <a href=''>What is the Specification?</a></li>
84 -<li><span class='TOCOutline'>2.1.3.2</span> <a href=''>What are Objectives?</a></li>
85 -<li><span class='TOCOutline'>2.1.3.3</span> <a href=''>What are Design Scenarios?</a></li>
86 -<li><span class='TOCOutline'>2.1.3.4</span> <a href=''>What are Use Cases?</a></li>
87 -<li><span class='TOCOutline'>2.1.3.5</span> <a href=''>What are Requirements?</a></li>
88 -<li><span class='TOCOutline'>2.1.3.6</span> <a href=''>What are Claims?</a></li>
89 -<li><span class='TOCOutline'>2.1.3.7</span> <a href=''>What is the difference between Foundation and Specification?</a></li>
90 -<li><span class='TOCOutline'>2.1.3.8</span> <a href=''>When does something from the Specification move to the Foundation?</a></li>
91 -</ul>
92 -</li>
93 -<li><span class='TOCOutline'>2.1.4</span> <a href=''>Evaluation</a>
94 -<ul class='toc-indentation'>
95 -<li><span class='TOCOutline'>2.1.4.1</span> <a href=''>What are Evaluations?</a></li>
96 -<li><span class='TOCOutline'>2.1.4.2</span> <a href=''>What are Artefacts?</a></li>
97 -<li><span class='TOCOutline'>2.1.4.3</span> <a href=''>What are Evaluation Methods?</a></li>
98 -<li><span class='TOCOutline'>2.1.4.4</span> <a href=''>What are Evaluation Results?</a></li>
99 -<li><span class='TOCOutline'>2.1.4.5</span> <a href=''>How does an Evaluation lead to a change in the Foundation?</a></li>
100 -<li><span class='TOCOutline'>2.1.4.6</span> <a href=''>How does an Evaluation lead to a change in the Specification?</a></li>
101 -</ul>
102 -</li>
103 -<li><span class='TOCOutline'>2.1.5</span> <a href=''>Ontology</a>
104 -<ul class='toc-indentation'>
105 -<li><span class='TOCOutline'>2.1.5.1</span> <a href=''>What is the Ontology?</a></li>
106 -</ul>
107 -</li>
108 -</ul>
109 -</li>
110 -<li><span class='TOCOutline'>2.2</span> <a href=''>On how to add content to Confluence</a>
111 -<ul class='toc-indentation'>
112 -<li><span class='TOCOutline'>2.2.1</span> <a href=''>Where should I put &lt;this&gt; in Confluence?</a></li>
113 -</ul>
114 -</li>
115 -<li><span class='TOCOutline'>2.3</span> <a href=''>Practical things on how to do stuff</a>
116 -<ul class='toc-indentation'>
117 -<li><span class='TOCOutline'>2.3.1</span> <a href=''>How do I refer to Jira Stories within a Confluence page?</a></li>
118 -<li><span class='TOCOutline'>2.3.2</span> <a href=''>How do I add labels to a Confluence page and why should I do this?</a></li>
119 -</ul>
120 -</li>
121 -</ul>
122 -</li>
123 -</ul>
124 -</div></p><h2 id="FAQ-Workflow">Workflow</h2><h6 id="FAQ-WhatshouldIdoduringaSCRUMsprintinaSCEprocess?">What should I do during a SCRUM sprint in a SCE process?</h6><p>Go ask your scrum master if you do not know what to do. For example, because you are new to the team, just completed your previous tasks, are unsure where your current research interests match or you do not know what should be prioritized. Make some agreements with your scrum master on this, and make sure your own interests are covered.</p><p>This means that you have to be clear with what you want to work on, and your scrum master to have an overview of priorities and potential gaps in work.</p><h6 id="FAQ-HowdoIknowifmyideaisrelevantgiventheentireResearch&amp;Development(R&amp;D)project?">How do I know if my idea is relevant given the entire Research &amp; Development (R&amp;D) project?</h6><p>If you have an idea for research or implementation, walk through these three steps:</p><p>1) Discuss your idea first with one or two others within the team. Make sure that you have a clear grasp of what your idea is.</p><p>2) Plan during the drift a meeting with the Scrum Master and Product Owner where you pitch your idea.</p><p>3) Both the Scrum Master and Product Owner can give you a go or no-go for your idea. If it is a go, the idea can be written in one or more User Stories and added to the backlog (note that this does not mean you can work on it next sprint, this depends on the sprint planning).</p><h2 id="FAQ-Confluence&amp;SCE">Confluence &amp; SCE</h2><h3 id="FAQ-OnthemeaningofConfluenceandSCEconcepts">On the meaning of Confluence and SCE concepts</h3><h4 id="FAQ-General">General</h4><h6 id="FAQ-WhatisSCE?">What is SCE?</h6><p>SCE stands for Socio-Cognitive Engineering. The SCE method entails an iterative incremental research and development (R&amp;D) process of human-agent systems with an explicit description of the design rationale (<a href="" rel="nofollow">source</a>). What does this mean? It means that it offers a way to do research and development to solve real-world problems that entails systems where humans and intelligent systems interact. It offers a way to do this while explicitly describing how researchers and developers came to the specific design of the entire system. By this the method tries to ensure a way of engineering that takes the human, technology and context systematically into account, all design steps are documented (not only results and benefits but also the upsides and downsides) and the underlying knowledge that was used to develop the entire system.</p><p>It is important to know that the SCE method regards the engineering of a specific system for a specific problem.</p><p>There are also some examples at <a href="">SCE Example Home</a>.</p><h6 id="FAQ-WhatistheSystem?">What is the System?</h6><p>SCE aims at the development of a joint Human-Machine System (e.g., explicating both the human and machine tasks and the task allocation process). The &quot;machine&quot; is the actual software and/or hardware that is designed, being designed, or planned to be designed in the near future. It is that which solves a concrete and specific problem, it may (and most likely does) do so by relying on existing generic technologies.</p><h6 id="FAQ-WhatistheProblem?">What is the Problem?</h6><p>The Problem is an actual and specific issue a group or multiple groups of people (with current technology) come across when living or doing their job (e.g. a fall prevention and assistance system for elderly). In addition it may entail potential future issues that are foreseen due to some reasons (e.g. a system to remedy energy shortage due to climate changes and current industry).</p><h4 id="FAQ-Foundation">Foundation</h4><h6 id="FAQ-WhatistheFoundation?">What is the Foundation?</h6><p>The Foundation contains the information (knowledge, models, methods, tools, ...)  required to design and build a specific system.</p><p>Foundation is a segment within the SCE method. The SCE method is about describing the design of a specific system for a specific problem. However, the method acknowledges that to do so, a certain amount of knowledge, experience and tools are required. These form the foundation of the specific system that is or will be developed. It not only includes an overview of literature and current systems, but may just as well include new research and technologies that were developed for the specific system. As long has this information is in some way more generic and reusable (i.e., not only applicable to the system being designed), it belongs to the Foundation. In addition, it contains a description of the current status quo relevant to the specific system (e.g. a problem statement, challenges, overview of user groups, etc.).</p><h6 id="FAQ-WhataretheOperationalDemands?">What are the Operational Demands?</h6><p><span>The O</span><span>perational Demands</span><span> describe the current practice as it is without the to be designed system and related technologies</span><span>. For the operational demands, the SCE method prescribes as main </span>components the stakeholders and their characteristics, and the problem description and <span>analysis thereof. As such this segment of SCE provides an overview of all that is relevant to the problem the intended system will ideally solve. Note that there nowhere is required to give an exhaustive list of such 'demands'. These are encapsulated in the descriptions of stakeholders and problem descriptions. </span></p><h6 id="FAQ-WhataretheStakeholders?">What are the Stakeholders?</h6><p><span>There are two kinds of Stakeholders: Direct Stakeholders and Indirect Stakeholders. In general a stakeholder is a person (or organization) who is related to the system we are designing and developing. A Direct Stakeholder is, as the name implies, someone who is directly related to the system. Normally these are the users. An Indirect Stakeholder is someone who has some benefit of the system but does so in an indirect way. For example, in the design of system that prevents elderly from falling the elderly are direct stakeholders whereas their family members and insurance companies are indirect stakeholders. A Stakeholder description should explain as specific as reasonably possible who these people are in the form of a general profile, but also what their values are and their relation to other stakeholders.  <br/></span></p><h6 id="FAQ-WhataretheTasks?">What are the Tasks?</h6><p>A Task is a certain action or sequence of actions a Stakeholder group generally goes through to achieve a certain goal. By documenting these actions it becomes easier, as a system designer, to think of the things a system should (still) allow in some form or another. These tasks can be small (e.g. opening a door as an elderly) or large (walking the dog as an elderly).</p><h6 id="FAQ-WhatarethePersonas?">What are the Personas?</h6><p>The Persona is a term used in User Experience Design (UX-Design). It is a tool for system designers to bring life to a stakeholder group as it provides a detailed description of a single (fictive) member of that group. They offer information a system designer or developer can use to think of the requirements and effects a certain system functionality may have. For example, when designing a system to prevent elderly from falling, two personas can be made: Andrew who likes to walk and be active and Sarah who loves to read on her balcony. Both personas offer a concrete information of putting the (intended) system in a context in which it may be used. This allows designers to think how certain functionality would work out.</p><p>There is plenty of material on personas, for example <a class="external-link" href="" rel="nofollow">this wikipedia page</a>.</p><h6 id="FAQ-WhatistheProblemScenario?">What is the Problem Scenario?</h6><p><span>A pro</span><span>blem scenario provides a short story-line to </span><span>illustrate the way in which stakeholders experience a problem. This story-line is allowed, and even preferred, to be specific. This means that it can literally be a small story about a specific stakeholder (e.g. a persona named &quot;Andrew&quot;) that has to deal with the problem the system has to solve. This makes it a scenario, instead of a mere definition. A story form ensures that the problem is grounded in specific (hypothetical) situations and issues the stakeholder group(s) run into given the current status quo. Since a problem can encapsulate many different issues and it may not be the same problem for every person, multiple problem scenarios can, and preferably should, be defined.<br/></span></p><p><span>In addition, any relevant information to the problem scenarios can also be provided under this segment. See these as a kind of appendices containing additional contextual information, although not specifically in the form of a story (e.g. a summary and link to an elaborate user experience study on which one or more problem scenarios were based).</span></p><h6 id="FAQ-WhataretheHumanFactors?">What are the Human Factors?</h6><p><span>The </span><span>Human Factors</span><span> segment of the SCE method describes the available relevant </span><span>knowledge about, for instance, human cognition, performance, task support, learning, </span><span>human-</span><span>machine interaction, ergonomics, etc. The three constituents important to the human factors analysis are: (a) the human factors knowledge (theories, models, methods, tools), (b) measuring instruments, and (c) interaction design patterns. The three constituents important to the human factors analysis are: (a) the human factors knowledge, (b) measures, and (c) interaction design patterns.<br/></span></p><p><span>Note that we emphasize that this knowledge should be relevant for the problem and its design solution: the knowledge described here should lead to a better understanding of what the system should support and how it should function.<br/></span></p><h6 id="FAQ-WhatistheHumanFactorsKnowledge?">What is the Human Factors Knowledge?</h6><p><span>The Human factors knowledge </span><span>describes available knowledge coming from previous research </span><span>about how to solve the problems that have been identified.<br/></span></p><h6 id="FAQ-WhatareMeasures?">What are Measures?</h6><p><span>The Measures</span><span> describe how to operationalize the quality of the usage of the system</span><span>, i.e. how well is a stakeholder working with the design able to reach his/her </span><span>objectives and what is the quality of the collaboration between the human and the </span><span>system?</span></p><h6 id="FAQ-WhataretheDesignPatterns?">What are the Design Patterns?</h6><p><span>Design Patterns</span><span> (DPs) </span><span>offer generic solutions to recurring </span><span>design problems that have been proven to be effective. DPs can fall under different categories, such as Interaction Design Patterns that focus on things as usable interface design and control options or Human-Agent Team Design Patterns that focus on things such as how humans and agents can collaborate effectively through information sharing. </span><span>DPs are often made available in </span><span>repositories.</span></p><h6 id="FAQ-WhatisTechnology?">What is Technology?</h6><p>The Technology segment encompasses both Current Technology as well as Envisioned Technology. The Current Technology includes software and hardware that is already out there which is generic enough to be applied to the system that is being designed and described. For example, wearable activity sensors and their software APIs. The Envisioned Technology includes software and hardware that is envisioned to be required for the intended system to be able to function. For example, a certain software package to detect a specific type of biases in data and AI models. An important property of the Envisioned Technology is that it is in essence applicable to more than just the intended system: It encompasses a (substantive) portion of research that was committed in light of the intended system but which is applicable to more than just that.</p><p>It is important to remember that when an Envisioned Technology is developed, it becomes Current Technology. As such, there is no clear distinction made between these two in the Confluence Space.</p><h4 id="FAQ-Specification">Specification</h4><h6 id="FAQ-WhatistheSpecification?">What is the Specification?</h6><p><span>The </span><span>Specification </span><span>describes a solution to the problem that is documented in the Foundation. It describes this solution in the form of a </span><span>system design that makes use of the identified problems, relevant human factors and current and/or envisioned </span><span>technology. The main thing to remember is that the Specification is specific to a problem and system implementation. Hence all which is stated in this segment relates to these two specific things. Anything that is more generically applicable (whether it already existed or was developed) forms the foundation of the system and thus belongs in the Foundation.</span></p><p><span>The system specification consists of objectives, design scenarios, </span><span>actors and use cases, requirements, and claims.<br/></span></p><h6 id="FAQ-WhatareObjectives?">What are Objectives?</h6><p><span style="color: rgb(0,0,0);">An Objective describes what is tried to be achieved with the system. This is different than a Requirement, as this specifies what the system should be capable of. Instead, an Objective describes an end-state of the joint cognitive system (e.g., an unbiased classification or a well-calibrated level of trust) and, possibly, the overall desired way to achieve this end-state (e.g. a hybrid-AI approach that utilizes knowledge- and data-driven approaches to the fullest).</span></p><h6 id="FAQ-WhatareDesignScenarios?">What are Design Scenarios?</h6><p><span>The Design Scenarios are </span><span>short descriptive stories that provide a clear description of how a persona will work wi</span><span>th the technology </span><span>thereby showing (a) the solution offered to one of the problem scenarios and (b) its expected beneficial effects . Thus, design scenarios are closely related to problem scenarios: they preferably can be the same story but a design scenario tells it from the perspective where the persona uses the system that is being designed. </span><span> Together, the </span><span>problem and design scenarios provide a contextualized view on what the problem is, who encounters it, how the system will solve it and how the system is being used in the process.</span></p><h6 id="FAQ-WhatareUseCases?">What are Use Cases?</h6><p>A Use Case is a step-by-step interaction description between one or more personas and the system. It commonly describes this in the form of a narrative which depicts for every action the persona(s) and system perform, however it does not state anything on how this is actually done.</p><h6 id="FAQ-WhatareRequirements?">What are Requirements?</h6><p>The Requirements are specific functional descriptions of what the system should be capable of.</p><h6 id="FAQ-WhatareClaims?">What are Claims?</h6><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">The Claims are statements that explain what the system should support or achieve with a given functionality. </span><br/></span></p><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);"><span>This explicit linking of requirements to claims enables designers to formulate hypotheses </span><span>that need to be tested in system evaluations to justify the adoption of the functional </span><span>requirement</span>. <span>If the claim cannot be </span><span>proven to be valid through system evaluations, the designers need to refine their system </span><span>design, for instance, by trying to improve the functionality, replacing the functionality w</span><span>ith </span><span>a different one, or dropping the functionality and the claim altogether (i.e. by deciding that </span><span>the objective is not reachable at this point). Either way, there is no use of including a </span><span>functionality that does not achieve its underlying claims. </span></span></span></p><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);"><span>Design decisions are often the outcome of weighting the pro's and con's of the design choice, Therefore, claims explicate the trade-off by specifying the expected upsides and the downsides that might occur (at the end, it should be justified that the upsides are higher than the downsides, e.g. in an empirical experiment with the end-users).</span></span></span></p><p>Ideally, a Claim is not only linked to a Requirement but also a Measurement Instrument from the Foundation segment. There can be one or more measurements that are needed to evaluate the claim.</p><h6 id="FAQ-WhatisthedifferencebetweenFoundationandSpecification?">What is the difference between Foundation and Specification?</h6><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">The Foundation segment is the place where all relevant information is documented regarding the problem, context, humans, technologies and more. The relevance is determined by what is needed to design a specific system.</span><br/></span></p><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">The Specification segment is the place where all relevant information is documented regarding the solution, requirements, claims and more. The relevance is determined whether it describes the system that is being designed or not.</span></span></p><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">Hence, the Foundation contains the actual foundational knowledge needed to specify the system in the Specification.</span></span></p><h6 id="FAQ-WhendoessomethingfromtheSpecificationmovetotheFoundation?">When does something from the Specification move to the Foundation?</h6><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">The SCE method supports an iterative design process. It does so in several ways, but one of these is that developed functionality can lead to generic technologies being developed and evaluated. Functionality is described in a Requirement so it may happen that much of the (new or generic) content of a Requirement is relocated to the Technology portion of the Foundation. </span><br/></span></p><h4 id="FAQ-Evaluation">Evaluation</h4><h6 id="FAQ-WhatareEvaluations?">What are Evaluations?</h6><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">An <span>Evaluation aims to </span><span>test and validate the system’s design, or to discriminate between multiple design options, </span><span>such that the current design can be improved upon in incremental development cycles. Note that this entails both user evaluations as well as technical performance evaluations.<br/></span></span></span></p><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);"><span>Ideally, an evaluation contains an artefact (prototype), evaluation method and evaluation results and can be constructed iteratively. For example, when setting up a first evaluation one may start with describing the artefact and method and later add the results.</span></span><br/></span></p><h6 id="FAQ-WhatareArtefacts?">What are Artefacts?</h6><p><span>An A</span><span>rtefact</span><span> is an implementation or prototype that incorporates a given set of </span><span>requirements, interaction design patterns, and technological means. An Artefact can be the full system, but is often only a portion of it to allow for a controlled evaluation. Often the Artefact links to a set of Requirements that will be tested.<br/></span></p><h6 id="FAQ-WhatareEvaluationMethods?">What are Evaluation Methods?</h6><p><span>An </span><span>Evaluation Method is a general description of how an evaluation is or will be construed. It </span><span>can take many forms, such as a human-in</span><span>-the-loop study, a use-</span><span>case</span><span>-based simulation, or an expert review but also more technological methods such as a test of robustness, accuracy, and speed. Ideally, a evaluation method refers to the Claim(s) it tries to evaluate and indirectly the Measurement(s) it will use for that (indirectly, because a Claim links to the Measurements).<br/></span></p><h6 id="FAQ-WhatareEvaluationResults?">What are Evaluation Results?</h6><p>An Evaluation Result describes the outcomes of an applied evaluation method. Preferably, it also documents potential changes to the Foundation and/or Specification that resulted from these results.</p><h6 id="FAQ-HowdoesanEvaluationleadtoachangeintheFoundation?">How does an Evaluation lead to a change in the Foundation?</h6><p><span style="color: rgb(255,0,0);"><span style="color: rgb(0,0,0);">An evaluation may result in new knowledge about the problem, stakeholders, technologies or other topics described in the Foundation. As such, an evaluation can lead to changes or additions to the Foundation.</span><br/></span></p><h6 id="FAQ-HowdoesanEvaluationleadtoachangeintheSpecification?">How does an Evaluation lead to a change in the Specification?</h6><p>An evaluation may disprove a certain claim. In this case, the linked Claim and Requirements that reside in the Specification segment, need to be updated or even removed all together. There is no sense in keeping a Requirement whose claim is disproved.</p><h4 id="FAQ-Ontology">Ontology</h4><h6 id="FAQ-WhatistheOntology?">What is the Ontology?</h6><p><span style="color: rgb(0,0,0);">The SCE methodology prescribes the construction of an ontology; a vocabulary describing a common language to be used throughout the system specification to avoid miscommunication, misunderstanding, and inconsistencies.</span></p><p><span style="color: rgb(0,0,0);">This segment may also be used to document data structures, however it is important to clearly separate such ontologies from the ontology used by the team itself.</span></p><h3 id="FAQ-OnhowtoaddcontenttoConfluence">On how to add content to Confluence</h3><h6 id="FAQ-WhereshouldIput&lt;this&gt;inConfluence?">Where should I put &lt;this&gt; in Confluence?</h6><p>Try to find it right place by looking at the questions on this page or to the SCE example. If you are still not sure, add it to the place you think it belongs to and ask the Confluence project space coordinator, whether it is the correct spot for it (with a link to your page). He or she can advise you on this.</p><h3 id="FAQ-Practicalthingsonhowtodostuff">Practical things on how to do stuff</h3><h6 id="FAQ-HowdoIrefertoJiraStorieswithinaConfluencepage?">How do I refer to Jira Stories within a Confluence page?</h6><p>When editing a page, you can insert a link to most Jira Issues (these include: Stories, Tasks, etc) by using the regular 'insert' functionality: the &quot;+&quot; on top of your editor. Next, you can search in the linked Jira repository on the issue you wish to link to. This will create an automatic link from that page to the Jira Issue you chose to link.</p><h6 id="FAQ-HowdoIaddlabelstoaConfluencepageandwhyshouldIdothis?">How do I add labels to a Confluence page and why should I do this?</h6><p>You can add one or more labels to any page by scrolling down and clicking on the label icon. This opens op a window in which you can add a new label. Labels are useful. You can search on them (click on the search box and select 'Labels') but can also link multiple pages under one category. For example the label 'help' can be added to any page and by simply clicking on that label or searching for it you have an overview of all help-related topics. Similar things could be achieved to link pages on categories (e.g. &quot;XAI&quot; or &quot;Bias&quot;) or progress (e.g. &quot;Done&quot; or &quot;In Progress&quot;).</p><p><br/></p><p><br/></p><p><br/></p><p><br/></p><p><br/></p>
125 - </div>
6 +* 1 [[Workflow>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Workflow]]
7 +** 1.1 [[What should I do during a SCRUM sprint in a SCE process?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatshouldIdoduringaSCRUMsprintinaSCEprocess?]]
8 +** 1.2 [[How do I know if my idea is relevant given the entire Research & Development (R&D) project?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-HowdoIknowifmyideaisrelevantgiventheentireResearch&Development(R&D)project?]]
9 +* 2 [[Confluence & SCE>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Confluence&SCE]]
10 +** 2.1 [[On the meaning of Confluence and SCE concepts>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-OnthemeaningofConfluenceandSCEconcepts]]
11 +*** 2.1.1 [[General>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-General]]
12 +**** 2.1.1.1 [[What is SCE?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatisSCE?]]
13 +**** 2.1.1.2 [[What is the System?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheSystem?]]
14 +**** 2.1.1.3 [[What is the Problem?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheProblem?]]
15 +*** 2.1.2 [[Foundation>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Foundation]]
16 +**** 2.1.2.1 [[What is the Foundation?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheFoundation?]]
17 +**** 2.1.2.2 [[What are the Operational Demands?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhataretheOperationalDemands?]]
18 +**** 2.1.2.3 [[What are the Stakeholders?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhataretheStakeholders?]]
19 +**** 2.1.2.4 [[What are the Tasks?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhataretheTasks?]]
20 +**** 2.1.2.5 [[What are the Personas?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatarethePersonas?]]
21 +**** 2.1.2.6 [[What is the Problem Scenario?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheProblemScenario?]]
22 +**** 2.1.2.7 [[What are the Human Factors?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhataretheHumanFactors?]]
23 +**** 2.1.2.8 [[What is the Human Factors Knowledge?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheHumanFactorsKnowledge?]]
24 +**** 2.1.2.9 [[What are Measures?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareMeasures?]]
25 +**** 2.1.2.10 [[What are the Design Patterns?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhataretheDesignPatterns?]]
26 +**** 2.1.2.11 [[What is Technology?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatisTechnology?]]
27 +*** 2.1.3 [[Specification>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Specification]]
28 +**** 2.1.3.1 [[What is the Specification?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheSpecification?]]
29 +**** 2.1.3.2 [[What are Objectives?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareObjectives?]]
30 +**** 2.1.3.3 [[What are Design Scenarios?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareDesignScenarios?]]
31 +**** 2.1.3.4 [[What are Use Cases?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareUseCases?]]
32 +**** 2.1.3.5 [[What are Requirements?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareRequirements?]]
33 +**** 2.1.3.6 [[What are Claims?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareClaims?]]
34 +**** 2.1.3.7 [[What is the difference between Foundation and Specification?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatisthedifferencebetweenFoundationandSpecification?]]
35 +**** 2.1.3.8 [[When does something from the Specification move to the Foundation?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhendoessomethingfromtheSpecificationmovetotheFoundation?]]
36 +*** 2.1.4 [[Evaluation>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Evaluation]]
37 +**** 2.1.4.1 [[What are Evaluations?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareEvaluations?]]
38 +**** 2.1.4.2 [[What are Artefacts?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareArtefacts?]]
39 +**** 2.1.4.3 [[What are Evaluation Methods?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareEvaluationMethods?]]
40 +**** 2.1.4.4 [[What are Evaluation Results?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatareEvaluationResults?]]
41 +**** 2.1.4.5 [[How does an Evaluation lead to a change in the Foundation?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-HowdoesanEvaluationleadtoachangeintheFoundation?]]
42 +**** 2.1.4.6 [[How does an Evaluation lead to a change in the Specification?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-HowdoesanEvaluationleadtoachangeintheSpecification?]]
43 +*** 2.1.5 [[Ontology>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Ontology]]
44 +**** 2.1.5.1 [[What is the Ontology?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhatistheOntology?]]
45 +** 2.2 [[On how to add content to Confluence>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-OnhowtoaddcontenttoConfluence]]
46 +*** 2.2.1 [[Where should I put <this~> in Confluence?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-WhereshouldIput<this>inConfluence?]]
47 +** 2.3 [[Practical things on how to do stuff>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-Practicalthingsonhowtodostuff]]
48 +*** 2.3.1 [[How do I refer to Jira Stories within a Confluence page?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-HowdoIrefertoJiraStorieswithinaConfluencepage?]]
49 +*** 2.3.2 [[How do I add labels to a Confluence page and why should I do this?>>url:file:///Users/bart/Downloads/SG/FAQ_76644432.html#FAQ-HowdoIaddlabelstoaConfluencepageandwhyshouldIdothis?]]
126 126  
127 -
128 -
129 - </div> </div>
130 - <div id="footer" role="contentinfo">
131 - <section class="footer-body">
132 - <p>Document generated by Confluence on 24 Aug, 2022 20:47</p>
133 - <div id="footer-logo"><a href="">Atlassian</a></div>
134 - </section>
135 - </div>
136 - </div> </body>
137 -</html>
138 -}}}
51 +
52 +== Workflow ==
53 +
54 +====== What should I do during a SCRUM sprint in a SCE process? ======
55 +
56 +Go ask your scrum master if you do not know what to do. For example, because you are new to the team, just completed your previous tasks, are unsure where your current research interests match or you do not know what should be prioritized. Make some agreements with your scrum master on this, and make sure your own interests are covered.
57 +
58 +This means that you have to be clear with what you want to work on, and your scrum master to have an overview of priorities and potential gaps in work.
59 +
60 +====== How do I know if my idea is relevant given the entire Research & Development (R&D) project? ======
61 +
62 +If you have an idea for research or implementation, walk through these three steps:
63 +
64 +1) Discuss your idea first with one or two others within the team. Make sure that you have a clear grasp of what your idea is.
65 +
66 +2) Plan during the drift a meeting with the Scrum Master and Product Owner where you pitch your idea.
67 +
68 +3) Both the Scrum Master and Product Owner can give you a go or no-go for your idea. If it is a go, the idea can be written in one or more User Stories and added to the backlog (note that this does not mean you can work on it next sprint, this depends on the sprint planning).
69 +
70 +== Confluence & SCE ==
71 +
72 +=== On the meaning of Confluence and SCE concepts ===
73 +
74 +==== General ====
75 +
76 +====== What is SCE? ======
77 +
78 +SCE stands for Socio-Cognitive Engineering. The SCE method entails an iterative incremental research and development (R&D) process of human-agent systems with an explicit description of the design rationale ([[source>>url:https://confluence.ewi.tudelft.nl/display/SE/SCE+Example+Home]]). What does this mean? It means that it offers a way to do research and development to solve real-world problems that entails systems where humans and intelligent systems interact. It offers a way to do this while explicitly describing how researchers and developers came to the specific design of the entire system. By this the method tries to ensure a way of engineering that takes the human, technology and context systematically into account, all design steps are documented (not only results and benefits but also the upsides and downsides) and the underlying knowledge that was used to develop the entire system.
79 +
80 +It is important to know that the SCE method regards the engineering of a specific system for a specific problem.
81 +
82 +There are also some examples at [[SCE Example Home>>url:https://confluence.ewi.tudelft.nl/display/SE/SCE+Example+Home]].
83 +
84 +====== What is the System? ======
85 +
86 +SCE aims at the development of a joint Human-Machine System (e.g., explicating both the human and machine tasks and the task allocation process). The "machine" is the actual software and/or hardware that is designed, being designed, or planned to be designed in the near future. It is that which solves a concrete and specific problem, it may (and most likely does) do so by relying on existing generic technologies.
87 +
88 +====== What is the Problem? ======
89 +
90 +The Problem is an actual and specific issue a group or multiple groups of people (with current technology) come across when living or doing their job (e.g. a fall prevention and assistance system for elderly). In addition it may entail potential future issues that are foreseen due to some reasons (e.g. a system to remedy energy shortage due to climate changes and current industry).
91 +
92 +==== Foundation ====
93 +
94 +====== What is the Foundation? ======
95 +
96 +The Foundation contains the information (knowledge, models, methods, tools, ...)  required to design and build a specific system.
97 +
98 +Foundation is a segment within the SCE method. The SCE method is about describing the design of a specific system for a specific problem. However, the method acknowledges that to do so, a certain amount of knowledge, experience and tools are required. These form the foundation of the specific system that is or will be developed. It not only includes an overview of literature and current systems, but may just as well include new research and technologies that were developed for the specific system. As long has this information is in some way more generic and reusable (i.e., not only applicable to the system being designed), it belongs to the Foundation. In addition, it contains a description of the current status quo relevant to the specific system (e.g. a problem statement, challenges, overview of user groups, etc.).
99 +
100 +====== What are the Operational Demands? ======
101 +
102 +The Operational Demands describe the current practice as it is without the to be designed system and related technologies. For the operational demands, the SCE method prescribes as main components the stakeholders and their characteristics, and the problem description and analysis thereof. As such this segment of SCE provides an overview of all that is relevant to the problem the intended system will ideally solve. Note that there nowhere is required to give an exhaustive list of such 'demands'. These are encapsulated in the descriptions of stakeholders and problem descriptions.
103 +
104 +====== What are the Stakeholders? ======
105 +
106 +There are two kinds of Stakeholders: Direct Stakeholders and Indirect Stakeholders. In general a stakeholder is a person (or organization) who is related to the system we are designing and developing. A Direct Stakeholder is, as the name implies, someone who is directly related to the system. Normally these are the users. An Indirect Stakeholder is someone who has some benefit of the system but does so in an indirect way. For example, in the design of system that prevents elderly from falling the elderly are direct stakeholders whereas their family members and insurance companies are indirect stakeholders. A Stakeholder description should explain as specific as reasonably possible who these people are in the form of a general profile, but also what their values are and their relation to other stakeholders.
107 +
108 +====== What are the Tasks? ======
109 +
110 +A Task is a certain action or sequence of actions a Stakeholder group generally goes through to achieve a certain goal. By documenting these actions it becomes easier, as a system designer, to think of the things a system should (still) allow in some form or another. These tasks can be small (e.g. opening a door as an elderly) or large (walking the dog as an elderly).
111 +
112 +====== What are the Personas? ======
113 +
114 +The Persona is a term used in User Experience Design (UX-Design). It is a tool for system designers to bring life to a stakeholder group as it provides a detailed description of a single (fictive) member of that group. They offer information a system designer or developer can use to think of the requirements and effects a certain system functionality may have. For example, when designing a system to prevent elderly from falling, two personas can be made: Andrew who likes to walk and be active and Sarah who loves to read on her balcony. Both personas offer a concrete information of putting the (intended) system in a context in which it may be used. This allows designers to think how certain functionality would work out.
115 +
116 +There is plenty of material on personas, for example [[this wikipedia page>>url:https://en.wikipedia.org/wiki/Persona_(user_experience)]].
117 +
118 +====== What is the Problem Scenario? ======
119 +
120 +A problem scenario provides a short story-line to illustrate the way in which stakeholders experience a problem. This story-line is allowed, and even preferred, to be specific. This means that it can literally be a small story about a specific stakeholder (e.g. a persona named "Andrew") that has to deal with the problem the system has to solve. This makes it a scenario, instead of a mere definition. A story form ensures that the problem is grounded in specific (hypothetical) situations and issues the stakeholder group(s) run into given the current status quo. Since a problem can encapsulate many different issues and it may not be the same problem for every person, multiple problem scenarios can, and preferably should, be defined.
121 +
122 +In addition, any relevant information to the problem scenarios can also be provided under this segment. See these as a kind of appendices containing additional contextual information, although not specifically in the form of a story (e.g. a summary and link to an elaborate user experience study on which one or more problem scenarios were based).
123 +
124 +====== What are the Human Factors? ======
125 +
126 +The Human Factors segment of the SCE method describes the available relevant knowledge about, for instance, human cognition, performance, task support, learning, human-machine interaction, ergonomics, etc. The three constituents important to the human factors analysis are: (a) the human factors knowledge (theories, models, methods, tools), (b) measuring instruments, and (c) interaction design patterns. The three constituents important to the human factors analysis are: (a) the human factors knowledge, (b) measures, and (c) interaction design patterns.
127 +
128 +Note that we emphasize that this knowledge should be relevant for the problem and its design solution: the knowledge described here should lead to a better understanding of what the system should support and how it should function.
129 +
130 +====== What is the Human Factors Knowledge? ======
131 +
132 +The Human factors knowledge describes available knowledge coming from previous research about how to solve the problems that have been identified.
133 +
134 +====== What are Measures? ======
135 +
136 +The Measures describe how to operationalize the quality of the usage of the system, i.e. how well is a stakeholder working with the design able to reach his/her objectives and what is the quality of the collaboration between the human and the system?
137 +
138 +====== What are the Design Patterns? ======
139 +
140 +Design Patterns (DPs) offer generic solutions to recurring design problems that have been proven to be effective. DPs can fall under different categories, such as Interaction Design Patterns that focus on things as usable interface design and control options or Human-Agent Team Design Patterns that focus on things such as how humans and agents can collaborate effectively through information sharing. DPs are often made available in repositories.
141 +
142 +====== What is Technology? ======
143 +
144 +The Technology segment encompasses both Current Technology as well as Envisioned Technology. The Current Technology includes software and hardware that is already out there which is generic enough to be applied to the system that is being designed and described. For example, wearable activity sensors and their software APIs. The Envisioned Technology includes software and hardware that is envisioned to be required for the intended system to be able to function. For example, a certain software package to detect a specific type of biases in data and AI models. An important property of the Envisioned Technology is that it is in essence applicable to more than just the intended system: It encompasses a (substantive) portion of research that was committed in light of the intended system but which is applicable to more than just that.
145 +
146 +It is important to remember that when an Envisioned Technology is developed, it becomes Current Technology. As such, there is no clear distinction made between these two in the Confluence Space.
147 +
148 +==== Specification ====
149 +
150 +====== What is the Specification? ======
151 +
152 +The Specification describes a solution to the problem that is documented in the Foundation. It describes this solution in the form of a system design that makes use of the identified problems, relevant human factors and current and/or envisioned technology. The main thing to remember is that the Specification is specific to a problem and system implementation. Hence all which is stated in this segment relates to these two specific things. Anything that is more generically applicable (whether it already existed or was developed) forms the foundation of the system and thus belongs in the Foundation.
153 +
154 +The system specification consists of objectives, design scenarios, actors and use cases, requirements, and claims.
155 +
156 +====== What are Objectives? ======
157 +
158 +An Objective describes what is tried to be achieved with the system. This is different than a Requirement, as this specifies what the system should be capable of. Instead, an Objective describes an end-state of the joint cognitive system (e.g., an unbiased classification or a well-calibrated level of trust) and, possibly, the overall desired way to achieve this end-state (e.g. a hybrid-AI approach that utilizes knowledge- and data-driven approaches to the fullest).
159 +
160 +====== What are Design Scenarios? ======
161 +
162 +The Design Scenarios are short descriptive stories that provide a clear description of how a persona will work with the technology thereby showing (a) the solution offered to one of the problem scenarios and (b) its expected beneficial effects . Thus, design scenarios are closely related to problem scenarios: they preferably can be the same story but a design scenario tells it from the perspective where the persona uses the system that is being designed. Together, the problem and design scenarios provide a contextualized view on what the problem is, who encounters it, how the system will solve it and how the system is being used in the process.
163 +
164 +====== What are Use Cases? ======
165 +
166 +A Use Case is a step-by-step interaction description between one or more personas and the system. It commonly describes this in the form of a narrative which depicts for every action the persona(s) and system perform, however it does not state anything on how this is actually done.
167 +
168 +====== What are Requirements? ======
169 +
170 +The Requirements are specific functional descriptions of what the system should be capable of.
171 +
172 +====== What are Claims? ======
173 +
174 +The Claims are statements that explain what the system should support or achieve with a given functionality.
175 +
176 +This explicit linking of requirements to claims enables designers to formulate hypotheses that need to be tested in system evaluations to justify the adoption of the functional requirement. If the claim cannot be proven to be valid through system evaluations, the designers need to refine their system design, for instance, by trying to improve the functionality, replacing the functionality with a different one, or dropping the functionality and the claim altogether (i.e. by deciding that the objective is not reachable at this point). Either way, there is no use of including a functionality that does not achieve its underlying claims.
177 +
178 +Design decisions are often the outcome of weighting the pro's and con's of the design choice, Therefore, claims explicate the trade-off by specifying the expected upsides and the downsides that might occur (at the end, it should be justified that the upsides are higher than the downsides, e.g. in an empirical experiment with the end-users).
179 +
180 +Ideally, a Claim is not only linked to a Requirement but also a Measurement Instrument from the Foundation segment. There can be one or more measurements that are needed to evaluate the claim.
181 +
182 +====== What is the difference between Foundation and Specification? ======
183 +
184 +The Foundation segment is the place where all relevant information is documented regarding the problem, context, humans, technologies and more. The relevance is determined by what is needed to design a specific system.
185 +
186 +The Specification segment is the place where all relevant information is documented regarding the solution, requirements, claims and more. The relevance is determined whether it describes the system that is being designed or not.
187 +
188 +Hence, the Foundation contains the actual foundational knowledge needed to specify the system in the Specification.
189 +
190 +====== When does something from the Specification move to the Foundation? ======
191 +
192 +The SCE method supports an iterative design process. It does so in several ways, but one of these is that developed functionality can lead to generic technologies being developed and evaluated. Functionality is described in a Requirement so it may happen that much of the (new or generic) content of a Requirement is relocated to the Technology portion of the Foundation.
193 +
194 +==== Evaluation ====
195 +
196 +====== What are Evaluations? ======
197 +
198 +An Evaluation aims to test and validate the system’s design, or to discriminate between multiple design options, such that the current design can be improved upon in incremental development cycles. Note that this entails both user evaluations as well as technical performance evaluations.
199 +
200 +Ideally, an evaluation contains an artefact (prototype), evaluation method and evaluation results and can be constructed iteratively. For example, when setting up a first evaluation one may start with describing the artefact and method and later add the results.
201 +
202 +====== What are Artefacts? ======
203 +
204 +An Artefact is an implementation or prototype that incorporates a given set of requirements, interaction design patterns, and technological means. An Artefact can be the full system, but is often only a portion of it to allow for a controlled evaluation. Often the Artefact links to a set of Requirements that will be tested.
205 +
206 +====== What are Evaluation Methods? ======
207 +
208 +An Evaluation Method is a general description of how an evaluation is or will be construed. It can take many forms, such as a human-in-the-loop study, a use-case-based simulation, or an expert review but also more technological methods such as a test of robustness, accuracy, and speed. Ideally, a evaluation method refers to the Claim(s) it tries to evaluate and indirectly the Measurement(s) it will use for that (indirectly, because a Claim links to the Measurements).
209 +
210 +====== What are Evaluation Results? ======
211 +
212 +An Evaluation Result describes the outcomes of an applied evaluation method. Preferably, it also documents potential changes to the Foundation and/or Specification that resulted from these results.
213 +
214 +====== How does an Evaluation lead to a change in the Foundation? ======
215 +
216 +An evaluation may result in new knowledge about the problem, stakeholders, technologies or other topics described in the Foundation. As such, an evaluation can lead to changes or additions to the Foundation.
217 +
218 +====== How does an Evaluation lead to a change in the Specification? ======
219 +
220 +An evaluation may disprove a certain claim. In this case, the linked Claim and Requirements that reside in the Specification segment, need to be updated or even removed all together. There is no sense in keeping a Requirement whose claim is disproved.
221 +
222 +==== Ontology ====
223 +
224 +====== What is the Ontology? ======
225 +
226 +The SCE methodology prescribes the construction of an ontology; a vocabulary describing a common language to be used throughout the system specification to avoid miscommunication, misunderstanding, and inconsistencies.
227 +
228 +This segment may also be used to document data structures, however it is important to clearly separate such ontologies from the ontology used by the team itself.
229 +
230 +=== On how to add content to Confluence ===
231 +
232 +====== Where should I put <this> in Confluence? ======
233 +
234 +Try to find it right place by looking at the questions on this page or to the SCE example. If you are still not sure, add it to the place you think it belongs to and ask the Confluence project space coordinator, whether it is the correct spot for it (with a link to your page). He or she can advise you on this.
235 +
236 +=== Practical things on how to do stuff ===
237 +
238 +====== How do I refer to Jira Stories within a Confluence page? ======
239 +
240 +When editing a page, you can insert a link to most Jira Issues (these include: Stories, Tasks, etc) by using the regular 'insert' functionality: the "+" on top of your editor. Next, you can search in the linked Jira repository on the issue you wish to link to. This will create an automatic link from that page to the Jira Issue you chose to link.
241 +
242 +====== How do I add labels to a Confluence page and why should I do this? ======
243 +
244 +You can add one or more labels to any page by scrolling down and clicking on the label icon. This opens op a window in which you can add a new label. Labels are useful. You can search on them (click on the search box and select 'Labels') but can also link multiple pages under one category. For example the label 'help' can be added to any page and by simply clicking on that label or searching for it you have an overview of all help-related topics. Similar things could be achieved to link pages on categories (e.g. "XAI" or "Bias") or progress (e.g. "Done" or "In Progress").
245 +
246 +
247 +
248 +
249 +
250 +