Skip to Content

Wiki source code of Step 4: Claims

Last modified by Mark Neerincx on 2023/04/13 12:17
Show last authors
1 |**Topic**|(% style="width:222px" %)**Question**|(% style="width:286px" %)**Answer**
2 |(((
3 [[image:12.png]]
4
5 //Measurements//
6 )))|(% style="width:222px" %)For each positive and negative effect listed in step 3, describe how you could evaluate (measure) whether they actually occur.|(% style="width:286px" %)(((
7 **__1. __**The evaluation of the conversational agent's effect can come from individuals having deliberations without the conversational agent versus with the conversational agent. This could allow us to see if more ideas were generated or if deliberation went smoothly.
8
9 **__2. __**The reflection could be analysed by doing interviews or conducting surveys with participants and asking them how they felt before and after they engaged with the conversational agent. In this manner, we can see if the user was able to reflect on their opinions and values than before they engaged with the agent.
10
11 **__The impact of the negative effects__**
12
13 **__1. __** We can analyse how the humans feel about themselves and if they feel put in a box by examining how they engage in discussion and seeing how open they are to new ideas.
14
15 **2. **If the users lose trust in the system, this can cause loss of trust in the police. This would be damaging to the society, as it would make it more difficult for the police to do their jobs and use technology in the future.
16 )))
17 |(((
18 [[image:14.png]]
19
20 //Benchmark//
21 )))|(% style="width:222px" %)For each measurement, what are the benchmarks (criteria)? (i.e., what are desired values?)|(% style="width:286px" %)
22 |(((
23
24
25 [[image:13.png]]
26
27 //Demonstration of AI-functionality//
28 )))|(% style="width:222px" %)Can you describe how you could demonstrate that your AI function (s) achieve(s) the effects that you listed in the previous question?|(% style="width:286px" %)I could describe achieving previous effects by doing qualitative surveys and interviews on the views of the users with regards to the conversational agent. Longer discussions and improved deliberation quality could be seen as an improvement in the deliberation and can be seen as usefulness of the conversational agent.