Skip to Content

Changes for page Step 4: Claims

Last modified by Mark Neerincx on 2023/04/13 12:17
From version 2.1
edited by Michaël Grauwde
on 2023/02/28 11:24
Change comment: There is no comment for this version
To version 4.2
edited by Mark Neerincx
on 2023/04/13 12:17
Change comment: Added comment

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.grauwde
1 +xwiki:XWiki.MarkNeerincx
Content
... ... @@ -1,20 +1,18 @@
1 -|**Topic**|(% style="width:222px" %)**Question**|(% style="width:286px" %)**Answer - Make more tangible!**
1 +|**Topic**|(% style="width:222px" %)**Question**|(% style="width:286px" %)**Answer**
2 2  |(((
3 3  [[image:12.png]]
4 4  
5 5  //Measurements//
6 6  )))|(% style="width:222px" %)For each positive and negative effect listed in step 3, describe how you could evaluate (measure) whether they actually occur.|(% style="width:286px" %)(((
7 -**__1. __**The efficiency of the evacuation or of communication could be evaluated by how quickly emergency responses are dispatched to the those requiring help.
7 +**__1. __**The evaluation of the conversational agent's effect can come from individuals having deliberations without the conversational agent versus with the conversational agent. This could allow us to see if more ideas were generated or if deliberation went smoothly.
8 8  
9 -**__2. __**The effectiveness of the communication could be analysed in a similar manner. But in times of chaos and distress, a conversational agent could simply ask the user, "if they understand the information". While this could allow for an easy answer for the engineers or authorities in charge of the conversational agent, it may be difficult to communicate this information in chaotic times.
9 +**__2. __**The reflection could be analysed by doing interviews or conducting surveys with participants and asking them how they felt before and after they engaged with the conversational agent. In this manner, we can see if the user was able to reflect on their opinions and values than before they engaged with the agent.
10 10  
11 -**__3. __**Relieving stress in this situation could be by the conversational agent putting the citizen in contact with a human operator on the end of the police or other emergency services that can walk them through the situation in which they find themselves.
12 -
13 13  **__The impact of the negative effects__**
14 14  
15 -**__1. __**A miscommunication between the conversational agent and the citizen could be analysed by the lagging time in which emergency services were dispatched to the citizen requiring help. Furthermore, this could also be seen by the lack of understanding in the text communicated by the citizen on the end of the conversational agent.
13 +**__1. __** We can analyse how the humans feel about themselves and if they feel put in a box by examining how they engage in discussion and seeing how open they are to new ideas.
16 16  
17 -**__2. __**In disaster times, it is required that the authorities communicate well with the public. A lack of communication could lead to distrust in the system as well as other AI systems. This distrust could lead to citizens being unwilling to use the conversational agent in the future. This could lead to lagging response times from the emergency services as human respondents may be overwhelmed by the amount of calls that they may receive. This could lead to an increase in deaths and injuries in crisis times.
15 +**2. **If the users lose trust in the system, this can cause loss of trust in the police. This would be damaging to the society, as it would make it more difficult for the police to do their jobs and use technology in the future.
18 18  )))
19 19  |(((
20 20  [[image:14.png]]
... ... @@ -27,4 +27,4 @@
27 27  [[image:13.png]]
28 28  
29 29  //Demonstration of AI-functionality//
30 -)))|(% style="width:222px" %)Can you describe how you could demonstrate that your AI function (s) achieve(s) the effects that you listed in the previous question?|(% style="width:286px" %)I could describe achieving previous effects by the response times in dispatching of emergency services and in the lives saves. Furthermore, a positive response to the conversational agent could also be seen as a demonstration of the usefulness of the conversational agent.
28 +)))|(% style="width:222px" %)Can you describe how you could demonstrate that your AI function (s) achieve(s) the effects that you listed in the previous question?|(% style="width:286px" %)I could describe achieving previous effects by doing qualitative surveys and interviews on the views of the users with regards to the conversational agent. Longer discussions and improved deliberation quality could be seen as an improvement in the deliberation and can be seen as usefulness of the conversational agent.
XWiki.XWikiComments[0]
Date
... ... @@ -1,0 +1,1 @@
1 +2023-04-13 12:17:18.719
Author
... ... @@ -1,0 +1,1 @@
1 +xwiki:XWiki.MarkNeerincx
Comment
... ... @@ -1,0 +1,1 @@
1 +It would be nice to have an objective measure of the quality of the deliberation (value-based argumentation). Note that the agent is expected to build a value model for each stakeholder and context/use case. Stakeholders can assess whether this model represents their values accurately.