Step 3: Effects

Positive consequences

Which positive effects are expected from the AI-functions

- to the performance of the actors who work with the AI (e.g., accuracy, speed, ...)?

- to the state of them (e.g., stress, understanding, trust, ...)?

The positive effects expected from the conversational agent is a speedy evacuation or response from the affected area. The positive effects then revolve around the efficiency of the evacuation and of the communication that the citizens receive from the authority figures. 

The conversational agent can relieve stress in these moments as well as increasing the efficiency of communication. This understanding of the situation can lead to saving lives and preventing further impacts from disaster and economic consequences. 

Negative consequences

Do you foresee potential negative effects of the AI-functions:

- on the performance, state and/or values of the actors?

- on more general ethical or societal aspects?

What are they?

Potential negative effects of the conversational agent could be a miscommunication between the agent and the citizen. This could lead to a misunderstanding in the distrust between the citizen and the agent. This could cause the citizen to not receive the required help on time and could hamper the emergency services responses to the required crisis. This could lead to distrust in the system

On the ethical and societal perspective, this could lead to a breakdown between the authority figures in the public safety perspective and the citizens. A breakdown in the communication between the two can lead to a damaging response in the views of technology in the wider public sphere. This can impede the ability for AI and in particular conversational agents to be trusted in the future. 

Impact on use-case

What is the impact of the AI functions on the overall use case?

What does it add to the use case/how does it improve the use case as a whole?