Wiki source code of Step 4: Claims
Last modified by Demi Tao on 2023/02/20 15:26
Show last authors
author | version | line-number | content |
---|---|---|---|
1 | |(% style="width:134px" %)**Topic**|(% style="width:258px" %)**Question**|(% style="width:553px" %)**Answer** | ||
2 | |(% style="width:134px" %)((( | ||
3 | [[image:12.png||height="98" width="98"]] | ||
4 | |||
5 | //Measurements// | ||
6 | )))|(% style="width:258px" %)For each positive and negative effect listed in step 3, describe how you could evaluate (measure) whether they actually occur.|(% style="width:553px" %)((( | ||
7 | - **Memory accuracy**. To evaluate whether the robot can help increase memory accuracy, we can look at the percentage of times that the patient names relatives and their relationships correctly. | ||
8 | |||
9 | - **Social connection**. To evaluate whether the robot can help promote social connection, we can look at the frequency with which the patient contact relatives and the feeling of social connection. | ||
10 | |||
11 | - **(Better) Quality of conversations**. To evaluate whether the robot can improve the quality of conversations, we can invite both patients and relatives to do a survey and determine through observational research. | ||
12 | |||
13 | - **Reduce emotional stress**. To evaluate whether the robot can reduce emotional stress, we can invite the patient to do a survey. | ||
14 | |||
15 | - **Better relative attitude**. To evaluate whether the robot can positively improve relatives' overall attitudes, we can invite them to do a survey or examine their willingness to take the initiatives to interact with the patient. | ||
16 | |||
17 | - **Lack of privacy.** We can tell the negative effect when the patient and relatives personal information is leaked from the healthcare scenario. But this is the worst case. | ||
18 | |||
19 | - **Irritation. **The patient's negative emotions might be obvious through the analysis of their words and facial expression. | ||
20 | |||
21 | - **Misinformation. **The misinformation can be detected by the number of information corrections that occur in the conversations. | ||
22 | ))) | ||
23 | |(% style="width:134px" %)((( | ||
24 | [[image:14.png||height="90" width="90"]] | ||
25 | |||
26 | //Benchmark// | ||
27 | )))|(% style="width:258px" %)For each measurement, what are the benchmarks (criteria)? (i.e., what are desired values?)|(% style="width:553px" %)((( | ||
28 | - **Memory accuracy**. The patient can call relatives' names correctly in 80% of conversations. | ||
29 | |||
30 | - **Social connection.** The patient contacts relatives three times a week and reviews daily news every morning. | ||
31 | |||
32 | - **(Better) Quality of conversations**. The patient can mention previous experience and chat happily in 80% of conversations. | ||
33 | |||
34 | - **Reduce emotional stress**. The patient self-reports his/her emotional status positively in the questionnaire. | ||
35 | |||
36 | - **Better relative attitude**. Relatives self-report their positive attitude about chatting with the patient in the questionnaire or in informal chats with doctors. Besides, relatives are willing to contact the patient three times a week. | ||
37 | |||
38 | - **Lack of privacy.** People other than the patient, relatives and the doctor in charge are able to access the information stored in the robot. | ||
39 | |||
40 | - **Irritation. **When the robot reminds the patient of things he/she remembers two times a day, we can assume the patient will irritate. In other cases, the patient self-reports his/her irritation. | ||
41 | |||
42 | - **Misinformation. **The information stored in the robot is not correct. | ||
43 | ))) | ||
44 | |(% style="width:134px" %)((( | ||
45 | |||
46 | |||
47 | [[image:13.png||height="95" width="98"]] | ||
48 | |||
49 | //Demonstration of AI-functionality// | ||
50 | )))|(% style="width:258px" %)Can you describe how you could demonstrate that your AI function (s) achieve(s) the effects that you listed in the previous question?|(% style="width:553px" %)((( | ||
51 | - **Memory accuracy**. The effect will be achieved when the patient is able to accurately recognizes relatives with the robot's help. | ||
52 | |||
53 | - **Social connection**. The effect will be achieved when the patient has contact with relatives frequently either on phone or virtually with the robot's help. | ||
54 | |||
55 | - **(Better) Quality of conversations**. The effect will be achieved when the patient is able to talk about things mentioned in previous conversations. | ||
56 | |||
57 | - **Reduce emotional stress**. The effect will be achieved when the patient expresses his/her stress-free status or is observed by relatives and doctors around. | ||
58 | |||
59 | - **Better relative attitude**. The effect will be achieved when relatives are willing to interact with and take care of the patient. | ||
60 | |||
61 | - **Lack of privacy.** The effect will be achieved when the information about both the patient and relatives is not securely stored and can easily be accessed by others. | ||
62 | |||
63 | - **Irritation. **The effect will be achieved when the robot reminds the patient of things he/she still remembers frequently. | ||
64 | |||
65 | - **Misinformation. **The effect will be achieved when the information stored in the robot is incorrect, such as misconceptions about a relative. | ||
66 | ))) |