Skip to Content

a. Prototype

Version 12.1 by Diederik Heijbroek on 2024/03/24 13:01

The prototype for this research consists of several components in the following Wizard of Oz style setup:

  • The NAO robot (human-like movements)
  • A chatbot with pre-trained custom OpenAI conversational model, running on a smartphone
  • A script with keyboard shortcuts to movements for the NAO, running on a laptop
  • A supervisor

The conversational model will handle the information exchange and verbal cues of the test, while the supervisor will act as the wizard and provide movements through the running robotsindeklas script. The prototype will be used according to the following steps:

  • NAO will be started by the supervisor, as this specific part of the NAO usability is not a focus of the research.
  • The participant will, as instructed, initiate conversation with the NAO. The NAO listens 'implicitly' through the chatbot.
  • The chatbot responds automatically, without supervisor intervention.
  • The supervisor will be able to listen to the entire conversation, and have the NAO move appropriately through pressing keyboard shortcuts.

Throughout the conversation, the NAO robot will make human-like movements or gestures. Gesture has been shown to serve a variety of cognitive functions, reducing cognitive load to benefit working [1].It remains unknown whether the human-like movements or gestures performed by a robot improve the natural flow of conversation. Therefore, we will add this design choice to the evaluation. The human-like movements will be as follows:

  • When NAO "listens", NAO will lean forward or try to face the participant. 
  • When NAO "talks", NAO will move its arms, head and torso.
  • Each movement is a random selection of various programmed movements.

TODO: this was the physical part that we want to test, maybe also something about the values that we want to test?

References

[1] Clough, S., & Duff, M. C. (2020). The role of gesture in communication and cognition: Implications for understanding and treating neurogenic communication disorders. Frontiers in Human Neuroscience, 14. doi:10.3389/fnhum.2020.00323