The R3D3 project aims at investigating situated natural language dialogue systems that combine limited natural language understanding with the understanding of the nonverbal behaviour of the users in a real-life context. Inspired by Star Wars’ R2D2, we have developed an even more advanced robot, our R3D3 (see the image below). R3D3 takes the form of a Receptionist Robot, carrying a virtual human that can have a spoken dialogue with the visitors to a museum, shop or office building. These dialogues are “double” in the sense that they involve both the virtual human and the robot.
The R3D3 project addresses scientific ICT challenges in the areas of computer vision, spoken language interaction, and data processing, as well as practical challenges in robot development.
Involved parties are the departments of Human Media Interaction and Robotics and Mechatronics of the University of Twente, the Dutch Police Academy, VicarVision, Sentient, NEMO Science Museum and smartrobot.solutions.
- J. Linssen, M. Berkhoff, M. Bode, E. Rens, M. Theune, and D. Wiltenburg (2017). You can leave your head on – attention management and turn-taking in multi-party interaction with a virtual human/robot duo. In Proceedings of Intelligent Virtual Agents (IVA 2017).
- J. Linssen and M. Theune (2017). R3D3: the Rolling Receptionist Robot with Double Dutch Dialogue. In Proceedings of the Companion of HRI ’17, pp. 189–190.
- M. Theune, D. Wiltenburg, M. Bode, and J. Linssen (2017). R3D3 in the Wild: Using A Robot for Turn Management in Multi-Party Interaction with a Virtual Human. In Proceedings of the IVA 2017 workshop on Interaction with Agents and Robots: Different Embodiments, Common Challenges.