The R3D3 project aimed at investigating situated natural language dialogue systems that combine limited natural language understanding with the understanding of the nonverbal behaviour of the users in a real-life context. Inspired by Star Wars’ R2D2, we developed an even more advanced robot, our R3D3 (see the image below). R3D3 takes the form of a Receptionist Robot, carrying a virtual human that can have a spoken dialogue with the visitors to a museum, shop or office building. These dialogues are “double” in the sense that they involve both the virtual human and the robot.
The R3D3 project addressed scientific ICT challenges in the areas of computer vision, spoken language interaction, and data processing, as well as practical challenges in robot development.
For an overview of the project results, see this blog post by R3D3 project partner VicarVision.
Involved parties are the departments of Human Media Interaction and Robotics and Mechatronics of the University of Twente, the Dutch Police Academy, VicarVision, Sentient, NEMO Science Museum and smartrobot.solutions.
Contact: Mariët Theune, firstname.lastname@example.org
- J. Linssen, M. Berkhoff, M. Bode, E. Rens, M. Theune, and D. Wiltenburg (2017). You can leave your head on – attention management and turn-taking in multi-party interaction with a virtual human/robot duo. In Proceedings of Intelligent Virtual Agents (IVA 2017).
- J. Linssen and M. Theune (2017). R3D3: the Rolling Receptionist Robot with Double Dutch Dialogue. In Proceedings of the Companion of HRI ’17, pp. 189–190.
- M. Theune, D. Wiltenburg, M. Bode, and J. Linssen (2017). R3D3 in the Wild: Using A Robot for Turn Management in Multi-Party Interaction with a Virtual Human. In Proceedings of the IVA 2017 workshop on Interaction with Agents and Robots: Different Embodiments, Common Challenges.