Short description:

Archive of applications and projects carried out in the past at the virtual reality lab.


Graphics, virtual reality, multimodal interaction

Research Themes:

The theme in this work is: Virtual Reality and Graphics



Some VR experiments that we have carried out:

Navigation in VR using data gloves

Moving around in 3D space is not straightforward. In this experiment, we tried to solve this problem by using the intuitive 'grab-and-drag'-metaphore. The user wears a data glove, and when he/she bends all fingers into a fist, the entire world can be moved by moving the hand (the position and orientation of the hand is tracked by a Flock Of Birds sensor). As long the hand is NOT in a fist, the user can have any kind of interaction with the virtual world (such as playing a virtual piano, see the next example). This method works quite well for small worlds, but is not very convenient in larger worlds, as the viewpoint is only changed a few decimeters with each drag.

See a movie of this: 1.0 MB MPEG

Air Piano playing in VR

Wearing the data glove, you can play a virtual piano. The actuators on the glove give haptic feedback for each finger. This means that when you 'touch' the piano keys with a specific finger, the black cylinders on top of that finger (on the glove) start to vibrate, to indicate the contact. The further the key is pressed, the stronger the vibration. The 3D piano and hand are contained in a multi-user virtual environment. This means that other viewers can see and hear you play in real-time. This opens up many possibilities for collaborative music making in a 3D environment through the internet. Imagine people in different places around the world playing real/virtual instruments, connected to the same system, who can see and hear each other play in a virtual band/orchestra...

See a movie of this: 3.8 MB AVI (MotionJPEG), 844 KB DivX or 1.0 MB MPEG

Air Drumming in VR

Similar to the previous example: play 'air drum' with 2 ordinary drum sticks, to which we've attached position sensors. Virtual drum sticks on the screen follow the movements of the sticks in your hands; when a virtual stick hits a virtual drum, a sound is triggered. Hit the drums harder, and the resulting sounds will be louder!

1) Virtual drumming on 2 drums (2.5 MB AVI or 621 KB MPEG)

2) Virtual drumming on a complete drum kit (3.8 MB AVI, 8 89 KB DivX or 937 KB MPEG)


(as you can see, we like our things 'virtual'...:-)

The Virtual Drummer

A 3D avatar that can play any drum part that you want. Just load a MIDI file containing a drum part, and the drummer will figure out how to play it (e.g. which hand to use for which note etcetera). Finally, the drummer plays along with the music.
Go to the Virtual Drummer site.

The Virtual Music Centre

In this somewhat older project, a local theater was modeled in VRML. The Virtual Music Centre functions as a central point for many other projects related to artificial intelligence, dialogue systems, human-computer interaction and navigation in 3D worlds.
The VMC home page

Virtual 'Huys Hengelo'

The 3D reconstruction of an old castle in our area. The system is designed to let historians visualise alternative theories. For example, different versions of the castle can be viewed, walls can be moved, etcetera.
Visit Huys Hengelo.


Our research group participates in the VRINT project (Virtual Reality INitiative Twente) which focuses -among others- on medical applications of VR technology.
The VRINT web site

Gulliver, a virtual museum

The Gulliver museum was designed by Mathias Stuk. The museum represents Gulliver's travels through the modern age. For demonstration purposes, this virtual reality model of the museum was created by students in the course 'Computer Graphics and Virtual Reality'. The goals of the project were both designing a usable model and learning the VRML language.
Visit Gulliver

The Virtual Aquarium

A demonstration of flocking behavior of fish, using Reynolds flocking rules.

Publications related to this showcase are:

A. Nijholt Gulliver project: performers and visitors, pp. 285-292. In Digital Applications for Cultural and Heritage Institutions, J. Hemsley, V. Cappellini and G. Stanke (eds), Ashgate Publishing Ltd, Hampshire (UK), ISBN 0-7546-3359-4, 2005 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt Enabling virtual communities: Gulliver and Aveiro, in Proc. 4th Workshop on Information and Computer Science (WICS 2002, K. Faisal and M. Sarfraz (eds), King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia, ISBN 9960-07-187-1, pp. 391-400, 2002 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt Gulliver Project: Performers and Visitors, in Proceedings EVA 2002 Florence: "Electronic Imaging and the Visual Arts", V. Cappellini, J. Hemsley and G. Stanke (eds), Pitagora Editrice Bologna, Bologna, Italy, ISBN 88-371-1312-9, pp. 241-244, 2002 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt, M. Stuk and J. Zwiers The virtual GULLIVER project, in Cybernetics and Systems 2002, R. Trappl (eds), Austrian Society for Cybernetic Studies, Vienna, Austria, ISBN 3-85206-160-1, pp. 878-882, 2002 [ BiBTeX ] [EprintsDownload PDF document
J. Hulstijn, G.H.W. Hondorp, A. Nijholt, M. van den Berk and A.J. van Hessen Dialogues with a Talking face for Web-based Services and Transactions, Technical Report, TR-CTIT-99-07, Enschede, Centre for Telematics and Information Technology University of Twente, Pages: 10, 1999 [ BiBTeX ] [EprintsDownload PDF document  Download PDF document
A. Nijholt, A.J. van Hessen and J. Hulstijn Speech and language interaction in a (virtual) cultural theatre, in Proceedings NLP and Industrial Applications, C. Moghrabi (eds), Universit√© de Moncton, Moncton, Canada, pp. 176-182, 1998 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt, M. van den Berk and A.J. van Hessen A natural language web-based dialogue system with a talking face, in Proceedings of the First Workshop on Text, Speech, Dialogue - TSD 1998, P. Sojka, V. Matoušek, K. Pala and I. Kopeček (eds), Masaryk University, Brno, Czech Republic, ISBN 80-210-1900-X, pp. 415-420, 1998 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt Commerce and Entertainment in the Twente Virtual Theatre Environment, in WRV99: II Brasilian Workshop on Virtual Reality, C. Kirner and T.G. Kirner (eds), Fundao Euripides de Marilia, Marilia, pp. 102-114, 1999 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt An agent-based virtual theatre community, in Local Nets: International Workshop on Community-based Interactive Systems, K. Stathis (eds), I3 Esprit, Brussels, pp. 116-133, 1999 [ BiBTeX ] [EprintsDownload PDF document
A. Nijholt, J. Hulstijn and A.J. van Hessen Speech and Language Interaction in a Web Theatre Environment, in Proceedings Interactive Dialogue in Multi-Modal Systems, P. Dalsgaard, C.-H. Lee, P. Heisterkamp and R. Cole (eds), ISCA Archives, Grenoble, ISBN 87-90834-00-3, pp. 129-132, 1999 [ BiBTeX ] [EprintsDownload HTML document  Download PDF document
A. Nijholt The Twente Virtual Theatre Environment: Agents and Interactions, in Interactions in Virtual Worlds (IVW'99), A. Nijholt, E.M.A.G. van Dijk and O.A. Donk (eds), Twente Workshop on Language Technology, volume 15, University of Twente, Enschede, pp. 147-164, 1999 [ BiBTeX ] [Eprints]
J. Hulstijn, A. Nijholt, G.H.W. Hondorp, M. van den Berk and A.J. van Hessen Dialogues with a Talking Face for Web-based Services and Transaction, in Proceedings Face to Face workshop, Z.M. Ruttkay (eds), CWI, Amsterdam, pp. 12-17, 1999 [ BiBTeX ] [Eprints]
A. Nijholt Multi-Media Access and Presentation in the Twente Virtual Theatre Environment, in Multimedia '99. Proceedings of the Eurographics Workshop, N. Correia, T. Cambell and G. Davenport (eds), Springer Verlag, Vienna, Austria, ISBN 3-211-83437-0, pp. 205-214, 2000 [ BiBTeX ] [EprintsDownload PDF document
D. Reidsma, M. Kragtwijk and A. Nijholt Building Huys Hengelo in VRML, in ICHIM 2001: Cultural Heritage and Technologies in the Third Millennium, D. Bearman and F. Garzotto (eds), Archives and Museum Informatics, Pittsburgh, ISBN 1-885626-24-X, pp. 325-332, 2001 [ BiBTeX ] [EprintsDownload HTML document  Download PDF document
M. Kragtwijk, A. Nijholt and J. Zwiers Implementation of a 3D Virtual Drummer, in Proceedings CAS2001, Eurographics Workshop on Animation and Simulation 2001, N. Magnenat-Thalmann and D. Thalmann (eds), Springer Verlag, New York, ISBN 3-211-83711-6, pp. 15-26, 2001 [ BiBTeX ] [EprintsDownload PDF document
M. Kragtwijk, A. Nijholt and J. Zwiers An animated virtual drummer, in Proceedings International Conference on Augmented, Virtual Environments and Three-dimensional Imaging (ICAV3D), V. Giagourta and M.G. Strintzis (eds), CERTH, Thessaloniki, Greece, pp. 319-322, 2001 [ BiBTeX ] [EprintsDownload PDF document
I. van Es, D.K.J. Heylen, E.M.A.G. van Dijk and A. Nijholt Gaze Behavior of Talking Faces Makes a Difference, in Proceedings CHI 2002: Changing the World, Changing Ourselves, L. Terveen and D. Wixon (eds), ACM Press, New York, ISBN 1-58113-454-1, pp. 734-735, 2002 [ BiBTeX ] [EprintsDOI>  Download PDF document

HMI-members working on this showcase are:

Former HMI-members:

old Parlevink website   colophon   [Back] .