Archive of applications and projects carried out in the past at the
virtual reality lab.
Graphics, virtual reality, multimodal interactionThe theme in this work is: Virtual Reality and Graphics
Some VR experiments that we have carried out:
(as you can see, we like our things 'virtual'...:-)
Moving around in 3D space is not straightforward. In this experiment,
we tried to solve this problem by using the intuitive
'grab-and-drag'-metaphore. The user wears a data glove, and when
he/she bends all fingers into a fist, the entire world can be moved
by moving the hand (the position and orientation of the hand is
tracked by a Flock Of Birds sensor). As long the hand is NOT in a
fist, the user can have any kind of interaction with the virtual world
(such as playing a virtual piano, see the next example). This method
works quite well for small worlds, but is not very convenient in
larger worlds, as the viewpoint is only changed a few decimeters with
See a movie of this: 1.0 MB
Wearing the data glove, you can play a virtual piano. The actuators
the glove give haptic feedback for each finger. This means that when
you 'touch' the piano keys with a specific finger, the black
on top of that finger (on the glove) start to vibrate, to indicate
contact. The further the key is pressed, the stronger the vibration.
The 3D piano and hand are contained in a multi-user virtual
environment. This means that other viewers can see and hear you play
in real-time. This opens up many possibilities for collaborative
making in a 3D environment through the internet. Imagine people in
different places around the world playing real/virtual instruments,
connected to the same system, who can see and hear each other play in
a virtual band/orchestra...
See a movie of this: 3.8 MB
KB DivX or
Similar to the previous example: play 'air drum' with 2 ordinary drum
sticks, to which we've attached position sensors. Virtual drum sticks
on the screen follow the movements of the sticks in your hands; when
virtual stick hits a virtual drum, a sound is triggered. Hit the
harder, and the resulting sounds will be louder!
1) Virtual drumming on 2 drums (2.5 MB
AVI or 621 KB MPEG)
2) Virtual drumming on a complete drum kit (3.8
KB DivX or 937
A 3D avatar that can play any drum part that you want. Just load a
MIDI file containing a drum part, and the drummer will figure out how
to play it (e.g. which hand to use for which note etcetera). Finally,
the drummer plays along with the music.
Go to the
Virtual Drummer site.
In this somewhat older project, a local theater was modeled in VRML.
The Virtual Music Centre functions as a central point for many other
projects related to artificial intelligence, dialogue systems,
human-computer interaction and navigation in 3D worlds.
The VMC home page
The 3D reconstruction of an old castle in our area. The system is
designed to let historians visualise alternative theories. For
example, different versions of the castle can be viewed, walls can be
Visit Huys Hengelo.
Our research group participates in the VRINT project (Virtual Reality
INitiative Twente) which focuses -among others- on medical
applications of VR technology.
The Gulliver museum was designed by Mathias Stuk. The museum
represents Gulliver's travels through the modern age. For
demonstration purposes, this virtual reality model of the museum was
created by students in the course 'Computer Graphics and Virtual
Reality'. The goals of the project were both designing a usable model
and learning the VRML language.
A demonstration of flocking behavior of fish, using Reynolds flocking rules.
|A. Nijholt, M. van den Berk and A.J. van Hessen A natural language web-based dialogue system with a talking face, in Proceedings of the First Workshop on Text, Speech, Dialogue - TSD 1998, P. Sojka, V. Matoušek, K. Pala and I. Kopeček (eds), Masaryk University, Brno, Czech Republic, ISBN 80-210-1900-X, pp. 415-420, 1998 [ BiBTeX ]  |
|A. Nijholt, J. Hulstijn and A.J. van Hessen Speech and Language Interaction in a Web Theatre Environment, in Proceedings Interactive Dialogue in Multi-Modal Systems, P. Dalsgaard, C.-H. Lee, P. Heisterkamp and R. Cole (eds), ISCA Archives, Grenoble, ISBN 87-90834-00-3, pp. 129-132, 1999 [ BiBTeX ]  |
|D. Reidsma, M. Kragtwijk and A. Nijholt Building Huys Hengelo in VRML, in ICHIM 2001: Cultural Heritage and Technologies in the Third Millennium, D. Bearman and F. Garzotto (eds), Archives and Museum Informatics, Pittsburgh, ISBN 1-885626-24-X, pp. 325-332, 2001 [ BiBTeX ]  |
|M. Kragtwijk, A. Nijholt and J. Zwiers An animated virtual drummer, in Proceedings International Conference on Augmented, Virtual Environments and Three-dimensional Imaging (ICAV3D), V. Giagourta and M.G. Strintzis (eds), CERTH, Thessaloniki, Greece, pp. 319-322, 2001 [ BiBTeX ]  |
|I. van Es, D.K.J. Heylen, E.M.A.G. van Dijk and A. Nijholt Gaze Behavior of Talking Faces Makes a Difference, in Proceedings CHI 2002: Changing the World, Changing Ourselves, L. Terveen and D. Wixon (eds), ACM Press, New York, ISBN 1-58113-454-1, pp. 734-735, 2002 [ BiBTeX ]  |