hmilogo
FEELSOUND

Short description:

FeelSound is a multi-user application for collaboratively composing music in an entertaining way. Up to four composers can jointly create acoustic music on a top-projection multitouch sensitive table.

Keywords:

multi-touch, music, collaboration

Research Themes:

Some themes present in this work are :

Description

Demo Reel

This div will be replaced


The Interface

Unlike music tables where tangible objects are manipulated on the horizontal surface, FeelSound depicts purely virtual representations of acoustic instruments, known as widgets. A total of six circular instrument widgets are present in FeelSound although more are possible; we included the piano, recorder, trumpet, drums, violin and contrabass. The widgets are represented by icons of the instrument that the users can touch and move about freely on the the table.

Harmonic Table

By touching a widget, users can compose music on a harmonic table. For each instrument, four octaves of notes are available in FeelSound in a 7x7 hexagonal lattice: the harmonic table. The position of similar notes is related: diagonals are minor and major third increases and decreases of the current note, while fifth notes variations are above or below. Every combination of musical intervals has the same shape all over the table: a minor triad (three note chord) is a left-facing triangle.

Mu3

We developed a multi-touch framework called Mu3 that abstracts from the multi-touch hardware that is used. In our case, we use the CircleTwelve Diamondtouch. This top-projection multi-touch sensitive panel can recognize up to four users simulatenously but it has difficulties in its touch resolution. Mu3 offers tracking algorithms that robustly detect and track touches while filtering out ghost-touches. Mu3 can receive and produce TUIO messaging. Download Mu3: http://code.google.com/p/mu3/

Publications related to this showcase are:

F.W. Fikkert, M.C. Hakvoort, P.E. van der Vet and A. Nijholt Experiences with Interactive Multi-touch Tables, in Proceedings 3rd International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 09), A. Nijholt, D. Reidsma and G.H.W. Hondorp (eds), Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering (LNICST), volume 9, Springer Verlag, Berlin, ISBN 978-3-642-02314-9, ISSN 1867-8211, pp. 193-200, 2009 [ BiBTeX ] [Eprints] DOI>  Download PDF document
F.W. Fikkert, M.C. Hakvoort, P.E. van der Vet and A. Nijholt FeelSound: Collaborative Composing of Acoustic Music, in Proceedings of the 5th International Conference on Advances in Computer Entertainment Technology (ACE '09), ACM, New York, ISBN 978-1-60558-863-6, pp. 294-297, 2009 [ BiBTeX ] [Eprints] Download PDF document
F.W. Fikkert, M.C. Hakvoort, P.E. van der Vet and A. Nijholt FeelSound: interactive acoustic music making, in Proceedings of the International Conference on Advances in Computer Enterntainment Technology, ACM International Conference Proceeding Series, volume 422, ACM, New York, ISBN 978-1-60558-864-3, pp. 449-449, 2009 [ BiBTeX ] [Eprints] DOI>  Download PDF document

HMI-members working on this showcase are:

Former HMI-members:

Projects involved with this showcase:

  • BioRange [A research programme to shape the future for bioinformatics in the Netherlands]
  • GATE [GATE: Games for Advanced Training and Entertainment]

old Parlevink website   colophon   [Back] .