English Deutsch

Project List

Musical Gesture 

The Musical Gesture project is about research in human-computer interaction in the context of electronic music. The term musical gesture includes traditional instrumental gestures but also interaction modes that are not tied to a specific instrumental practise. They might originate from interaction with other technical interfaces such as those used in the recording studio, video games or on stage.

A special focus lies on in-depth analysis and qualification of musical gestures in instrumental and electronic music, the perception processes involved and the expressive qualities of those gestures.

The technical developments deal with integrating current state-of-the-art hardware and software components for the specific needs of musical interaction. These comprise a.o. wearable wireless sensors, custom made musical controllers and computer vision algorithms.

The results are applied in musical and other artistic projects such as musical performances, interactive dance or interactive audio-visual installations. The technologies are applied to research such as the ISS Interactive Swarm Space or the concert performance with Ambisonic Tools. These offer the ideal testing ground for new ideas, algorithms, devices and extended interaction technologies.

 

 

Publications:

 

Motion To Gesture To Sound: Mapping For Interactive Dance
Jan C. Schacher in: Proceedings of the 2010 Conference on New Interfaces for Musical Expression (NIME 2010), Sydney, Australia

 

Towards an Interactive Multimedia Experience for Club Music and Dance
Dennis Majoe (ETH) Irena Kulka (ETH) Jan C. Schacher in: Proc. of the 7th International Conference on Advances in Mobile Computing & Multimedia, (MoMM 2009), Kuala Lumpur, Malaysia

 

Action and Perception in Interactive Sound Installations: An Ecological Approach
Jan C. Schacher in: Proceedings of the 2009 Conference on New Interfaces for Musical Expression (NIME 2009), Pittsburg, USA

 

davos soundscape, a location based interactive composition
Jan C. Schacher in: Proceedings of the 2008 Conference on New Interfaces for Musical Expression (NIME 2008), Genova, Italy

 

Gesture Control of Sounds in 3D Space
Jan C. Schacher in: Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME 2007), New York, USA

 

 

Downloads:

Blobtracker Source