MaD allows for simple and intuitive design of continuous sonic gestural interaction. The motion-sound mapping is automatically learned by the system when movement and sound examples are jointly recorded. In particular, our applications focus on using vocal sounds – recorded while performing action, – as primary material for interaction design. The system integrates of specific probabilistic models with hybrid sound synthesis models. Importantly, the system is independent to the type of motion/gesture sensing devices, and can directly accommodate the use different sensors such as, cameras, contact microphones, and inertial measurement units. The application concerns performing arts, gaming but also medical applications such auditory-aided rehabilitation. More…
On February 6th, 7th and 8th, La Ville de Paris and the À Suivre association organized the 4th edition of Paris Face Cachée, which aims at proposing original and off-the-wall ways to discover the city. The CoSiMa team led the workshops Expérimentations sonores held at IRCAM. More…
Gestural sonic interaction: playing with a virtual water tub. Sound samples are controlled with hand movements, by splashing water or sweeping under the surface.
Conception: Eric O. Boyer (Ircam & LPP), Sylvain Hanneton (LPP), Frédéric Bevilacqua (Ircam)
Technology: MuBu and LeapMotion Max object, ISMM team at Ircam-STMS CNRS UPMC
Sound materials: Roland Cahen & Diemo Schwarz – Topophonie project
With the support of ANR LEGOS project.
hand tracking, LEGOS, max, movement, mubu, Topophonie, water
The concatenative real-time sound synthesis system CataRT plays grains from a large corpus of segmented and descriptor-analysed sounds according to proximity to a target position in the descriptor space. This can be seen as a content-based extension to granular synthesis providing direct access to specific sound characteristics. More…
Dirty Tangible Interfaces (DIRTI) are a new concept in interaction design that forgoes the dogma of repeatability in favor of a richer and more complex experience, constantly evolving, irreversible & infinitely modifiable. The video resuming 4 days of experimentation with a tangible interface and iPad app specially designed for kids at the Maison des Petits of the cultural centre CENTQUATRE in Paris is now online.
Since about 5 years, CataRT is used extensively as a performance instrument by a growing number of musicians, and has stabilised and been tried and tested in many performances. This is why the Inventor Composer Coaction call for new instruments was a welcome occasion to present this instrument to a wider audience, and to advance towards a systematic assessment of how to play and compose with CataRT.
To this end, the CataRT as an Instrument page collects the links to sound and video examples demonstrating CataRT as an expressive performance instrument. More…
Urban Musical Game was created for the festival Future en Seine in June 2011 by IRCAM – Centre Pompidou, the design agency NoDesign and the association Phonotonic in collaboration with the composer Andrea Cera.
The installation features balls augmented by wireless sensor technology inducing the generation of digital sounds and music tracks. Uniting music and sports, the game embraces challenges and rules of both universes.
Urban Musical Game was created for
the festival Future en Seine in June 2011 by IRCAM – Centre Pompidou, the design agency NoDesign and the association Phonotonic in collaboration with the composer Andrea Cera.
The installation features balls augmented by wireless sensor technology inducing the generation of digital sounds and music tracks. Uniting music and sports, the game embraces challenges and rules of both universes.
