Software

PiPo SDK release v0.1

3 Jul , 2015  

Update: the PiPo SDK v0.2 is now available on Ircam R&D‘s GitHub!

The PiPo module API for writing your own processing and analysis objects is now available and documented here: http://recherche.ircam.fr/equipes/temps-reel/mubu/pipo
It includes an example xcode project to build a simple pipo mxo for Max that also works within MuBu.

, , ,

Software // Videos

MaD — Mapping by Demonstration for Continuous Sonification

24 Mar , 2015   Gallery

MaD allows for simple and intuitive design of continuous sonic gestural interaction. The motion-sound mapping is automatically learned by the system when movement and sound examples are jointly recorded. In particular, our applications focus on using vocal sounds – recorded while performing action, – as primary material for interaction design. The system integrates of specific probabilistic models with hybrid sound synthesis models. Importantly, the system is independent to the type of motion/gesture sensing devices, and can directly accommodate the use different sensors such as, cameras, contact microphones, and inertial measurement units. The application concerns performing arts, gaming but also medical applications such auditory-aided rehabilitation. More…

, , , , ,

Project // Videos

Gestural sonic interaction: the virtual bath tub

22 Jan , 2015   Video

Gestural sonic interaction: playing with a virtual water tub. Sound samples are controlled with hand movements, by splashing water or sweeping under the surface.

Conception: Eric O. Boyer (Ircam & LPP), Sylvain Hanneton (LPP), Frédéric Bevilacqua (Ircam)
Technology: MuBu and LeapMotion Max object, ISMM team at Ircam-STMS CNRS UPMC
Sound materials: Roland Cahen & Diemo Schwarz – Topophonie project

With the support of ANR LEGOS project.

, , , , , ,

Software

Leap Motion skeletal tracking in Max

7 Nov , 2014  

We developed a new object for using the Leap Motion in Max, based on the Leap Motion SDK V2 Skeletal Tracking Beta. More…

, ,

Software

mubu.*mm: Probabilistic Models for Designing Motion & Sound Relationships

5 Jul , 2014   Gallery

We just released the beta version of mubu.*mm, a set of objects for probabilistic modeling of motion and sound relationships. More…

, , ,

Software

MuBu

3 Mar , 2014  

MuBu for Max

A toolbox for Multimodal Analysis of Sound and Motion, Interactive Sound Synthesis and Machine Learning.

Including :

  • real-time and batch data processing (sound descriptors, motion features, filtering);
  • granular, concatenative and additive synthesis;
  • data visualization;
  • static and temporal recognition;
  • regression algorithms

The main MuBu object (for multi-buffer) is a multi-track container for sound description and motion capture data. The object imubu is an editor and visualizer of the mubu content. A set of externals for content based real-time interactive audio processing can access to the shared memory of the MuBu container.

More…