Music via Motion: Transdomain Mapping of Motion and Sound for Interactive Performances

EvoMove: Evolutionary-based living musical companion

“…However, the most exciting perspective is to explore the artistic landscape opened by this "living" musical companion. Indeed, while several examples of systems (Ng, 2004) or performances (Variations V by Merce Cunningham and John Cage, or Virus/Antivirus by Cie Lanabel), also use motion sensors, the novelty of Evo-Move is to let open the mapping between the motion space and the sound space. Indeed, the correspondence between sounds and movements is not chosen in advance, it is built on-the-fly depending on the moves made and repeated by the performers.…”

A Virtual Reality Drumkit Simulator System with a Kinect Device

“…Advanced human-computer interfaces to implement a more natural or immersive interaction with music have been proposed and/or studied in previous works for a wide array of applications: gaming (Gower & McDowall, 2012) (Wang & Lai, 2011), new instruments creation/simulation (Jordà, 2010), medical rehabilitation (De Dreu, Van der Wilk, Poppe, Kwakkel, & Van Wegen, 2012), modification of visual patterns by using sung or speech voice (Levin & Lieberman, 2004), body motion to sound mapping (Antle, Droumeva, & Corness, 2008) (Castellano, Bresin, Camurri, & Volpe, 2007) (Halpern et al, 2011) (Khoo et al, 2008), orchestra conductor simulation (Morita, Hashimoto, & Ohteru, 1991) (Parton & Edwards, 2009) (Todoroff, Leroy, & Picard-Limpens, 2011), tangible and haptic instrument simulation (Bakker, van den Hoven, & Antle, 2011) (Holland, Bouwer, Dalgelish, & Hurtig, 2010), drum-hitting simulation (Höofer, Hadjakos, & Mühlhäuser, 2009) (Ng, 2004) (Trail et al, 2012) (Odowichuk, Trail, Driessen, Nie, & Page, 2011), etc. Some of the problems commonly identified with advanced human-computer interfaces is that they are usually expensive, intrusive and/ or bulky, being prone to raise ergonomic issues. Fortunately, the emergence of devices like the Wiimote and Kinect has helped to mitigate such issues.…”