Indirection between movement and sound in an interactive sound installation

Fehr, Jonas; Erkut, Cumhur

doi:10.1145/2790994.2791016

Cited by 4 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Studies that proposed sonification models to translate higher-level movement features are less common. Some, e.g., [12,16,17], focus on the sonification of Effort qualities from the Laban movement analysis (LMA) system [28]. Camurri et al [7] proposed a interactive sonification system to support the process of learning specific movement qualities like, for example, dynamic symmetry.…”

Section: Related Workmentioning

confidence: 99%

Does embodied training improve the recognition of mid-level expressive movement qualities sonification?

Niewiadomski

Mancini

Cera

et al. 2018

J Multimodal User Interfaces

View full text Add to dashboard Cite

This research is a part of a broader project exploring how movement qualities can be recognized by means of the auditory channel: can we perceive an expressive full-body movement quality by means of its interactive sonification? The paper presents a sonification framework and an experiment to evaluate if embodied sonic training (i.e., experiencing interactive sonification of your own body movements) increases the recognition of such qualities through the auditory channel only, compared to a non-embodied sonic training condition. We focus on the sonification of two mid-level movement qualities: fragility and lightness. We base our sonification models, described in the first part, on the assumption that specific compounds of spectral features of a sound can contribute to the cross-modal perception of a specific movement quality. The experiment, described in the second part, involved 40 participants divided into two groups (embodied sonic training vs. no training). Participants were asked to report the level of lightness and fragility they perceived in 20 audio stimuli generated using the proposed sonification models. Results show that (1) both expressive qualities were correctly recognized from the audio stimuli, (2) a positive effect of embodied sonic training was observed for fragility but not for lightness. The paper is concluded by the description of the artistic performance that took place in 2017 in Genoa (Italy), in which the outcomes of the presented experiment were exploited. KeywordsSonification • Expressive qualities • Lightness • Fragility • Movement qualities • Embodied training M. Mancini participated to this work while being member of the Casa Paganini-

show abstract

Section: Related Workmentioning

confidence: 99%