Comparative study on the effect of Parameter Mapping Sonification on perceived instabilities, efficiency, and accuracy in real-time interactive exploration of noisy data streams

“…This provided a link between the proprioceptively known position of the subject's own hand and spatial cues in the binaural rendering. The alternation rate of the pink/white noise bursts increased with increasing angular proximity to the target direction using a Geiger counter metaphor [71,79]. Once the subject reached the intended target direction, a success sound would play, spatialised at the target's location.…”

Section: Hrtf Accommodation Examplementioning

confidence: 99%

System-to-User and User-to-System Adaptations in Binaural Audio

Picinali

Katz

2022

Sonic Interactions in Virtual Environments

View full text Add to dashboard Cite

This chapter concerns concepts of adaption in a binaural audio context (i.e. headphone-based three-dimensional audio rendering and associated spatial hearing aspects), considering first the adaptation of the rendering system to the acoustic and perceptual properties of the user, and second the adaptation of the user to the rendering quality of the system. We start with an overview of the basic mechanisms of human sound source localisation, introducing expressions such as localisation cues and interaural differences, and the concept of the Head-Related Transfer Function (HRTF), which is the basis of most 3D spatialisation systems in VR. The chapter then moves to more complex concepts and processes, such as HRTF selection (system-to-user adaptation) and HRTF accommodation (user-to-system adaptation). State-of-the-art HRTF modelling and selection methods are presented, looking at various approaches and at how these have been evaluated. Similarly, the process of HRTF accommodation is detailed, with a case study employed as an example. Finally, the potential of these two approaches are discussed, considering their combined use in a practical context, as well as introducing a few open challenges for future research.

show abstract

“…The same concept can be applied to predict the perceived dissonance of polyrhythms (Hannon, Soley, & Levine, 2011). These finding could be important for future emotional sonification projects that wish to convey tension with rhythm instead of pitch (Poirier-Quinot, Parseihian, & Katz, 2017 unclear how much the emotional ratings were influenced by the visual aspects of the dance performance as opposed to the music. Are all sounds perceived to be more emotional when paired with emotional visual gestures?…”

Section: Emotional Expressivitymentioning

confidence: 98%

Interactive Sonification Strategies for the Motion and Emotion of Dance Performances

Landry¹

View full text Add to dashboard Cite

Comparative study on the effect of Parameter Mapping Sonification on perceived instabilities, efficiency, and accuracy in real-time interactive exploration of noisy data streams

Cited by 4 publications

References 11 publications

Interactive sonification strategies for the motion and emotion of dance performances

Interactive sonification strategies for the motion and emotion of dance performances

System-to-User and User-to-System Adaptations in Binaural Audio

Interactive Sonification Strategies for the Motion and Emotion of Dance Performances

Contact Info

Product

Resources

About