Listening Touch

Giomi, Andrea; Fratagnoli, Federica

doi:10.1145/3212721.3212815

Cited by 3 publications

(1 citation statement)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Likewise, orientation is a preferred physical dimension, and is used most in combination with the following auditory categories: timbral as demonstrated by [127], [33], [128]; pitch as demonstrated by [85], [30], [129], [130]; spatial as demonstrated by [131]- [133]. Finally, acceleration is generally chosen in combination with the following auditory categories: loudness as demonstrated by [134], [135]; timbral as demonstrated by [136]- [141]; pitch as demonstrated by [142]- [144]. Outside of the PVAO physical dimensions, data obtained as force or pressure, as dictated by the use of a force or pressure sensor, has been combined with sampled sounds [145], and changes in loudness [84], timbral [32], pitch [69] and, temporal-related [71] auditory feedback.…”

Section: B Sonification Mappingmentioning

confidence: 99%

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

Nown

Upadhyay

Kerr

et al. 2023

IEEE Rev. Biomed. Eng.

View full text Add to dashboard Cite

Movement sonification is emerging as a useful tool for rehabilitation, with increasing evidence in support of its use. To create such a system requires component considerations outside of typical sonification design choices, such as the dimension of movement to sonify, section of anatomy to track, and methodology of motion capture. This review takes this emerging and highly diverse area of literature and keyword-code existing real-time movement sonification systems, to analyze and highlight current trends in these design choices, as such providing an overview of existing systems. A combination of snowballing through relevant existing reviews and a systematic search of multiple databases were utilized to obtain a list of projects for data extraction. The review categorizes systems into three sections: identifying the link between physical dimension to auditory dimension used in sonification, identifying the target anatomy tracked, identifying the movement tracking system used to monitor the target anatomy. The review proceeds to analyze the systematic mapping of the literature and provide results of the data analysis highlighting common and innovative design choices used, irrespective of application, before discussing the findings in the context of movement rehabilitation. A database containing the mapped keywords assigned to each project are submitted with this review.

show abstract

Section: B Sonification Mappingmentioning

confidence: 99%

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

Nown

Upadhyay

Kerr

et al. 2023

IEEE Rev. Biomed. Eng.

View full text Add to dashboard Cite

show abstract

A Phenomenological Approach to Wearable Technologies and Viscerality: From embodied interaction to biophysical music performance

Giomi

2023

Org. Sound

View full text Add to dashboard Cite

During the past decade, embodied knowledge has provided novel important insights to rethink mediation technology, thereby paving the way for a transdisciplinary approach to wearable technologies. Stemming from a phenomenological-based approach and considering current trends in sonic interaction design, this article proposes an extensive account on embodied approaches to mediation technology and underlines the increasing importance of somatic knowledge within the field. It also presents an autoethnographic analysis of my own performance, which provides an original contribution to the artistic application of wearable technologies. Stemming from an ongoing research-creation on musical improvisation with biophysical technologies, the case study emphasises how an embodied and visceral approach to interaction can transform wearable devices into an active sensory-perceptual mode of experiencing, which is capable of stimulating the performer’s sensorimotor metaplasticity. The reconfiguration of a body’s automations through the use of sound feedback is a process that unfolds with a high degree of sensitivity in which the body can be poetically understood as an emergent territoriality, inhabited and transfigured by the sound.

show abstract