Quantum: An art-science case study on sonification and sound design in virtual reality

Morawitz, Falk

doi:10.1109/sive.2018.8577080

Cited by 3 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The use of NMR data in an art-science context has only recently been explored, with the incorporation of audified NMR data into electroacoustic music compositions [11] [12]. It has been shown that NMR sonification is not only a source of new musical timbres, but it can be used as an auditory indicator of inter-molecular interactions in virtual reality art installations [13]. The use of hydrogen-1 and carbon-13 NMR data for sonification has been examined elsewhere [11] and is well suited to display structural features of small molecules as sound.…”

Section: (1)mentioning

confidence: 99%

“…In these compositions, NMR data have been used for purely aesthetic purposes, to create and experiment with these data-based timbres and their impact on compositional procedures. NMR data have also been implemented as auditory information on molecular states for 3D molecular representations in virtual reality [13]. One of the biggest challenges for the deployment of NMR data sonification in music and sound art is the abstract nature of NMR data [13], making it hard for the audience to link the sounds heard to the underlying data.…”

Section: Nmr Sonification In Acousmatic Music Compositionmentioning

confidence: 99%

“…NMR data have also been implemented as auditory information on molecular states for 3D molecular representations in virtual reality [13]. One of the biggest challenges for the deployment of NMR data sonification in music and sound art is the abstract nature of NMR data [13], making it hard for the audience to link the sounds heard to the underlying data. However, this link between data and sonification-based sound material is important for art and music-based works, as it has been noted for various art installations that the audience gains a deeper appreciation of the artwork when the link between data and audio-visual spectacle is clear [27].…”

Section: Nmr Sonification In Acousmatic Music Compositionmentioning

confidence: 99%

See 2 more Smart Citations

Multilayered Narration in Electroacoustic Music Composition Using Nuclear Magnetic Resonance Data Sonification and Acousmatic Storytelling

Morawitz¹

2019

Proceedings of the 25th International Conference on Auditory Display (ICAD 2019)

Self Cite

View full text Add to dashboard Cite

Nuclear magnetic resonance (NMR) spectroscopy is an analytical tool to determine the structure of chemical compounds. Unlike other spectroscopic methods, signals recorded using NMR spectrometers are frequently in a range of zero to 20000 Hz, making direct playback possible. As each type of molecule has, based on its structural features, distinct and predictable features in its NMR spectra, NMR data sonification can be used to create auditory ‘fingerprints’ of molecules. This paper describes the methodology of NMR data sonification of the nuclei nitrogen, phosphorous, and oxygen and analyses the sonification products of DNA and protein NMR data. The paper introduces On the Extinction of a Species, an acousmatic music composition combining NMR data sonification and voice narration. Ideas developed in electroacoustic composition, such as acousmatic storytelling and sound-based narration are presented and investigated for their use in sonification-based creative works.

show abstract

Section: (1)mentioning

confidence: 99%

Section: Nmr Sonification In Acousmatic Music Compositionmentioning

confidence: 99%

Section: Nmr Sonification In Acousmatic Music Compositionmentioning

confidence: 99%

See 1 more Smart Citation

Multilayered Narration in Electroacoustic Music Composition Using Nuclear Magnetic Resonance Data Sonification and Acousmatic Storytelling

Morawitz¹

2019

Proceedings of the 25th International Conference on Auditory Display (ICAD 2019)

Self Cite

View full text Add to dashboard Cite

show abstract

“…revolution" into a sound art composition (Christidis and Carpentier 2017). Other applications have combined sonification with a virtual reality environment to provide users with a visual frame of reference and an increased sense of immersion (Morawitz 2018).…”

Section: Sound and Sonification In Artmentioning

confidence: 99%

Towards a More Inclusive Museum: Developing Multi-Sensory Approaches to the Visual Arts for Visually Impaired Audiences

Berube¹

View full text Add to dashboard Cite

This thesis investigates the contribution of multi-sensoriality to the understanding and appreciation of two-dimensional artworks, such as drawings or paintings, by people with visual impairments. This exploratory study was conducted from a disability studies perspective, in which the researcher's role was that of a facilitator and the participants were experts of their own experience. This participatory action project draws on interdisciplinary research practices in several interrelated fields, including accessibility and disability studies, blindness studies, anthropology of the senses, tactile perception and haptics, and translation studies. Previous research focused primarily on initiatives to translate visual arts into tactile content to make them accessible to people with visual impairments. The present study contributes to multi-sensory initiatives for the low-vision and blind community, drawing on research findings of sensory museology and cognitive psychology to deepen our knowledge about multi-sensory translation.Data collected from three rounds of individual interviews and one co-design session with visually impaired participants was examined using a qualitative methodology. A thematic analysis was developed to inform design decisions and identify barriers to inclusion in art museums. The study also included the co-creation of multisensory translations of Franklin Carmichael's painting In the Nickel Belt (1928) and Outport Icon #2 (2001 by Duncan de Kergommeaux. The broader findings of this study provide evidence to support the notion that touch and hearing can play a valuable role in conveying the nature of art to visually impaired visitors, giving them greater autonomy in their interpretation.This study challenges the long-standing tradition of museums relying on vision as the only acceptable sense through which visitors can access visual arts. While further work may be needed to assess the degree of equivalence between experiencing a painting through sight and accessing it through touch and hearing, this project establishes a foundation for further research and initiatives pertaining to the implementation of antiocularcentric approaches in museums.

show abstract

Apple Swipe: A Mobile Game Apps for Visually Impaired Users Using Binaural Sounds

Norowi

Azman

Wahat

2021

Asian CHI Symposium 2021

View full text Add to dashboard Cite

Quantum: An art-science case study on sonification and sound design in virtual reality

Cited by 3 publications

References 5 publications

Multilayered Narration in Electroacoustic Music Composition Using Nuclear Magnetic Resonance Data Sonification and Acousmatic Storytelling

Multilayered Narration in Electroacoustic Music Composition Using Nuclear Magnetic Resonance Data Sonification and Acousmatic Storytelling

Towards a More Inclusive Museum: Developing Multi-Sensory Approaches to the Visual Arts for Visually Impaired Audiences

Apple Swipe: A Mobile Game Apps for Visually Impaired Users Using Binaural Sounds

Contact Info

Product

Resources

About