Six-Degrees-of-Freedom Parametric Spatial Audio Based on One Monaural Room Impulse Response

Arend, Johannes M.; Garí, Sebastià V. Amengual; Schissler, Carl; Klein, Florian; Robinson, Philip W.

doi:10.17743/jaes.2021.0009

Cited by 10 publications

(6 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Employing spatial audio techniques is one method of sound simulation in acoustic VR research. Spatial audio entails the recording and reproduction of sound in a manner that generates the listener a sense of localisation and spatialization [27,28], which aims to replicate a real-world acoustic environment through sound recording, or to synthesize realistic new ones. Spatialized sounds heighten the sense of presence in auditory virtual environments, consequently, there is definitely a significant relation between physiological and psychological responses towards spatialized sounds [29].…”

Section: Realistic Spatial Audio Sourcesmentioning

confidence: 99%

A Conceptual Framework for Immersive Acoustic Auralisation: Investigating the Key Attributes

Khairul Anuar,

Sulaiman,

Che Din

et al. 2024

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

In architectural acoustics, the assessment of sound propagation in interior and/or environmental conditions has now become progressively more prominent throughout the past few decades, as a response to the development of advanced prediction tools. Within the adaptation of virtual reality (VR) systems, it is necessary to considerably expedite the prediction and simulation software as well as to enable flexible and responsive data analysis during simulation and 3D audio sensory projection. To generate ideal immersion in a simulated virtual environment, the generated stimulus across all senses should therefore be coherent. Accordingly, in the domain of acoustic in virtual reality, the system sound simulation must be constructed efficiently in order to convey the auditory stimuli to the user in an appropriate manner. This necessitates the implementation of virtual reality system as an advanced prediction tool that can accurately anticipate and replicate realistic audio experiences. Therefore, this study explores the realm of acoustic virtual reality (AVR) through a critical review with the purpose of elucidating design attributes and determining factors in generating immersive acoustic VR experiences. In light of these findings, the aim of this paper is to develop a comprehensive conceptual framework that will serve as a beneficial guide and road map for future researchers and developers in the field.

show abstract

Section: Realistic Spatial Audio Sourcesmentioning

confidence: 99%

A Conceptual Framework for Immersive Acoustic Auralisation: Investigating the Key Attributes

Khairul Anuar,

Sulaiman,

Che Din

et al. 2024

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

show abstract

“…Besides, for example, semantic and visual information can be used to estimate acoustic properties (Kim et al, 2017, 2020). BRIR synthesis can be realized either by pure simulation, for example, based on ray-tracing (Savioja & Svensson, 2015; Brinkmann et al, 2019), wave-based simulation approaches or delay networks (Alary et al, 2019; Välimäki et al, 2012) or by manipulation of measured impulse responses, like interpolation (Bruschi et al, 2020; Brinkmann et al, 2020), extrapolation (Neidhardt et al, 2018; Sloma et al, 2019; Coleman et al, 2017; Pörschmann et al, 2017) or shaping of the late reverberation tail (Jot & Lee, 2016; Pörschmann & Zebisch, 2012; Arend et al, 2021). Systems that do not rely on a priori knowledge are desired because their use is not limited to rooms or environments for which the predetermined information is available.…”

Section: Basic Technical System For Auditory Augmented Realitymentioning

confidence: 99%

“…One approach is to extract the energy decay relief (EDR) and frequency-dependent decay curves. These can be scaled according to the reverberation properties of the desired room (Jot & Lee, 2016) or by extracting envelopes of subbands resulting from a filterbank analysis and applying them to shape a binaural noise sequence (Pörschmann & Zebisch, 2012; Arend et al, 2021).…”

Section: Required Accuracy Of Physical Propertiesmentioning

confidence: 99%

Perceptual Matching of Room Acoustics for Auditory Augmented Reality in Small Rooms - Literature Review and Theoretical Framework

2022

Self Cite

View full text Add to dashboard Cite

For the realization of auditory augmented reality (AAR), it is important that the room acoustical properties of the virtual elements are perceived in agreement with the acoustics of the actual environment. This perceptual matching of room acoustics is the subject reviewed in this paper. Realizations of AAR that fulfill the listeners’ expectations were achieved based on pre-characterization of the room acoustics, for example, by measuring acoustic impulse responses or creating detailed room models for acoustic simulations. For future applications, the goal is to realize an online adaptation in (close to) real-time. Perfect physical matching is hard to achieve with these practical constraints. For this reason, an understanding of the essential psychoacoustic cues is of interest and will help to explore options for simplifications. This paper reviews a broad selection of previous studies and derives a theoretical framework to examine possibilities for psychoacoustical optimization of room acoustical matching.

show abstract

“…Once estimates are obtained, parameters like the directions of arrival (DoAs) of early reflections and the spatiotemporal envelope of the late reverberation are determined from it, all with the intention of using them to render virtual sound sources. Virtual acoustic rendering using a limited set of parameters [6] is likely to yield sufficient quality for transfer-plausibility. In contrast to applications such as echo cancellation or dereverberation, where estimation methods have to be accurate enough to successfully invert the system, the goal of merely extracting sound field parameters is likely to relax the requirements on the system identification.…”

Section: Introductionmentioning

confidence: 99%

Blind Directional Room Impulse Response Parameterization from Relative Transfer Functions

Meyer-Kahlen

Schlecht

2022

2022 International Workshop on Acoustic Signal Enhancement (IWAENC)

View full text Add to dashboard Cite

Acquiring information about an acoustic environment without conducting dedicated measurements is an important problem of forthcoming augmented reality applications, in which real and virtual sound sources are combined. We propose a straightforward method for estimating directional room impulse responses from running signals. We adaptively identify relative transfer functions between the output of a beamformer pointing into the direction of a single active sound source and the complete set of spherical harmonics domain signals, representing all directions. To this end, estimation is performed with a frequency domain recursive least squares algorithm. Then, parameters such as the directions of arrival of early reflections and the reverberation time are extracted. Estimation of the direct-to-reverberant ratio requires dedicated processing. We show examples of successful estimation from speech signals, based on a simulated and a measured response.

show abstract

Six-Degrees-of-Freedom Parametric Spatial Audio Based on One Monaural Room Impulse Response

Cited by 10 publications

References 21 publications

A Conceptual Framework for Immersive Acoustic Auralisation: Investigating the Key Attributes

A Conceptual Framework for Immersive Acoustic Auralisation: Investigating the Key Attributes

Perceptual Matching of Room Acoustics for Auditory Augmented Reality in Small Rooms - Literature Review and Theoretical Framework

Blind Directional Room Impulse Response Parameterization from Relative Transfer Functions

Contact Info

Product

Resources

About