Real-time binaural room modelling for augmented reality applications

Yeoward, Christopher; Shukla, Rishi; Stewart, Rebecca; Sandler, Mark; Reiss, Joshua D.

doi:10.17743/jaes.2021.0046

Cited by 5 publications

(5 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A real-time binaural room modeling proposal for AR applications based on Scattering Delay Network (SDN) reverberation was presented by Yeoward, et al in 2021 [19]. The combination of Digital Waveguide Network (DWN) and ray-tracing Image Source Method (ISM) approaches for SDN reverberation provides physical accuracy close to room simulation models while meeting the lower processing requirements of other reverberators that use delay networks [19][20][21]. A study by Djordjevic et al [22] indicated that SDNs are considered more natural than binaural room impulse responses, ray tracing, and feedback delay networks in evaluations based on non-interactive simulations of two listening rooms.…”

Section: Reverberation Algorithms For Ar Scenariosmentioning

confidence: 99%

“…A study by Djordjevic et al [22] indicated that SDNs are considered more natural than binaural room impulse responses, ray tracing, and feedback delay networks in evaluations based on non-interactive simulations of two listening rooms. However, the suitability of SDNs for AR applications needs to be determined, as binaural SDN models have not been proposed in real-time architectures suitable for mobile or wearable computing devices [19].…”

Section: Reverberation Algorithms For Ar Scenariosmentioning

confidence: 99%

See 1 more Smart Citation

Perceptual Similarities between Artificial Reverberation Algorithms and Real Reverberation

Kearney

Daffern

2023

Applied Sciences

View full text Add to dashboard Cite

This paper presents a study evaluating the perceptual similarity between artificial reverberation algorithms and acoustic measurements. An online headphone-based listening test was conducted and data were collected from 20 expert assessors. Seven reverberation algorithms were tested in the listening test, including the Dattorro, Directional Feedback Delay Network (DFDN), Feedback Delay Network (FDN), Gardner, Moorer, and Schroeder reverberation algorithms. A new Hybrid Moorer–Schroeder (HMS) reverberation algorithm was included as well. A solo cello piece, male speech, female singing, and a drumbeat were rendered with the seven reverberation algorithms in three different reverberation times (0.266 s, 0.95 s and 2.34 s) as the test conditions. The test was conducted online and based on the Multiple Stimuli with Hidden Reference and Anchor (MUSHRA) paradigm. The reference conditions consisted of the same audio samples convolved with measured binaural room impulse responses (BRIRs) with the same three reverberation times. The anchor was dual-mono 3.5 kHz low pass filtered audio. The similarity between the test audio and the reference audio was scored on a scale of zero to a hundred. Statistical analysis of the results shows that the Gardner and HMS reverberation algorithms are good candidates for exploration of artificial reverberation in Augmented Reality (AR) scenarios in future research.

show abstract

Section: Reverberation Algorithms For Ar Scenariosmentioning

confidence: 99%

Section: Reverberation Algorithms For Ar Scenariosmentioning

confidence: 99%

Perceptual Similarities between Artificial Reverberation Algorithms and Real Reverberation

Kearney

Daffern

2023

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…The reverberation tail is thus spatialised according to the direction of the first-order reflections. Yeoward et al (2021) recently used a different approach to generate a binaural output for SDN. There, binaural signals were generated from the output of a virtual loudspeaker array that rotated in unison with the listener's orientation, while the loudspeaker gains were updated according to the relative direction of first-order reflections using panning.…”

Section: Audio Renderingmentioning

confidence: 99%

“…Scattering Delay Networks (SDN) (De Sena et al, 2015) was the room acoustic model used in the tests described in this paper. SDN is particularly suitable for use in computer gaming, VR and AR and other real-time rendering applications (Geronazzo et al, 2020;Yeoward et al, 2021), owing to its spatial fidelity and computational efficiency, achieved by rendering accurately only the most perceptually significant reflections.…”

Section: Introductionmentioning

confidence: 99%

On the Relative Importance of Visual and Spatial Audio Rendering on VR Immersion

Potter

Cvetković

Sena

2022

Front. Signal Process.

View full text Add to dashboard Cite

A study was performed using a virtual environment to investigate the relative importance of spatial audio fidelity and video resolution on perceived audio-visual quality and immersion. Subjects wore a head-mounted display and headphones and were presented with a virtual environment featuring music and speech stimuli using three levels each of spatial audio quality and video resolution. Spatial audio was rendered monaurally, binaurally with head-tracking, and binaurally with head-tracking and room acoustic rendering. Video was rendered at resolutions of 0.5 megapixels per eye, 1.5 megapixels per eye, and 2.5 megapixels per eye. Results showed that both video resolution and spatial audio rendering had a statistically significant effect on both immersion and audio-visual quality. Most strikingly, the results showed that under the conditions that were tested in the experiment, the addition of room acoustic rendering to head-tracked binaural audio had the same improvement on immersion as increasing the video resolution five-fold, from 0.5 megapixels per eye to 2.5 megapixels per eye.

show abstract

“…SDN has been shown to result in (a) a higher "naturalness" than feedback delay networks (FDNs) [11], convolution methods and ray-tracing [12], (b) a greater sense of externalisation than higher-order ambisonics measurements [13], and (c) a greater sense of immersion in VR environments [14]. Furthermore, it was successfully incorporated in various realtime binaural rendering applications [13], [15], [16], and it has since been extended to (a) model outdoor scenes [17], (b) coupled enclosures [18], and (c) exact modelling of higherorder reflections [19]. Although the results presented in this paper may only be applicable to SDN modelling, it is possible that the findings extend to other reverberation techniques.…”

Section: Introductionmentioning

confidence: 99%

User Expectation of Room Acoustic Parameters in Virtual Reality Environments

Burnett,

Neidhardt,

Cvetković

et al. 2023

2023 Immersive and 3D Audio: From Architecture to Automotive (I3DA)

View full text Add to dashboard Cite

This paper explores how visual attributes of a VR scene affect user expectations of room reverberation. A psychoacoustic experiment was run wherein subjects wore a VR headset and adjusted two unlabelled sliders controlling the reverberation time (T60) and the acoustic room size until the reverberant response was closest to their expectation of how the room they were seeing should sound. Different visual characteristics, in particular, room type and size, surface material, and furnishing were modified to determine how these might affect their expectations of the reverberant response. Results showed that visual room size had a significant effect on both the expected T60, in agreement with previous literature, and on the expected acoustic room size. Both relations seem to be well-described by a simple sublinear power law model, which could be used, for instance, to design reverberation time (T60) and acoustic room size values that align well with listeners' expectation for a given visual room volume. Differences in visual surface materials were found to have a statistically significant effect on the expected T60. The level of visual furnishing, on the other hand, only had a marginally significant effect on the expected T60. The results also indicate considerable subjective differences in individual expectations.

show abstract

Real-time binaural room modelling for augmented reality applications

Cited by 5 publications

References 19 publications

Perceptual Similarities between Artificial Reverberation Algorithms and Real Reverberation

Perceptual Similarities between Artificial Reverberation Algorithms and Real Reverberation

On the Relative Importance of Visual and Spatial Audio Rendering on VR Immersion

User Expectation of Room Acoustic Parameters in Virtual Reality Environments

Contact Info

Product

Resources

About