Creation of Auditory Augmented Reality Using a Position-Dynamic Binaural Synthesis System—Technical Components, Psychoacoustic Needs, and Perceptual Evaluation

Werner, Stephan; Klein, Florian; Neidhardt, Annika; Sloma, Ulrike; Schneiderwind, Christian; Brandenburg, Karlheinz

doi:10.3390/app11031150

Cited by 13 publications

(12 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One approach to this is by combining environmental IRs and HRTFs [139] when rendering virtual sounds. Alternatively, researchers can directly measure a user's binaural room impulse responses (BRIRs) in the environment of interest, which integrate room acoustics and the user's personal auditory perception [140,141] in one measurement. To avoid the complexity of in-situ measurements, it is also possible to simulate perceptually plausible BRIRs [142].…”

Section: Spatial Sound Synthesismentioning

confidence: 99%

Audio Augmented Reality: A Systematic Review of Technologies, Applications, and Future Research Directions

Yang¹,

Barde²,

Billinghurst³

2022

J. Audio Eng. Soc.

View full text Add to dashboard Cite

Audio Augmented Reality (AAR) aims to augment people's auditory perception of the real world by synthesizing virtual spatialized sounds. AAR has begun to attract more research interest in recent years, especially because Augmented Reality (AR) applications are becoming more commonly available on mobile and wearable devices. However, because audio augmentation is relatively under-studied in the wider AR community, AAR needs to be further investigated in order to be widely used in different applications. This paper systematically reports on the technologies used in past studies to realize AAR and provides an overview of AAR applications. A total of 563 publications indexed on Scopus and Google Scholar were reviewed, and from these, 117 of the most impactful papers were identified and summarized in more detail. As one of the first systematic reviews of AAR, this paper presents an overall landscape of AAR, discusses the development trends in techniques and applications, and indicates challenges and opportunities for future research. For researchers and practitioners in related fields, this review aims to provide inspirations and guidance for conducting AAR research in the future.

show abstract

Section: Spatial Sound Synthesismentioning

confidence: 99%

Audio Augmented Reality: A Systematic Review of Technologies, Applications, and Future Research Directions

Yang¹,

Barde²,

Billinghurst³

2022

J. Audio Eng. Soc.

View full text Add to dashboard Cite

show abstract

“…Note that the scope of this chapter covers reverberation's spatial features from the listener's point of view, but not from the source's point of view. Therefore, sound source directivity is not discussed, even though it is an important topic on its own-e.g., it is essential to model it correctly in a six-degrees-of-freedom (6DoF) application where the listener is allowed to walk past a directional source [51].…”

Section: Simulating Reverberation Efficientlymentioning

confidence: 99%

Reverberation and its Binaural Reproduction: The Trade-off between Computational Efficiency and Perceived Quality

Engel¹,

Picinali²

2022

Advances in Fundamental and Applied Research on Spatial Audio

View full text Add to dashboard Cite

Accurately rendering reverberation is critical to produce realistic binaural audio, particularly in augmented reality applications where virtual objects must blend in seamlessly with real ones. However, rigorously simulating sound waves interacting with the auralised space can be computationally costly, sometimes to the point of being unfeasible in real time applications on resource-limited mobile platforms. Luckily, knowledge of auditory perception can be leveraged to make computational savings without compromising quality. This chapter reviews different approaches and methods for rendering binaural reverberation efficiently, focusing specifically on Ambisonics-based techniques aimed at reducing the spatial resolution of late reverberation components. Potential future research directions in this area are also discussed.

show abstract

“…Furthermore, a simple approximation can be employed by convolving HRTF corresponding to the direction of source relative to the listener with a fixed RIR for all positions in the same environment. Neidhardt et al indicated that the adaptation of only the direct sound with corresponding HRTFs could be used to create convincing virtual sound illusions [72].…”

Section: A Room Auralization Using Rendering Filtermentioning

confidence: 99%

“…Another important consideration in dynamic rendering is the position resolution for the BRIR update. Efficient dynamic rendering can be achieved by updating BRIRs based on the required minimum grid resolution of the user's positional changes [72]. The minimum grid resolution can be derived based on perceptual thresholds such as minimum audible angle for head rotations and the just noticeable differences of distance changes induced by the user's head/body translation.…”

Section: A Room Auralization Using Rendering Filtermentioning

confidence: 99%

Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering

Gupta

Ranjan

et al. 2022

IEEE Signal Process. Mag.

Self Cite

View full text Add to dashboard Cite

UGMENTED OR MIXED REALITY (AR/MR) is emerging as one of the key technologies in the future of computing. Audio cues are critical for maintaining a high degree of realism, social connection, and spatial awareness for various AR/MR applications such as teaching and training, gaming, remote work, education, and virtual social gatherings. Motivated by a wide variety of AR/MR listening experiences delivered over hearables, this feature article systematically reviews the integration of fundamental and advanced signal processing techniques for AR/MR audio to equip the researchers and engineers in the signal processing community for the next wave of AR/MR. I. Introduction: AR/MR audio experience over hearablesAlternate reality technologies aim to provide a feeling of presence to humans through engaging multi-modal content.We define AR/MR as an alternate reality experience achieved by the seamless fusion of the reproduced virtual content with the real-world stimuli that can be modified as desired. This definition expands on AR's previous usage, where the experiences provided were limited to the overlay of virtual content in the real world. It can also include other alternate reality technologies, such as virtual reality (VR), where users can get transported to a virtual environment.The immersive AR/MR technologies have demonstrated substantial benefits in various applications such as education and training, tourism, and remote working. We have seen significant progress in rendering AR/MR devices' different modalities in the past few decades. In particular, the new lifestyle of reduced physical connection triggered by the COVID-19 pandemic has made such needs even more critical than ever before. This paper focuses on sound (or audio), an inherent part of our everyday lives for communication, social interactions, and situational awareness. Unlike vision, where the field of view is limited, natural listening always spans a 360°range.The pervasive spatial perception of sound can be critical in a wide variety of high-stress situations, such as warnings for approaching vehicles or public announcements in case of emergencies where the visual cues may not be enough.Even in day-to-day cases, such as conversations among a group of people, we rely on audio cues to direct our attention towards a particular speaker, referred to as the cocktail party effect.Audio devices today can be broadly classified into two major categories: speakers and headphones. Speakers are widely used to playback audio content for multimedia applications, where a fixed configuration of speakers can provide the

show abstract

Creation of Auditory Augmented Reality Using a Position-Dynamic Binaural Synthesis System—Technical Components, Psychoacoustic Needs, and Perceptual Evaluation

Cited by 13 publications

References 25 publications

Audio Augmented Reality: A Systematic Review of Technologies, Applications, and Future Research Directions

Audio Augmented Reality: A Systematic Review of Technologies, Applications, and Future Research Directions

Reverberation and its Binaural Reproduction: The Trade-off between Computational Efficiency and Perceived Quality

Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering

Contact Info

Product

Resources

About