On the Upscaling of Higher-Order Ambisonics Signals for Sound Field Translation

Kentgens, Maximilian; Hares, Shahd Al; Jax, Peter

doi:10.23919/eusipco54536.2021.9615981

Cited by 4 publications

(5 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To address this limitation, methods often use additional assumptions or parametric information about the recording to gain extended translation. For example, methods use known or estimated source directions and/or distances [192,196,198,200,206], a distance map [197,199], or spatial sparsity assumptions [203,207]. While the translation distance is limited, the extrapolation-based approach benefits from its unobtrusive and cost efficient use of a single HOA microphone.…”

Section: Rotation and Translationmentioning

confidence: 99%

Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges

Rafaely

Tourbabin²,

Habets³

et al. 2022

Acta Acust.

View full text Add to dashboard Cite

Spatial audio has been studied for several decades, but has seen much renewed interest recently due to advances in both software and hardware for capture and playback, and the emergence of applications such as virtual reality and augmented reality. This renewed interest has led to the investment of increasing efforts in developing signal processing algorithms for spatial audio, both for capture and for playback. In particular, due to the popularity of headphones and earphones, many spatial audio signal processing methods have dealt with binaural reproduction based on headphone listening. Among these new developments, processing spatial audio signals recorded in real environments using microphone arrays plays an important role. Following this emerging activity, this paper aims to provide a scientific review of recent developments and an outlook for future challenges. This review also proposes a generalized framework for describing spatial audio signal processing for the binaural reproduction of recorded sound. This framework helps to understand the collective progress of the research community, and to identify gaps for future research. It is composed of five main blocks, namely: the acoustic scene, recording, processing, reproduction, and perception and evaluation. First, each block is briefly presented, and then, a comprehensive review of the processing block is provided. This includes topics from simple binaural recording to Ambisonics and perceptually motivated approaches, which focus on careful array configuration and design. Beamforming and parametric-based processing afford more flexible designs and shift the focus to processing and modeling of the sound field. Then, emerging machine- and deep-learning approaches, which take a further step towards flexibility in design, are described. Finally, specific methods for signal transformations such as rotation, translation and enhancement, enabling additional flexibility in reproduction and improvement in the quality of the binaural signal, are presented. The review concludes by highlighting directions for future research.

show abstract

Section: Rotation and Translationmentioning

confidence: 99%

Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges

Rafaely

Tourbabin²,

Habets³

et al. 2022

Acta Acust.

View full text Add to dashboard Cite

show abstract

“…locations with near life-like audio quality. At the near-end, either headphones [5]- [7] or loudspeaker arrays [8]- [10] can be used as the rendering device for AT, where the idea behind the latter rendering approach is similar to the sound field reconstruction techniques such as Ambisonics [11,12] and Wave Field Synthesis (WFS) [13,14]. In this study, we will focus on the Binaural Audio Telepresence (BAT).…”

Section: Introductionmentioning

confidence: 99%

Model-Matching Principle Applied to the Design of an Array-Based All-Neural Binaural Rendering System for Audio Telepresence

Hsu

Bai

2023

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

View full text Add to dashboard Cite

Audio Telepresence (AT) aims to create an immersive experience of the audio scene at the far end for the user(s) at the near end. The application of AT could encompass scenarios with varying degrees of emphasis on signal enhancement and ambience preservation. It is desirable for an AT system to be scalable between these two extremes. To this end, we propose an array-based Binaural AT (BAT) system using the DeepFilterNet as the backbone to convert the array microphone signals into the Head-Related Transfer Function (HRTF)-filtered signals, with a tunable weighting between signal enhancement and ambience preservation. An array configuration-independent Spatial COherence REpresentation (SCORE) feature is proposed for the model training so that the network remains robust to different array geometries and sensor counts. magnitude-weighted Interaural Phase Difference error (mw-IPDe), magnitude-weighted Interaural Level Difference error (mw-ILDe), and modified Scale-Invariant Signal-to-Distortion Ratio (mSI-SDR) are defined as performance metrics for objective evaluation. Subjective listening tests were also performed to validate the proposed BAT system. The results have shown that the proposed BAT system can achieve superior telepresence performance with the desired balance between signal enhancement and ambience preservation, even when the array configurations are unseen in the training phase.

show abstract

“…Using an emphasis operator [4][5][6] or increasing the order of encoded ambisonic signals [7][8][9][10][11][12][13][14][15][16][17] can improve spatial resolution. In [4,5], an objective estimator is built to localize sources while conserving energy.…”

Section: Introductionmentioning

confidence: 99%

“…In [4,5], an objective estimator is built to localize sources while conserving energy. Methods based on sparsity are presented in [7][8][9][10][11][12][13][14][15][16]. In [7][8][9][10][11][12], the solution matrix is obtained by using a uniform overcomplete spherical harmonics basis matrix, while in [16], a non-uniform spherical harmonics basis dictionary is employed.…”

Section: Introductionmentioning

confidence: 99%

“…Methods based on sparsity are presented in [7][8][9][10][11][12][13][14][15][16]. In [7][8][9][10][11][12], the solution matrix is obtained by using a uniform overcomplete spherical harmonics basis matrix, while in [16], a non-uniform spherical harmonics basis dictionary is employed. These sparse approaches rely on the conditioning of the dictionary matrix for their effectiveness.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Diversity Minimization Technique for Multiple Measurement Vector-based Super-resolution spatial Audio Imaging

Routray,

Dwivedi,

Hegde

2022

Proceedings of the 10th Convention of the European Acoustics Association Forum Acusticum 2023

View full text Add to dashboard Cite

Ambisonics is an efficient spatial sound acquisition and reproduction technique in the spherical harmonic domain. At low frequencies, lower-order ambisonics reproduction is accurate, but at high frequencies, the spatial resolution suffers. An increase in frequency shrinks the radius of the error-free region and degrades the spatial resolution. Higher-order ambisonics (HOA) provided better spatial resolution in this context. However, sound spatial acquisition in HOA is constrained by hardware complexity and storage space, in contrast to low-order ambisonics (Bformat). So, it is worthwhile to acquire the sound scene at low order to reduce hardware complexity and storage requirement and upscale to a higher order while reproducing to improve the spatial resolution. This work investigated algorithms based on minimizing the diversity measures for obtaining higher-order ambisonics from the B-format signals. In particular, we are interested in the FOCUSS (FOCal Underdetermined System Solver) class of algorithms, which is an alternative and complementary approach to the sequential forward method to solve the sparse inverse problem. The performance of the proposed upscaling method is evaluated using the mean square error metrics. The subjective evaluation is performed using a listening test and compared with state-of-art methods.

show abstract

On the Upscaling of Higher-Order Ambisonics Signals for Sound Field Translation

Cited by 4 publications

References 12 publications

Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges

Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges

Model-Matching Principle Applied to the Design of an Array-Based All-Neural Binaural Rendering System for Audio Telepresence

Diversity Minimization Technique for Multiple Measurement Vector-based Super-resolution spatial Audio Imaging

Contact Info

Product

Resources

About