Application of Machine Learning for the Spatial Analysis of Binaural Room Impulse Responses

Abstract

Abstract:Spatial impulse response analysis techniques are commonly used in the field of acoustics, as they help to characterise the interaction of sound with an enclosed environment. This paper presents a novel approach for spatial analyses of binaural impulse responses, using a binaural model fronted neural network. The proposed method uses binaural cues utilised by the human auditory system, which are mapped by the neural network to the azimuth direction of arrival classes. A cascade-correlation neural network was trained using a multi-conditional training dataset of head-related impulse responses with added noise. The neural network is tested using a set of binaural impulse responses captured using two dummy head microphones in an anechoic chamber, with a reflective boundary positioned to produce a reflection with a known direction of arrival. Results showed that the neural network was generalisable for the direct sound of the binaural room impulse responses for both dummy head microphones. However, it was found to be less accurate at predicting the direction of arrival of the reflections. The work indicates the potential of using such an algorithm for the spatial analysis of binaural impulse responses, while indicating where the method applied needs to be made more robust for more general application.

The Past Has Ears (PHE): XR Explorations of Acoustic Spaces as Cultural Heritage

“…An evaluation of current state-of-the-art and under development modelling methods will be carried out, examining for example ray-tracing, digital waveguides, image-source method, finite-difference time domain (FDTD), and stochastic processing approaches which have all been shown to hold hold some promise which each exhibit certain limitations. The quality of resulting simulations are evaluated regarding authenticity from metric analysis perspectives and human perception perspectives, as listening to digital reconstructions is often more meaningful as a means to study acoustic heritage and to communicate its cultural nature, raising awareness for non-specialists [9,14].…”

Special Issue on “Sound and Music Computing”

“…More work on this topic is needed, to be able to study room acoustics with machine learning. Lovedee-Turner and Murphy [10] have collected a database of spatial sound recordings for the purpose of classification of acoustic scenes as well as the material for machine learning algorithms. To validate the database they also introduce a classifier that performs better than a traditional Mel-frequency-cepstral-coefficient classifier.…”

Binaural Modelling and Spatial Auditory Cue Analysis of 3D-Printed Ears

“…For binaural localization in targeted rooms, statistical relationships between sound signals and room transfer functions can be analyzed prior to real-time location estimations, such as the work presented in [ 17 ]. The accuracy can be further enhanced by jointly estimating the azimuth and the distance of binaural signals using artificial neural network [ 18 , 19 ]. Another approach utilizing the room’s reverberation properties has been proposed in [ 20 ], where the reverberation weighting is used to separately attenuate the early and late reverberations while preserving the interaural cues.…”