How Well Can Driverless Vehicles Hear? An Introduction to Auditory Perception for Autonomous and Smart Vehicles

Abstract

From sirens to car horns, the urban environment is full of sounds that are designed to direct drivers' attention to conditions that require special care. Microphone-equipped autonomous vehicles can also use these acoustic cues to increase safety and performance. This article explores auditory perception in the context of autonomous driving and smart vehicles, in general, examining the potential of exploiting acoustic cues in driverless vehicle technology. With a journey through the literature, we discuss various applications of auditory perception in driverless vehicles, ranging from the identification and localization of external acoustic objects to leveraging ego noise for motion estimation and engine fault detection. In addition to solutions already proposed in the literature, we point out directions for further investigations, focusing, in particular, on parallel studies in the areas of acoustics and audio signal processing that demonstrate potential for improving the performance of driverless cars.

Real-Time Acoustic Perception for Automotive Applications

“…Acoustic perception can therefore complement the knowledge obtained from other sensory devices both in active (drive) and passive (park) mode, where sensing abilities can be exploited to continuously monitor the car and the surrounding environment for possible hazards (always-on operation). Among multiple potential use cases [3], highlighted in Fig. 1, such technology could help in: (i) detecting dangerous situations; (ii) identifying anomalies in car components; (iii) monitoring the acoustic scene for critical events.…”