A Study of Features and Deep Neural Network Architectures and Hyper-Parameters for Domestic Audio Classification

Abstract

Recent methodologies for audio classification frequently involve cepstral and spectral features, applied to single channel recordings of acoustic scenes and events. Further, the concept of transfer learning has been widely used over the years, and has proven to provide an efficient alternative to training neural networks from scratch. The lower time and resource requirements when using pre-trained models allows for more versatility in developing system classification approaches. However, information on classification performance when using different features for multi-channel recordings is often limited. Furthermore, pre-trained networks are initially trained on bigger databases and are often unnecessarily large. This poses a challenge when developing systems for devices with limited computational resources, such as mobile or embedded devices. This paper presents a detailed study of the most apparent and widely-used cepstral and spectral features for multi-channel audio applications. Accordingly, we propose the use of spectro-temporal features. Additionally, the paper details the development of a compact version of the AlexNet model for computationally-limited platforms through studies of performances against various architectural and parameter modifications of the original network. The aim is to minimize the network size while maintaining the series network architecture and preserving the classification accuracy. Considering that other state-of-the-art compact networks present complex directed acyclic graphs, a series architecture proposes an advantage in customizability. Experimentation was carried out through Matlab, using a database that we have generated for this task, which composes of four-channel synthetic recordings of both sound events and scenes. The top performing methodology resulted in a weighted F1-score of 87.92% for scalogram features classified via the modified AlexNet-33 network, which has a size of 14.33 MB. The AlexNet network returned 86.24% at a size of 222.71 MB.

Application and Theory of Multimedia Signal Processing Using Machine Learning or Advanced Methods

“…The eighth paper (Copiaco et al ( 2021)) [8] presents a detailed study of the most apparent and widely-used cepstral and spectral features for multi-channel audio applications. Additionally, the paper details the development of a compact version of the AlexNet model for computationally limited platforms through studies of performances against various architectural and parameter modifications of the original network.…”

A Comparative Study of Preprocessing and Model Compression Techniques in Deep Learning for Forest Sound Classification

“…This model showcases the effectiveness of deep CNNs for image classification tasks, setting a new standard for supervised learning without unsupervised pre-training. Several studies have used AlexNet in the audio classification domain using spectrograms with state-of-the-art performance [ 23 , 24 , 25 ].…”

Influence of Environmental Noise on Quality Control of HVAC Devices Based on Convolutional Neural Network

“…This paper presents research that is devoted to testing products directly in a production process by searching for a relationship between the intensity of EN, influencing anechoic chamber efficiency, and the classification accuracy of the decision-making algorithm based on the convolutional neural network (CNN) [20,21]. The technology of the CNN was chosen as the classification algorithm as it is promising and thriving technology that has been successfully applied in areas such as image processing [22], object detection [23], speech recognition [24], etc.…”