Spatial position constraint for unsupervised learning of speech representations

Abstract

The success of supervised learning techniques for automatic speech processing does not always extend to problems with limited annotated speech. Unsupervised representation learning aims at utilizing unlabelled data to learn a transformation that makes speech easily distinguishable for classification tasks, whereby deep auto-encoder variants have been most successful in finding such representations. This paper proposes a novel mechanism to incorporate geometric position of speech samples within the global structure of an unlabelled feature set. Regression to the geometric position is also added as an additional constraint for the representation learning auto-encoder. The representation learnt by the proposed model has been evaluated over a supervised classification task for limited vocabulary keyword spotting, with the proposed representation outperforming the commonly used cepstral features by about 9% in terms of classification accuracy, despite using a limited amount of labels during supervision. Furthermore, a small keyword dataset has been collected for Kadazan, an indigenous, low-resourced Southeast Asian language. Analysis for the Kadazan dataset also confirms the superiority of the proposed representation for limited annotation. The results are significant as they confirm that the proposed method can learn unsupervised speech representations effectively for classification tasks with scarce labelled data.

Speaker Profiling Based on the Short-Term Acoustic Features of Vowels

“…Another study also analyzed the sliding window's effectiveness for extracting spectral or cepstral features [7], whilst Paliwal et al measured the impact of time window duration on speech recognition [8]. Research shows that unsupervised compression of cepstral speech features further enhances the classification accuracy for certain classification tasks [9]. Acoustic features of speech vary significantly for various speaker accents.…”

A transformer fine-tuning strategy for text dialect identification

“…The pre-training helps the model learn the text structure utilising massive unlabelled text data scraped from the web. The unsupervised pre-training has been proven very effective for a wide range of classification tasks [ 6 ].…”