On the improvement of modulation features using multi-microphone energy tracking for robust distant speech recognition

Abstract

Abstract-In this work, we investigate robust speech energy estimation and tracking schemes aiming at improved energybased multiband speech demodulation and feature extraction for multi-microphone distant speech recognition. Based on the spatial diversity of the speech and noise recordings of a multimicrophone setup, the proposed Multichannel, Multiband Demodulation (MMD) scheme includes: 1) energy selection across the microphones that are less affected by noise and 2) cross-signal energy estimation based on the cross-Teager energy operator. Instantaneous modulations of speech resonances are estimated on the denoised energies. Second-order frequency modulation features are measured and combined with MFCCs achieving improved distant speech recognition on simulated and real data recorded in noisy and reverberant domestic environments.

Improved Frequency Modulation Features for Multichannel Distant Speech Recognition

“…which in general measures the relative rate of change between two oscillators. As discussed in [28] and [29], two useful properties of the operator can be derived: 1) On averaging, noise u m (t) contributes as an additive error term to the Teager energy Ψ[s k ] of the kth resonance of the source signal:…”

Modulation scheme recognition using convolutional neural network

“…The modulation recognition refers to automatic identification of modulated signals with noise. It also can be used for the applications such as demodulation and feature extraction, which play an important role in military intelligence, electronic warfare, electronic reconnaissance, and other areas [1]. As of that, lots of studies have been accomplished and various algorithms have been introduced by using those techniques.…”

Μέθοδοι Εύρωστης Αναγνώρισης Ομιλίας Με Πολλαπλούς Αισθητήρες Και Εφαρμογές Σε Ευφυή Περιβάλλοντα

“…Συνοψίζουμε τα κίνητρα που μας ώθησαν στις ερευνητικές κατευθύνσεις της παρούσας έρευνας καθώς και τις κύριες συνεισφορές της [59,60,[111][112][113][114][115][116][117][118]135].…”