Foreign accent classification using deep neural nets

Singh, Utkarsh; Gupta, Akshay; Bisharad, Dipjyoti; Arif, Wasim

doi:10.3233/jifs-179715

Cited by 5 publications

(2 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Singh et al [12] designed and tested a proposed architecture on a common voice dataset. The proposed architecture consists of a cascade of Convolutional Neural networks (CNN) and Convolutional Recurrent Neural networks (CRNN).…”

Section: Literature Reviewmentioning

confidence: 99%

Age and Gender Classification Using Backpropagation and燘agging燗lgorithms

Almomani¹,

Alweshah²,

Alomoush³

et al. 2023

Computers, Materials &Amp; Continua

View full text Add to dashboard Cite

Voice classification is important in creating more intelligent systems that help with student exams, identifying criminals, and security systems. The main aim of the research is to develop a system able to predicate and classify gender, age, and accent. So, a new system called Classifying Voice Gender, Age, and Accent (CVGAA) is proposed. Backpropagation and bagging algorithms are designed to improve voice recognition systems that incorporate sensory voice features such as rhythm-based features used to train the device to distinguish between the two gender categories. It has high precision compared to other algorithms used in this problem, as the adaptive backpropagation algorithm had an accuracy of 98% and the Bagging algorithm had an accuracy of 98.10% in the gender identification data. Bagging has the best accuracy among all algorithms, with 55.39% accuracy in the voice common dataset and age classification and accent accuracy in a speech accent of 78.94%.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Age and Gender Classification Using Backpropagation and燘agging燗lgorithms

Almomani¹,

Alweshah²,

Alomoush³

et al. 2023

Computers, Materials &Amp; Continua

View full text Add to dashboard Cite

show abstract

“…In language identification, architectures that combine CNN with RNN have been used, as in the case of the work of Bartz et al (2017), where an architecture called Convolutional Recurrent Neural Network (CRNN) is proposed, specifically designed for learning from spectrograms. Later, Singh et al (2020) applied CRNN and CNN to automatically classify accents, achieving 4.73% higher accuracy with CRNN than with CNN.…”

Section: Approaches Trained From Scratchmentioning

confidence: 99%

Deep learning applied to speech processing: development of novel models and techniques

Carofilis Vasco

View full text Add to dashboard Cite

This thesis proposes and evaluates new machine learning techniques and models for different tasks in the field of speech processing. It mainly addresses the identification of speakers, languages, and accents using several descriptor proposals based on different sound representations. In addition, it presents a new transfer learning technique based on a new descriptor, and two new architectures for deep learning models based on complementary audio representations.The new transfer learning technique is based on a descriptor we call Grad-Transfer, which is based on the model interpretability method Gradient-weighted Class Activation Mapping (Grad-CAM). Grad-CAM generates a heat map of the most relevant zones in the input data according to their influence on a given model prediction. For the development of Grad-Transfer, we experimentally demonstrate, using Birch and k-means clustering algorithms, that the heat maps generated by the Grad-CAM method are able to store part of the knowledge acquired by a deep learning speech processing model fed by spectrograms during its training process. We exploited this capability of Grad-CAM to formulate a new technique that transfers knowledge from a pre-trained model to an untrained one, through the Grad-Transfer descriptor, which is responsible for summarizing and reusing such knowledge. Several Grad-Transfer-based models were evaluated for the accent identification task using the Voice Cloning Toolkit dataset. These models include Gaussian Naive Bayes, Support Vector Machines, and Passive Aggressive classifiers. Experimental results show an increase in performance of up to 23.58% in models fed by Grad-Transfer descriptors and spectrograms compared to models fed by spectrograms alone. This demonstrates the ability of Grad-Transfer to improve the performance of speech processing models and opens the door to new implementations for similar tasks.On the other hand, new transfer learning approaches based on embedding generation models were evaluated. Embeddings are generated by machine learning models trained for a specific task on large datasets. By exploiting the knowledge already acquired, these models can be reused for new tasks where the amount of available data is small. This thesis proposes a new architecture for deep learning models, called Mel and Wave Embeddings for Human Voice Tasks (MeWEHV), capable of generating robust embeddings for speech processing. MeWEHV combines embeddings generated by a pre-En conjunto, esta tesis presenta varios avances en las áreas de identificación de hablantes, idiomas y acentos, y propone nuevas técnicas y modelos que utilizan el aprendizaje por transferencia para mejorar el rendimiento de los modelos del estado del arte evaluados.

show abstract

Automatic Accent Identification Using Less Data: a Shift from Global to Segmental Accent

Grigaliūnaitė,

Melnik-Leroy

2024

Arab J Sci Eng

View full text Add to dashboard Cite

Foreign accent classification using deep neural nets

Cited by 5 publications

References 6 publications

Age and Gender Classification Using Backpropagation and燘agging燗lgorithms

Age and Gender Classification Using Backpropagation and燘agging燗lgorithms

Deep learning applied to speech processing: development of novel models and techniques

Automatic Accent Identification Using Less Data: a Shift from Global to Segmental Accent

Contact Info

Product

Resources

About