Transformer-Based Multilingual G2P Converter for E-Learning System

Liu, Jueting; Ren, Chang; Luan, Yaoxuan; Li, Sicheng; Xie, Tianshi; Seals, Cheryl; Speights Atkins, Marisha

doi:10.1007/978-3-031-05643-7_35

Cited by 3 publications

(2 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Grapheme-to-phoneme (G2P) conversion is a process of generating words in their IPA format from written format. G2P converters can be regarded as variants of machine translators [5].…”

Section: Transformer-based Multilingual G2p Convertermentioning

confidence: 99%

“…As an intelligent linguistic E-learning system, this module helps students understand the difference between correct pronunciation and disordered speech. During this study, we employed the Mel frequency cepstrum coefficient (MFCC) as the feature to represent the speech sound and a convolutional neural network (CNN) as the classification model [5].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

AI Enhancements for Linguistic E-Learning System

Liu,

Li,

Ren

et al. 2023

Applied Sciences

View full text Add to dashboard Cite

E-learning systems have been considerably developed after the COVID-19 pandemic. In our previous work, we developed a linguistic interactive E-learning system for phonetic transcription learning. In this paper, we propose three artificial-intelligence-based enhancements to this system from different aspects. Compared with the original system, the first enhancement is a disordered speech classification module; this module is driven by the MFCC-CNN model, which aims to distinguish disordered speech and nondisordered speech. The accuracy of the classification is about 83%. The second enhancement is a grapheme-to-phoneme converter. This converter is based on the transformer model and designed for teachers to better generate IPA words from the regular written text. Compared with other G2P models, our transformer-based G2P model provides outstanding PER and WER performance. The last part of this paper focuses on a Tacotron2-based IPA-to-speech synthesis system, this deep learning-based TTS system can help teacher generate high-quality speech sounds from IPA characters which significantly improve the functionality of our original system. All of these three enhancements are related to the phonetic transcription process. and this work not only provides a better experience for the users of this system but also explores the utilization of artificial intelligence technologies in the E-learning field and linguistic field.

show abstract

“…Grapheme-to-phoneme (G2P) conversion is a process of generating words in their IPA format from written format. G2P converters can be regarded as variants of machine translators [5].…”

Section: Transformer-based Multilingual G2p Convertermentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

AI Enhancements for Linguistic E-Learning System

Liu,

Li,

Ren

et al. 2023

Applied Sciences

View full text Add to dashboard Cite

show abstract

Phone-Based Speech Recognition for Phonetic E-Learning System

Ren,

Liu,

Feng

et al. 2023

Communications in Computer and Information Science

View full text Add to dashboard Cite

AI Enhancements for Linguistic E-learning System

Liu,

Li,

Ren

et al. 2023

Preprint

View full text Add to dashboard Cite

The E-learning system has achieved great development after the pandemic. In this work, we proposed three artificial intelligence-based enhancements to our linguistic interactive E-learning system from different aspects. Compared with the original phonetic transcription exam system, our enhancements include an MFCC+CNN-based disordered speech classification module, a Transformer-based Grapheme-to-Phoneme converter, and a Tacotron2-based IPA-to-Speech speech synthesis system. This work not only provides a better experience for the users of this system but also explores the utilization of artificial intelligence technologies in the E-learning field and linguistic field.

show abstract

Transformer-Based Multilingual G2P Converter for E-Learning System

Cited by 3 publications

References 8 publications

AI Enhancements for Linguistic E-Learning System

AI Enhancements for Linguistic E-Learning System

Phone-Based Speech Recognition for Phonetic E-Learning System

AI Enhancements for Linguistic E-learning System

Contact Info

Product

Resources

About