Cross-Lingual Speaker Adaptation for HMM-Based Speech Synthesis

Wu, Yi-Jian; King, Simon; Tokuda, Keiichi

doi:10.1109/chinsl.2008.ecp.14

Cited by 51 publications

(57 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Once integrated, subjective evaluation of the intelligibility and naturalness of the voices will be carried out. Future work also includes the exploration of other network topologies [9], incorporating variance modeling into the DNNs [32], cross-lingual speaker adaptation [29] and a more in-depth linguistic analysis.…”

Section: Discussionmentioning

confidence: 99%

Statistical Text-to-Speech Synthesis of Spanish Subtitles

Piqueras

Del-Agua

Giménez

et al. 2014

Advances in Speech and Language Technologies for Iberian Languages

View full text Add to dashboard Cite

Abstract. Online multimedia repositories are growing rapidly. However, language barriers are often difficult to overcome for many of the current and potential users. In this paper we describe a TTS Spanish system and we apply it to the synthesis of transcribed and translated video lectures. A statistical parametric speech synthesis system, in which the acoustic mapping is performed with either HMM-based or DNN-based acoustic models, has been developed. To the best of our knowledge, this is the first time that a DNN-based TTS system has been implemented for the synthesis of Spanish. A comparative objective evaluation between both models has been carried out. Our results show that DNN-based systems can reconstruct speech waveforms more accurately.

show abstract

Section: Discussionmentioning

confidence: 99%

Statistical Text-to-Speech Synthesis of Spanish Subtitles

Piqueras

Del-Agua

Giménez

et al. 2014

Advances in Speech and Language Technologies for Iberian Languages

View full text Add to dashboard Cite

show abstract

“…Latorre et al and Black and Schultz proposed building such multilingual synthesizers using combined data from multiple languages (Latorre et al, 2006;Black and Schultz, 2006). Wu et al also proposed a technique of cross-lingual speaker adaptation (Wu et al, 2008a). They revealed that multilingual synthesis and cross-lingual adaptation were indeed feasible and provided reasonable quality.…”

Section: Multilingual Supportmentioning

confidence: 99%

Statistical Parametric Speech Synthesis

Black

Zen

Tokuda

2007

2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07

Self Cite

203

View full text Add to dashboard Cite

This review gives a general overview of techniques used in statistical parametric speech synthesis. One instance of these techniques, called hidden Markov model (HMM)-based speech synthesis, has recently been demonstrated to be very effective in synthesizing acceptable speech. This review also contrasts these techniques with the more conventional technique of unit-selection synthesis that has dominated speech synthesis over the last decade. The advantages and drawbacks of statistical parametric synthesis are highlighted and we identify where we expect key developments to appear in the immediate future.

show abstract

“…However this does not mean that cross-lingual approach cannot use two languages with little similarity, where a phoneme mapping technique can be applied to map the phonemes of source and target language [23].…”

Section: Malay As An Under-resourced Languagementioning

confidence: 99%

“…To map the phones of Malay and English, we used the data mapping approach proposed by Wu et al, [23] where the mapping information is used to attach the adaptation data of the target Malay speech to the source language model. In this method, the context dependent labels are mapped from the target language into the source language; in this case Malay segment-phonetic labels (which were prepared manually) are mapped into the English phonetic labels.…”

Section: Cross-lingual Adaptation Approachmentioning

confidence: 99%

Developing an HMM-Based Speech Synthesis System for Malay: A Comparison of Iterative and Isolated Unit Training

Mustafa

Don

Ainon

et al. 2014

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYThe development of an HMM-based speech synthesis system for a new language requires resources like speech database and segment-phonetic labels. As an under-resourced language, Malay lacks the necessary resources for the development of such a system, especially segment-phonetic labels. This research aims at developing an HMM-based speech synthesis system for Malay. We are proposing the use of two types of training HMMs, which are the benchmark iterative training incorporating the DAEM algorithm and isolated unit training applying segmentphonetic labels of Malay. The preferred method for preparing segmentphonetic labels is the automatic segmentation. The automatic segmentation of Malay speech database is performed using two approaches which are uniform segmentation that applies fixed phone duration, and a crosslingual approach that adopts the acoustic model of English. We have measured the segmentation error of the two segmentation approaches to ascertain their relative effectiveness. A listening test was used to evaluate the intelligibility and naturalness of the synthetic speech produced from the iterative and isolated unit training. We also compare the performance of the HMM-based speech synthesis system with existing Malay speech synthesis systems. key words: iterative training, isolated unit training, cross lingual approach, uniform segmentation, segment-phonetic labels

show abstract

Cross-Lingual Speaker Adaptation for HMM-Based Speech Synthesis

Cited by 51 publications

References 12 publications

Statistical Text-to-Speech Synthesis of Spanish Subtitles

Statistical Text-to-Speech Synthesis of Spanish Subtitles

Statistical Parametric Speech Synthesis

Developing an HMM-Based Speech Synthesis System for Malay: A Comparison of Iterative and Isolated Unit Training

Contact Info

Product

Resources

About