Mimicry of human speech sounds using an anthropomorphic talking robot by auditory feedback

Nishikawa, K.; Kuwae, Toshiharu; Takanobu, Hideaki; Mochida, Takemi; Honda, Masaaki; Takanishi, A.

doi:10.1109/iros.2004.1389364

Cited by 7 publications

(7 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…1 to an humanoid, the Nolich is with the IFACE s.r.l., Trieste, Italy mnolich@units.it located at the cognitive level of the robot, while the control and phonatory modules are located at the vocalization level. Some researchers, for example [2] [3], faced the vocalization problem from a mechanical point of view. They have realized a mechanical replica of the human vocal tract, of the larynx and of the tongue.…”

Section: Introductionmentioning

confidence: 99%

“…In the closed loop strategy, for example, the extraction of control parameters from speech is optimized by minimizing the distance between original and generated speech. Our work is inspired by the work described in [2] [3] in the sense that we estimate from the input utterances the articulatory movements using a closed loop strategy. These parameters are then used to generate artificial replica of the input utterances on one hand and to control artificial phonatory organs on the other hand.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Improved humanoid vocalization acquisition from a human tutor

Mumolo

Nolich²

2011

2011 IEEE International Conference on Robotics and Biomimetics

View full text Add to dashboard Cite

This paper describes an approach which allow a humanoid robot to automatically acquire vocalization capability by learning from a human tutor. The proposed algorithm can, at the same time, synthesize speech utterances from unrestricted text and generate facial movements of the humanoid head synchronized with the generated speech. The algorithm uses fuzzy articulatory rules, derived from the International Phonetic Alphabet (IPA) to allow simpler adaptation to different languages, and genetic optimization of the membership degrees. Experimental results show a good subjective acceptance of the acquired vocalization in terms of quality, naturalness and synchronization. Although the algorithm has been implemented on a virtual talking face, it could eventually be used also in mechanical vocalization systems.

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Improved humanoid vocalization acquisition from a human tutor

Mumolo

Nolich²

2011

2011 IEEE International Conference on Robotics and Biomimetics

View full text Add to dashboard Cite

show abstract

“…Any apparent errors occurred at the time of switching from the voiceless sounds to the voiced sounds, due to the fact that the vocal cords were easily influenced by the load from the vocal tract. The details of these experiments are described in a further paper [12] …”

Section: Speech Mimicrymentioning

confidence: 99%

“…1. The details of this system are described in our earlier paper [12]. We developed a new talking robot, WT-4 (Waseda Talker No.…”

Section: Introductionmentioning

confidence: 99%

Development of a New Human-like Talking Robot for Human Vocal Mimicry

Fukui

Nishikawa²,

Kuwae³

et al.

Proceedings of the 2005 IEEE International Conference on Robotics and Automation

Self Cite

View full text Add to dashboard Cite

This paper describes development of a new human-like talking robot WT-4 (Waseda Talker No. 4).WT-4 was developed to overcome the problems related to the lack of variation in the formant frequency of the sounds generated by the previous talking robot WT-3. These problems arose particularly on the first formant (F1) where frequencies of less than 500 [Hz] could not be reached. And the differences among WT-3's vowels were not clear; which may have been caused by the sound source of the vocal cords and the lips. Therefore, the connection between the vocal cords and the vocal tract was improved, as well as the lips mechanism. As the result of these improvements, WT-4's sounds were quite similar to a human's, and WT-4 was able to reproduce suitable sounds using auditory feedback.

show abstract

“…In vocal cords needed to more accurately reproduce the biological form. We also developed an auditory feedback mechanism for vowel production that optimized robot parameters using acoustic parameters [7]. Their intent was to clarify the human voice acquisition mechanism by reproducing it using a robot.…”

Section: Introductionmentioning

confidence: 99%

New Anthropomorphic Talking Robot having Sensory Feedback Mechanism and Vocal Cords based on Human Biomechanical Structure

Fukui

Nishikawa

Ikeo

et al.

The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006.

Self Cite

View full text Add to dashboard Cite

We developed an anthropomorphic talking robot WT-5 (Waseda Talker No. 5) having a sensor feedback mechanism and novel vocal cords based on human biological structures. The sensory feedback is more important when we producing obstacle consonant sounds,, compared to the auditory feedback mechanism. We reproduce this mechanism by placing tactile sensors and a pressure sensor on the palate of a talking robot and reducing the error between the pressure of the human voice and the robot consonant production. The vocal cord model was constructed with a similar structure to the biological structure of the human vocal cords and vibrated like those of a human. In addition, using these mechanisms, WT-5 could produce voices closer to those of a human. And also realized continuous mimic speaking that includes consonant sounds.

show abstract

Mimicry of human speech sounds using an anthropomorphic talking robot by auditory feedback

Cited by 7 publications

References 5 publications

Improved humanoid vocalization acquisition from a human tutor

Improved humanoid vocalization acquisition from a human tutor

Development of a New Human-like Talking Robot for Human Vocal Mimicry

New Anthropomorphic Talking Robot having Sensory Feedback Mechanism and Vocal Cords based on Human Biomechanical Structure

Contact Info

Product

Resources

About