Data-Driven Tools for Designing Talking Heads Exploiting Emotional Attitudes

Cosi, Piero; Fusaro, Andrea; Grigoletto, Daniele; Tisato, Graziano

doi:10.1007/978-3-540-24842-2_10

Cited by 4 publications

(3 citation statements)

References 8 publications

(7 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Two synthetic 3D face models were used in the study, one originating from Sweden [5] and one from Italy [6]. The Swedish face, a male, is made up of approximately 1,500 polygons, whereas the Italian face is a textured young female built using around 25,000 polygons.…”

Section: Methodsmentioning

confidence: 99%

Preliminary Cross-Cultural Evaluation of Expressiveness in Synthetic Faces

Beskow¹,

Cerrato²,

Cosi

et al. 2004

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Abstract. This paper reports the results of a preliminary cross-evaluation experiment run in the framework of the European research project PF-Star 1 , with the double aim of evaluating the possibility of exchanging FAP data between the involved sites and assessing the adequacy of the emotional facial gestures performed by talking heads. The results provide initial insights in the way people belonging to various cultures react to natural and synthetic facial expressions produced in different cultural settings, and in the potentials and limits of FAP data exchange.

show abstract

Section: Methodsmentioning

confidence: 99%

Preliminary Cross-Cultural Evaluation of Expressiveness in Synthetic Faces

Beskow¹,

Cerrato²,

Cosi

et al. 2004

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

show abstract

“…We are currently developing this new software version in order to easily integrate LUCIA in a website; there are many promising functionality for web applications: a virtual guide for any website (which we are exploiting in the wikimemo.it project -The portal of Italian Language and Culture); a storyteller for e-book reading; a digital tutor for hearing impaired; a personal assistant for smart-phone and mobile devices. The early results can be observed in [44] 4 Emotional synthesis Audio Visual emotional rendering was developed working on true real emotional audio and visual databases whose content was used to automatically train emotion specific intonation and voice quality models to be included in FESTIVAL, our Italian TTS system [25,26,27,28] and also to define specific emotional visual rendering to be implemented in LUCIA [29,30,31]. Fig.…”

Section: Data Acquisition Environmentmentioning

confidence: 99%

LUCIA: An Open Source 3D Expressive Avatar for Multimodal h.m.i.

Leone

Paci

Cosi

2012

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

Self Cite

View full text Add to dashboard Cite

LUCIA is an MPEG-4 facial animation system developed at ISTC-CNR 1. It works on standard Facial Animation Parameters and speaks with the Italian version of FESTIVAL TTS. To achieve an emotive/expressive talking head LUCIA was build from real human data physically extracted by ELITE optotracking movement analyzer. LUCIA can copy a real human by reproducing the movements of passive markers positioned on his face and recorded by the ELITE device or can be driven by an emotional XML tagged input text, thus realizing a true audio/visual emotive/expressive synthesis. Synchronization between visual and audio data is very important in order to create the correct WAV and FAP files needed for the animation. LUCIA's voice is based on the ISTC Italian version of FESTIVAL-MBROLA packages, modified by means of an appropriate APML/VSML tagged language. LUCIA is available in two different versions: an open source framework and the "work in progress" WebGL.

show abstract

“…Visual speech synthesis can be accomplished either through manipulation of video images ( [4], [5]) or based on two-or three dimensional models of the human face and/or speech organs that are under control of a set of deformation parameters, as described by for example [6], [7], [8] and [9].…”

Section: Synthesis Of Visible Speechmentioning

confidence: 99%

Data-driven synthesis of expressive visual speech using an MPEG-4 talking head

Beskow

Nordenberg²

2005

Interspeech 2005

View full text Add to dashboard Cite

This paper describes initial experiments with synthesis of visual speech articulation for different emotions, using a newly developed MPEG-4 compatible talking head. The basic problem with combining speech and emotion in a talking head is to handle the interaction between emotional expression and articulation in the orofacial region. Rather than trying to model speech and emotion as two separate properties, the strategy taken here is to incorporate emotional expression in the articulation from the beginning. We use a data-driven approach, training the system to recreate the expressive articulation produced by an actor while portraying different emotions. Each emotion is modelled separately using principal component analysis and a parametric coarticulation model. The results so far are encouraging but more work is needed to improve naturalness and accuracy of the synthesized speech.

show abstract

Data-Driven Tools for Designing Talking Heads Exploiting Emotional Attitudes

Cited by 4 publications

References 8 publications

Preliminary Cross-Cultural Evaluation of Expressiveness in Synthetic Faces

Preliminary Cross-Cultural Evaluation of Expressiveness in Synthetic Faces

LUCIA: An Open Source 3D Expressive Avatar for Multimodal h.m.i.

Data-driven synthesis of expressive visual speech using an MPEG-4 talking head

Contact Info

Product

Resources

About