Automatic face cloning and animation using real-time facial feature tracking and speech acquisition

Towards 3D Communications: Real Time Emotion Driven 3D Virtual Facial Animation

“…(1) Organ characteristics: the forehead, eyebrows, eyes, nose, mouth and chin (2) The pitch characteristics of the organs (3) Characteristics of the face shape Our system builds 6 standard emotional face model including anger, disgust, fear, sad, surprise and joy as showing in Figure 4. …”

“…Different from the automatically face cloning and animation [2], our algorithm detect the facial feature points for estimate user's emotional state, avatar's facial animation is driven by these emotional state sequence. Note that affect detection through has became a research hot spot recently.…”

A graphical model based solution to the facial feature point tracking problem

“…In such methods, intensity values [11][12][13][14] or Gabor features [15] are usually used as part of the data term in curve evolution. Similarly, in [16][17][18] 3-D wire-frame models are constructed and iteratively deformed using intensity values. Spatial relations are taken into account by constraining the shape of facial features using subspace representations, such as principal component analysis (PCA), in the shape space, leading to so-called active shape models (ASM) [11][12][13].…”

Mirror MoCap: Automatic and efficient capture of dense 3D facial motion parameters from video

“…For tracking to be fully automatic, some studies have employed a generic facial motion model. Goto et al [13] used separate simple tracking rules for eyes, lips, and other facial features. Pighin et al [23,24] proposed tracking animation-purposed facial motion based on linear combination of 3D face model bases.…”