Manifold‐Based 3D Face Caricature Generation with Individualized Facial Feature Extraction

Abstract

Caricature is an interesting art to express exaggerated views of different persons and things through drawing.The face caricature is popular and widely used for different applications. To do this, we have to properly extract unique/specialized features of a person's face. A person's facial feature not only depends on his/her natural appearance, but also the associated expression style. Therefore, we would like to extract the neutural facial features and personal expression style for different applicaions. In this paper, we represent the 3D neutral face models in BU-3DFE database by sparse signal decomposition in the training phase. With this decomposition, the sparse training data can be used for robust linear subspace modeling of public faces. For an input 3D face model, we fit the model and decompose the 3D model geometry into a neutral face and the expression deformation separately. The neutral geomertry can be further decomposed into public face and individualized facial feature. We exaggerate the facial features and the expressions by estimating the probability on the corresponding manifold. The public face, the exaggerated facial features and the exaggerated expression are combined to synthesize a 3D caricature for a 3D face model. The proposed algorithm is automatic and can effectively extract the individualized facial features from an input 3D face model to create 3D face caricature.

Alive Caricature from 2D to 3D

“…Given a single caricature image (left), our algorithm generates its 3D model and the model with texture (right, displayed in two views). ture generation systems have been developed [24,27,25,40]. Most of these works focus on 2D caricature generation.…”

3D Magic Mirror: Automatic Video to 3D Caricature Translation

“…Although experienced artists could draw a 2D caricature without losing its distinct facial features with a given photo, it is still not easy for common people. Motivated by this, there have been a lot of work by designing computerassisted systems to generate caricatures with few user inputs [3], [4], [5], [6], [7], [8], [9], [10] or automatically with a reference caricature [1]. Most of these works focus on 2D caricatures generation or 3D caricatures modeling from user inputs such as facial landmarks and sketches.…”