Interactive Generation of Realistic Facial Wrinkles from Sketchy Drawings

Kim, Hyeon-Joong; Öztireli, A. Cengiz; Shin, Il-Kyu; Groß, Markus; Choi, Soo-Mi

doi:10.1111/cgf.12551

Cited by 8 publications

(5 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, they assume that all the details in input faces are static, thus cannot handle dynamic details in inputs. Several methods allow users to intuitively create new wrinkles using sketches [5,49,81,40], but they cannot animate the generated wrinkles. Our model first represents facial details and their changes caused by structure, expression, and age in a unified latent space.…”

Section: Related Workmentioning

confidence: 99%

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

Ling¹,

Wang²,

Lu³

et al. 2022

Preprint

View full text Add to dashboard Cite

Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable models mostly focus on largescale facial geometry but ignore facial details. This paper augments morphable models in representing facial details by learning a Structureaware Editable Morphable Model (SEMM). SEMM introduces a detail structure representation based on the distance field of wrinkle lines, jointly modeled with detail displacements to establish better correspondences and enable intuitive manipulation of wrinkle structure. Besides, SEMM introduces two transformation modules to translate expression blendshape weights and age values into changes in latent space, allowing effective semantic detail editing while maintaining identity. Extensive experiments demonstrate that the proposed model compactly represents facial details, outperforms previous methods in expression animation qualitatively and quantitatively, and achieves effective age editing and wrinkle line editing of facial details. Code and model are available at https://github.com/ gerwang/facial-detail-manipulation.

show abstract

Section: Related Workmentioning

confidence: 99%

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

Ling¹,

Wang²,

Lu³

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…These methods are able to faithfully reproduce the appearance of a real actor, however the wrinkle patterns in these displacement maps cannot easily be edited or transferred to another 3D model and will not work for characters for which no actor is available. The editing of wrinkles is possible in a paper by Kim et al [7] which uses strokes by an artist to generate believable wrinkles on a 3D model of a human face, and Cao et al [5] and Shin et al [17] are able to capture and transfer wrinkles and deformations onto other 3D models. These algorithm all work on large scale wrinkles.…”

Section: A Related Workmentioning

confidence: 99%

“…For this we introduce a parameter t that runs from 0 at one end of the curve to 1 at the other end, and write the fixed w and d values as described in Bickel et al [24] as a parameter set P that maps each t to a parameter w and d. • Instead of a fixed S(p), we generalize by allowing any arbitrary cross section function that accepts a parameter set. We model this by introducing an arbitrary profile and write it as Φ(x, P ) where x is the distance from the spline and P is a parameter set that contains w and d for any t. This is similar to the cross section defined as by Kim [7]. Modeling a wrinkle as a geometrical shape has several advantages: it is closer to how we intuitively think about the surface of skin, and it also allows us to quantify the layout, size and distribution of these shapes with a small set of parameters that can be estimated from images.…”

Section: B Wrinkle Primitivementioning

confidence: 99%

“…• We first present an improvement over the wrinkle tracing method used in Kim [7], that extracts wrinkles that cross each other and is able to follow shapes with arbitrary cross sections. • Second, we propose an improvement over the displacement map generating method presented inBando [8] and Kim [7] by not requiring additional user input and allowing wrinkles to overlap regardless of the number input vector fields. Our algorithm can generate a displacement map of arbitrary resolution for skin wrinkles at the mesoand microscale depending on the input data.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Example-Based Skin Wrinkle Displacement Maps

Vanderfeesten

Bikker

2018

2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)

View full text Add to dashboard Cite

We present an algorithm for generating procedural displacement maps for wrinkle patterns measured from photographs or scans. These displacement maps can contain wrinkle patterns that appear at the meso-and microscale, and are modeled using several spatially varying parameters such as the size, shape and distribution of each individual skin wrinkle. We present an algorithm to measure the parameters of skin wrinkle patterns, and show how to adapt the measured parameters to generate displacement maps with similar properties for 3D models other than the one measured. Lastly, we evaluate the quality of the generated maps by comparing them to maps acquired by scanning human skin.

show abstract

“…(2) It is not difficult to apply this method to the application with topological changes. Procedural methods were mainly applied for the detailed deformations such as: cloth [131,132], faces [133,134], and many other surface of objects [135]. The major disadvantage is that the deformation generated by procedures may look artificial.…”

Section: Procedurally Enhanced Methodsmentioning

confidence: 99%

Thin deformable tissues modeling for simulation of arthroscopic knee surgery

Weng¹

View full text Add to dashboard Cite

Minimally invasive surgery is common in present hospitals since it has many advantages over traditional open surgery. However, the skills which it requires are very different from those developed in doing traditional surgery, and they have to be learnt in a different way. A survey of the current training methods reveals that using virtual reality simulators is a promising direction for training minimally invasive surgery, and it requires the developers to improve accuracy and efficiency of human tissue simulations. A further survey of existing deformable models for real time surgical-training simulations leads to the conclusion that there is room for research for developing new thin tissue models in which one of the dimensions is significantly smaller than the other two. A new generic model is proposed for deformation and cutting of thin deformable tissues in real time. The tissues may develop wrinkles when pressed with virtual probes, as well as they can be trimmed and cut with different virtual surgical instruments using desktop haptic devices. The model is then applied to three tissues for simulating virtual arthroscopic surgery: meniscus, ligament and cartilage. The main attention was paid to the meniscus to be realistically deformed while developing wrinkles when tested with the virtual probe, as well as to be cut and trimmed at its edge with various virtual instruments. Ligaments were simulated for displaying their realistic deformation when examined with the surgical hook and cartilage was IV mostly used to modeling its geometry and elastic properties when examined with haptic devices. A side-by-side comparison with actual surgical videos verifies the simulation accuracy. To demonstrate its flexibility, the model was also applied to other objects such as a piece of meat and a thin paper sheet. To validate the obtained results, a virtual reality knee arthroscopic prototype simulator is developed. The proposed models are combined with a scene graph structure and implemented using SOFA. The performances for the implementation of different settings of collision meshes are compared and discussed. The usability and feasibility of the proposed methods are further verified by the real time simulations of various surgical procedures, which include meniscus examination, punching out torn tissues, removing tissues pieces by pieces, and contouring the edge of meniscus.

show abstract

Interactive Generation of Realistic Facial Wrinkles from Sketchy Drawings

Cited by 8 publications

References 38 publications

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

Example-Based Skin Wrinkle Displacement Maps

Thin deformable tissues modeling for simulation of arthroscopic knee surgery

Contact Info

Product

Resources

About