Dynamic Facial Asset and Rig Generation from a Single Scan

Li, Jiaman; Kuang, Zhengfei; Zhao, Yajie; He, Mingming; Bladin, Karl; Li, Hao

doi:10.48550/arxiv.2010.00560

Cited by 1 publication

(1 citation statement)

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [74], statistical models were used to enhance details and generate aged or de-aged geometries regarding ages, genders, and races. In [75], a whole set of dynamic facial assets could be generated from a single facial scan. A high-fidelity facial scan database (178 subjects, each with 19 to 26 different expressions) was used to train a Blendshape Generation network and a Texture Generation network.…”

Section: Other Trendsmentioning

confidence: 99%

A Survey of Facial Capture for Virtual Reality

et al. 2022

View full text Add to dashboard Cite

The holograms in the movie Star Wars have inspired many researchers to capture the whole human body in real-time and present it as an avatar into Virtual Reality (VR). Facial capture is important to achieve this because facial expressions are essential for social interaction. However, facial capture works well only when the face is not occluded. While a VR headset has been widely used as a display device for VR, it occludes half of the face and becomes an obstacle. This paper presents a systematic literature review on facial capture for VR. The survey aims to: review the current state-of-the-art facial capture technologies for VR; identify the types of technologies and context of the use, the methodologies and theoretical groundings; identify research gaps in facial capture for VR; and identify solutions of facial capture for VR headsets. A realism index is defined to evaluate and compare the collected papers. The results show several technology trends in the facial capture for VR: tracking facial motion with markers, facial capture in headsets using cameras or sensors, facial performance capture, and hologram/volumetric capture. It is shown that the Modular Codec Avatar is the best facial capture method in a VR headset, whereas Metahuman has the best output effects. This paper also proposes that an open-design VR headset is an effective approach to lower the Total Cost of Ownership (TCO).

show abstract

Section: Other Trendsmentioning

confidence: 99%