3D Face Reconstruction from Video Using 3D Morphable Model and Silhouette

Baumberger, Christian; Constantinescu, Mihai; Olariu, Radu; Aguiar, Edilson de; Santos, Thiago Oliveira dos

doi:10.1109/sibgrapi.2014.12

Cited by 8 publications

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[25,27]. Another popular method is silhouette extraction, where the outer silhouette of a face is detected in video frames and the base model(without texture) is then constructed iteratively [28,29]. In [30] and [31] landmark based shape reconstruction of 3D faces, which is very similar to RGB-D reconstruction, is used.…”

Section: Introductionmentioning

confidence: 99%

3D Face Reconstruction with Region Based Best Fit Blending Using Mobile Phone for Virtual Reality Based Social Media

Anbarjafari,

Haamer,

Lusi

et al. 2018

Preprint

View full text Add to dashboard Cite

The use of virtual reality (VR) is exponentially increasing and due to that many researchers has started to work on developing new VR based social media. For this purpose it is important to have an avatar of the users which look like them to be easily generated by the devices which are accessible, such as mobile phone. In this paper, we propose a novel method of recreating a 3D human face model captured with a phone camera image or video data. The method focuses more on model shape than texture in order to make the face recognizable. We detect 68 facial feature points and use them to separate a face into four regions. For each area the best fitting models are found and are further morphed combined to find the best fitting models for each area. These are then combined and further morphed in order to restore the original facial proportions. We also present a method of texturing the resulting model, where the aforementioned feature points are used to generate a texture for the resulting model.

show abstract