In-plane face orientation estimation in still images

Abstract

International audienceThis paper addresses a fine in-plane (roll) face orientation estimation for a perspective face analysis algorithm that requires normalized frontal faces. As most of the face analysers (e.g., gender, expression, and recognition) need frontal up-right faces, there is a clear need for the precise roll estimation, as precise face normalization has an important role in classification methods. The in-plane orientation estimation algorithm is constructed on top of regular Viola-Jones frontal face detector. When a face is detected for the first time, it is rotated with respect to the face origin to find the boundaries of the detection. Mean value of these angles is said to be the measurement of the in-plane rotation of the face. Since we only need a face detection algorithm, the proposed method can work effectively on very small sized faces where traditional landmark (eye, mouth) or planar detection based estimations fail. Experiments on controlled and unconstrained large-scale datasets (CMU Rotated, YouTube, Boston University Face Tracking, Caltech, FG-NET Aging, BioID and Manchester Talking-Face) showed that the proposed method is robust to various settings for in-plane face orientation estimation in terms of RMSE and MAE. We achieved less than ±3.5 ∘ mean absolute error for roll estimation which proves that the accuracy of the proposed method is comparable to that of the state-of-the-art tracking based approaches for the roll estimation

3D Face Tracking Using Stereo Cameras: A Review

“…Face modelling refers in the beauty industry to the beauty shots that are usually taken solely of faces [98] to promote cosmetics. Cosmetic brands will hire models to appear in product shots and campaigns with a focus on different facial features.…”

“…Cosmetic brands will hire models to appear in product shots and campaigns with a focus on different facial features. Companies like Maybelline, Max Factor, and Rimmel, need face models to promote their new lipstick, mascara or foundation to a larger audience [98]. Featuring these products on a specific model's face drives sales because consumers can see the effect and color of the product.…”

Head Yaw Estimation using Frontal Face Detector

“…Using a similar idea as (Danisman and Bilasco, 2015) which estimate roll pose estimation, we focus on yaw pose estimation from still images using frontal Viola-Jones (Viola and Jones, 2001) face detector using a two-stage approach. The frontal Viola-Jones detector responds positively to faces that are nearly frontal.…”