Data Augmentation-Assisted Makeup-Invariant Face Recognition

Abstract

Recently, face datasets containing celebrities photos with facial makeup are growing at exponential rates, making their recognition very challenging. Existing face recognition methods rely on feature extraction and reference reranking to improve the performance. However face images with facial makeup carry inherent ambiguity due to artificial colors, shading, contouring, and varying skin tones, making recognition task more difficult. The problem becomes more confound as the makeup alters the bilateral size and symmetry of the certain face components such as eyes and lips affecting the distinctiveness of faces. The ambiguity becomes even worse when different days bring different facial makeup for celebrities owing to the context of interpersonal situations and current societal makeup trends. To cope with these artificial effects, we propose to use a deep convolutional neural network (dCNN) using augmented face dataset to extract discriminative features from face images containing synthetic makeup variations. The augmented dataset containing original face images and those with synthetic make up variations allows dCNN to learn face features in a variety of facial makeup. We also evaluate the role of partial and full makeup in face images to improve the recognition performance. The experimental results on two challenging face datasets show that the proposed approach can compete with the state of the art.

A deep learning framework for football match prediction

“…Particularly it discussed data augmentation approach based on celebrity-famous makeup styles and semantic preserving transformations suitable for makeupinvariant face recognition. This study focused on training a dCNN model to effectively learn the discriminative features in the presence of cosmetic variations and to fight the frequently occurring problem of overfitting in dCNNs [8].…”

An efficient content based image retrieval using enhanced multi-trend structure descriptor

“…Subsequently, deep learning processes are employed in the domain of image recognition [52][53][54][55][56]. Though deep learning approaches are better in performance, their computational cost is too high and requires high configuration machines.…”

Estimation of gait normality index based on point clouds through deep auto-encoder

“…Recently, such approaches have demonstrated good performance on common problems such as content-based image retrieval [2,42] and image classification [3,40,41]. Another approach is the use of pretrained deep networks for feature extraction such as [27,31]. These methods, however, are applied on natural images with an appropriate resolution, in which each code word is formed from an image patch.…”