Spoofing faces using makeup: An investigative study

Abstract

Makeup can be used to alter the facial appearance of a person. Previous studies have established the potential of using makeup to obfuscate the identity of an individual with respect to an automated face matcher. In this work, we analyze the potential of using makeup for spoofing an identity, where an individual attempts to impersonate another person's facial appearance. In this regard, we first assemble a set of face images downloaded from the internet where individuals use facial cosmetics to impersonate celebrities. We next determine the impact of this alteration on two different face matchers. Experiments suggest that automated face matchers are vulnerable to makeup-induced spoofing and that the success of spoofing is impacted by the appearance of the impersonator's face and the target face being spoofed. Further, an identification experiment is conducted to show that the spoofed faces are successfully matched at better ranks after the application of makeup. To the best of our knowledge, this is the first work that systematically studies the impact of makeup-induced face spoofing on automated face recognition.

Entropy-Based Face Recognition and Spoof Detection for Security Applications

“…In [60] authors defined two spoofing indexes. SI 1 evaluates the similarity between the after-makeup images of subject p, A…”

“…The MIFS (Makeup Induced Face Spoofing) dataset [60], composed of face images of 107 subjects obtained from YouTube video makeup tutorials and face images of associated target subjects from the Internet. There are 4 photos per subject (2 before makeup, 2 after makeup) and 2 photos per target subject, making a total of 642 still images.…”

Impact and Detection of Facial Beautification in Face Recognition: An Overview

“…For instance, plastic surgery can be performed to conceal the identity of a subject [33]. In the same manner, makeup can be applied with the aim of identity concealment [82] or even to prevent face detection [83]. More importantly, when applied by professional makeup artists facial makeup can be used for impersonation, i.e., to launch presentation attacks to face recognition systems, as it has been evidenced by Chen et al [82].…”

“…In the same manner, makeup can be applied with the aim of identity concealment [82] or even to prevent face detection [83]. More importantly, when applied by professional makeup artists facial makeup can be used for impersonation, i.e., to launch presentation attacks to face recognition systems, as it has been evidenced by Chen et al [82]. It is to be noted that beautification induced by makeup can be circumvented by 3D face analysis [46], as well as to a great extent by investigating spectra beyond the visible one.…”

Revealing True Identity: Detecting Makeup Attacks in Face-based Biometric Systems

“…Such systems, however, are susceptible to various presentation attacks, including printed faces, artificial masks, prosthetics, and makeup attacks. To defend against various attacks and improve accuracy, authentication systems deployed in high security facilities usually employ additional modalities beside regular (a) Cosmetic makeup samples from [7] (b) Malicious makeup samples from our dataset RGB cameras. For example, stereo cameras can be used to estimate the depth in order to defend against printed faces.…”