Creating Realistic Presentation Attacks for Facial Impersonation Step-by-Step

Abstract

Presentation attacks are one of the many dangers facing law enforcement today. In addition, material science is constantly advancing and criminals, aware of this fact, are taking advantage of new composites to manufacture new artifacts that allow them to cross borders by breaching border control points. This article presents the creation of several presentation attacks using make-up, hyper-realistic latex, and prosthetic masks. It is worth noting that such attacks do not receive adequate attention, due to the difficulty in their elaboration. The work of professionals in the make-up sector is required. Each stage of processing is analyzed for any artifacts that would facilitate the detection of the attack, using a multispectral approach in the visible and thermal spectra. The methodology evaluates three different face recognition systems (FRS), the different stages of impersonation, i.e. when a specific part of the face such as nose, cheekbones, jaw, or eyes is incorporated. The results show that certain parts of the face improve impersonation and make it more difficult for the algorithms to detect possible impersonation. However, other parts of the face, such as the jaw, not only do not improve impersonation but also significantly worsen performance. Using OpenFace as an FRS example, which is one of the FRS employed in this research work, the bonafide comparison of the target yields a score of 0.304, while with the make-up attack before applying make-up to the jaw, it gives 0.291, and after applying make-up, it gives 0.421.