Changes in Facial Expression as Biometric: A Database and Benchmarks of Identification

Abstract

Abstract-Facial dynamics can be considered as unique signatures for discrimination between people. These have started to become important topic since many devices have the possibility of unlocking using face recognition or verification. In this work, we evaluate the efficacy of the transition frames of video in emotion as compared to the peak emotion frames for identification. For experiments with transition frames we extract features from each frame of the video from a fine-tuned VGG-Face Convolutional Neural Network (CNN) and geometric features from facial landmark points. To model the temporal context of the transition frames we train a Long-Short Term Memory (LSTM) on the geometric and the CNN features. Furthermore, we employ two fusion strategies: first, an early fusion, in which the geometric and the CNN features are stacked and fed to the LSTM. Second, a late fusion, in which the prediction of the LSTMs, trained independently on the two features, are stacked and used with a Support Vector Machine (SVM). Experimental results show that the late fusion strategy gives the best results and the transition frames give better identification results as compared to the peak emotion frames.

Cycle-consistent generative adversarial neural networks based low quality fingerprint enhancement

“…In the recent years many researchers are using deep neural network in biometric recognition [14,32,34]. Cao and Jain [3] proposed an automated latent fingerprint recognition algorithm using Convolutional Neural Networks (ConvNets) for ridge flow estimation and minutiae descriptor extraction.…”

Siamese Architecture-Based 3D DenseNet with Person-Specific Normalization Using Neutral Expression for Spontaneous and Posed Smile Classification

“…In other words, facial expressions are powerful visual indicators of the emotions and psychological state of individuals [ 1 ]. Consequently, facial expressions and movements have been studied in various fields, including biometric authentication, forensic science, and diagnosis of disorders [ 2 , 3 , 4 ]. In this study, we investigated spontaneous and posed smile classification, which is one way of inferring human psychological states through facial expression analysis.…”

Action Recognition Using Single-Pixel Time-of-Flight Detection

“…Deep neural networks, due to their high accuracy, are widely used in many of the computer vision applications such as emotion recognition [ 10 , 11 , 12 , 13 , 14 , 15 , 16 ], biometric recognition [ 17 , 18 , 19 , 20 ], personality analysis [ 21 , 22 ], and activity analysis [ 5 , 23 , 24 ]. Depending on the nature of the data, different structures can be used [ 25 , 26 ].…”