Your Face Mirrors Your Deepest Beliefs—Predicting Personality and Morals through Facial Emotion Recognition

Abstract

Can we really “read the mind in the eyes”? Moreover, can AI assist us in this task? This paper answers these two questions by introducing a machine learning system that predicts personality characteristics of individuals on the basis of their face. It does so by tracking the emotional response of the individual’s face through facial emotion recognition (FER) while watching a series of 15 short videos of different genres. To calibrate the system, we invited 85 people to watch the videos, while their emotional responses were analyzed through their facial expression. At the same time, these individuals also took four well-validated surveys of personality characteristics and moral values: the revised NEO FFI personality inventory, the Haidt moral foundations test, the Schwartz personal value system, and the domain-specific risk-taking scale (DOSPERT). We found that personality characteristics and moral values of an individual can be predicted through their emotional response to the videos as shown in their face, with an accuracy of up to 86% using gradient-boosted trees. We also found that different personality characteristics are better predicted by different videos, in other words, there is no single video that will provide accurate predictions for all personality characteristics, but it is the response to the mix of different videos that allows for accurate prediction.

Leveraging the Sensitivity of Plants with Deep Learning to Recognize Human Emotions

“…The task was to watch a video sequence designed to elicit strong emotional responses from participants. The video sequence was created based on previous work by Gloor et al [ 32 ], and the details of the video are described in Table 1 . The participant then sat in the experimental room, and the sensors (plant and camera) were activated.…”

Measuring ethical behavior with AI and natural language processing to assess business success

“…These emotions have been preserved because of their biological and social functions are associated with an organized recurring pattern of behavioral components 59 , 60 . The Basic Emotion Theory was adopted by a recent study that used facial emotion recognition to predict emotional response to visual stimuli, which highlights the strong association between personality characteristics and moral values of individuals 61 . Based on an individual’s moral values, the individual will show different emotional responses.…”

Psychometric profiling of individuals using Twitter profiles: A psychological Natural Language Processing based approach

“…Talent acquisition and talent management consider psychometric profiling an important step as many business leaders have admitted that mindset is more important than skill-set in a dependable candidate. 2 The most recent domains that researchers have started looking into to understand the personality of person are facial cues, 3,4 speech, 5 handwriting 6 and oddball questions. 7 Some new fields where the use of personality profiling is proposed is cyber threat intelligence, where Reference 8 found out that the personality of each hacker is correlated with the pattern of their hacking and their expertise level.…”

“…The most recent domains that researchers have started looking into to understand the personality of person are facial cues, 3,4 speech, 5 handwriting 6 and oddball questions 7 . Some new fields where the use of personality profiling is proposed is cyber threat intelligence, where Reference 8 found out that the personality of each hacker is correlated with the pattern of their hacking and their expertise level.…”