Automated facial coding software outperforms people in recognizing neutral faces as neutral from standardized datasets

Lewinski, Peter

doi:10.3389/fpsyg.2015.01386

Cited by 73 publications

(57 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…FaceReader allows for the simultaneous presence of multiple emotions. A more detailed description of the science behind FaceReader can be found at: http://info.noldus.com/free-white-paper-on-facereader-methodology/, or see [32,33].…”

Section: Categorymentioning

confidence: 99%

Sensory-specific satiety: Added insights from autonomic nervous system responses and facial expressions

Boesveldt

Delplanque

et al. 2017

Physiology & Behavior

View full text Add to dashboard Cite

• We measured sensory-specific satiety with autonomic nervous system responses and facial expressions.• Consumption of the test meals resulted overall in increased heart rate, reduced skin conductance and skin temperature, as well as intensified disgusted facial expressions.• Skin conductance and skin temperature reflected effects of sensory-specific satiety.• Sad and angry facial expressions showed effects of sensory-specific satiety. a b s t r a c t a r t i c l e i n f o As a food is consumed, its perceived pleasantness declines compared to that of other foods. Although this phenomenon, referred to as sensory-specific satiety, is well-established by means of measuring food intake and pleasantness ratings, this study was aimed at gaining more insight into the mechanisms that underlie such cognitive output behavior using two measures used in (food) emotion research, namely Autonomic Nervous System (ANS) responses and facial expressions. Twenty-four healthy female participants visited four times in a hungry state, in which they received 4 different semi-liquid meals (2 sweet and 2 savory) delivered via a time-controlled pump leading to sensory-specific satiety. Before and after the meals they were presented with a sip of all four different test meals where ANS responses (heart rate, skin conductance and skin temperature) and facial expressions were recorded. As expected, pleasantness ratings showed a significant decrease after eating the same meal or a meal similar in taste (sweet or savory) (p b 0.001), and less decrease after eating a meal with a different taste. In general, consumption of the test meals resulted in increased heart rate, reduced skin conductance and skin temperature, as well as intensified anger and disgusted facial expressions (p b 0.05). In addition, skin conductance, skin temperature, sad and angry expressions also showed effects reflecting sensory-specific satiety. In conclusion, ANS responses and facial expressions indicate that sensory specific satiety of foods 1) not only reduces the food's pleasantness but also arousal and 2) are possibly mediated by changes in food emotions.

show abstract

Section: Categorymentioning

confidence: 99%

Sensory-specific satiety: Added insights from autonomic nervous system responses and facial expressions

Boesveldt

Delplanque

et al. 2017

Physiology & Behavior

View full text Add to dashboard Cite

show abstract

“…FaceReader TM is a commercial computer vision tool used to objectively analyze the presence of expressions, action units, and emotional overall valence in facial images. FaceReader TM is well established and validated in the scientific literature, with results approaching expert level (Lewinski, 2015;Adams et al, 2016).…”

Section: Facereader Resultsmentioning

confidence: 99%

Everyday Beliefs About Emotion Perceptually Derived From Neutral Facial Appearance

Albohn

Adams

2020

Front. Psychol.

View full text Add to dashboard Cite

The evolution of the human brain and visual system is widely believed to have been shaped by the need to process and make sense out of expressive information, particularly via the face. We are so attuned to expressive information in the face that it informs even stable trait inferences (e.g., Knutson, 1996) through a process we refer to here as the face-specific fundamental attribution error (Albohn et al., 2019). We even derive highly consistent beliefs about the emotional lives of others based on emotion-resembling facial appearance (e.g., low versus high brows, big versus small eyes, etc.) in faces we know are completely devoid of overt expression (i.e., emotion overgeneralization effect: see Zebrowitz et al., 2010). The present studies extend these insights to better understand lay beliefs about older and younger adults' emotion dispositions and their impact on behavioral outcomes. In Study 1, we found that older versus younger faces objectively have more negative emotion-resembling cues in the face (using computer vision), and that raters likewise attribute more negative emotional dispositions to older versus younger adults based just on neutral facial appearance (see too Adams et al., 2016). In Study 2, we found that people appear to encode these negative emotional appearance cues in memory more so for older than younger adult faces. Finally, in Study 3 we exam downstream behavioral consequences of these negative attributions, showing that observers' avoidance of older versus younger faces is mediated by emotion-resembling facial appearance.

show abstract

“…To be sure, measures for coding should avoid incurring inconsistencies arising from human idiosyncrasies, [53] and to the extent that the agreed results reported below are based upon a simple 100% agreement that one set of witnesses or committee exhibited relatively more nonverbal cues (anger, happiness, etc) than the other set of witnesses or committee, the bulk of the coding results do not report as findings any inconsistencies among the coders (and so, a measure such as Krippendorff's Alpha is not used). Studies do not usually discuss differences among coders (although exceptions include: Schubert and colleagues, who comment on a coder's "idiosyncratic tendency to overcode"; [43] and Bucy and Gong, who discuss specific techniques for improving intercoder reliability and precision [9,[55][56][57][58]) and yet-as discussed earlier-receivers of nonverbal messages do not necessarily respond in similar ways, as these signals are conditional on pre-existing attitudes and the situational context of the behaviour, and some individuals are simply more adept than others in discerning the meaning of the signals. Finally, "stereotypical" university undergraduates have been criticized for being "socially compliant" and "more likely to be mercurial in their attitudes because of lack of self-knowledge."…”

Section: Coding Of Nonverbal Behaviour In Parliamentary Hearingsmentioning

confidence: 99%

“…First, humans still outperform computers in interpreting the nuances and context of facial expressions, although the capacity of automation is no doubt rapidly evolving. [57] Second, no software as yet (of which I am aware) automatically codes facial expressions, vocal cues and gestures as a whole package. Third, software that codes all relevant aspects of nonverbal communication may well be around the corner; nonetheless, this does not negate the importance of obtaining human coding of the various categories, as observed in real world settings.…”

Section: Coding Of Nonverbal Behaviour In Parliamentary Hearingsmentioning

confidence: 99%

Nonverbal contention and contempt in U.K. parliamentary oversight hearings on fiscal and monetary policy

Schonhardt-Bailey

2017

Polit. life sci.

View full text Add to dashboard Cite

In parliamentary committee oversight hearings on fiscal policy, monetary policy and financial stability, where verbal deliberation is the focus, nonverbal communication may be pivotal inNotably, the concern here is with the explanations and justifications aspect of accountability, and as such, the focus is on the deliberative component of accountability, rather than the implications 3 or consequences of any judgements (e.g., sanctions, penalties or other consequences of judgements are not explored in this project). Moreover, the "judgments" of parliamentary committees are not in the form of votes (at least in respect to oversight hearings), but rather are on-going and cumulative assessments of ministers and experts. In this way, both the deliberations and the judgments are dynamic and inherently interactional.Although deliberation is at the heart of decision making within public policy, its contribution remains inherently hard to measure and assess within a systematic framework. One approach to studying deliberation empirically is to apply textual analysis to the verbatim transcripts from committee meetings. In studying American monetary policy decision making, this methodology has proven valuable for gaining insights into both the policy meetings of the Federal Open MarketCommittee and the conduct of oversight by congressional committees. Parliament is especially important for select committee activity, given the much greater prominence of these committees following the key reforms of 2010 which among other things, created the election of committee members and chairs, thereby stripping the power of the party whips to appoint these members and thereby lent the committees greater autonomy in holding the Government to account[6], and even (more rarely) triggering resignations by top officials (most recently, the resignation of a newly appointed Bank of England deputy governor [7]).The findings from textual analysis are instructive as to the depth and breadth of arguments used by policymakers in their defence of policy actions. In particular, this analysis finds that deliberation in fiscal policy hearings contrasts sharply with deliberation in monetary policy and financial stability hearings, and moreover, the deliberation conducted by MPs in the Commons committee also contrasts systematically from that conducted by peers in the Lords committee. The context for these differences in content will be described further below, but the point here is that while textual analysis is effective in empirically measuring the deliberative content, it provides no information as to the delivery of these arguments within a deliberative setting. In short, the written 4 record provides us with the semantic content of deliberation, but not the underlying interpersonal dynamic of the committee hearing. Measuring nonverbal behaviour promises a means to gauge better both the emotive tone of the arguments but also the nature of the intentions of the witnesses appearing before each committee, witnesses whose credibility and inten...

show abstract

Automated facial coding software outperforms people in recognizing neutral faces as neutral from standardized datasets

Cited by 73 publications

References 22 publications

Sensory-specific satiety: Added insights from autonomic nervous system responses and facial expressions

Sensory-specific satiety: Added insights from autonomic nervous system responses and facial expressions

Everyday Beliefs About Emotion Perceptually Derived From Neutral Facial Appearance

Nonverbal contention and contempt in U.K. parliamentary oversight hearings on fiscal and monetary policy

Contact Info

Product

Resources

About