Body Actions Change the Appearance of Facial Expressions

Fantoni, Carlo; Gerbino, Walter

doi:10.1371/journal.pone.0108211

Cited by 19 publications

(31 citation statements)

References 73 publications

(82 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…After having performed a sequence of mood-inducing actions (either comfortable or uncomfortable), participants classified morphed faces displaying mixed expressions along the happy-to-angry continuum as either “happy” or “angry.” Systematic shifts of the point of subjective neutrality between these facial expressions were fully consistent with a facilitation-by-congruency hypothesis: comfortable actions increased the probability of classifying a neutral face as happy ( positive emotion); whereas uncomfortable actions increased the probability of classifying a neutral face as angry ( negative emotion). Furthermore, Fantoni & Gerbino (2014) found that JNDs were smaller when facial emotion identification was preceded by reaching, relative to a baseline inaction condition. They argued that hyperarousal from action (relative to inaction) improved the sensitivity to subtle variations of facial expression and reduced the degree of classification uncertainty (response times were shorter after reaching than in the baseline inaction condition).…”

Section: Introductionmentioning

confidence: 92%

“…Recently, Fantoni & Gerbino (2014) demonstrated that the internal state of comfort/discomfort induced by reaching affects the identification of facial expressions in a direction congruent with transient mood ( Fantoni, Cavallero & Gerbino, 2014a ; Gerbino et al, 2014a ; Gerbino et al, 2014b ). To manipulate transient mood in a controlled exploratory-action setting, Fantoni & Gerbino (2014) and implemented the Motor Action Mood Induction Procedure (MAMIP). The procedure required participants to perform a series of either comfortable or uncomfortable visually-guided reaches of targets randomly located at short vs. long distances, corresponding to [0.65–0.75] vs. [0.9–1.00] ranges, relative to arm length.…”

Section: Introductionmentioning

confidence: 99%

“…This effects of motor action valence (in particular, comfort/discomfort of visually-guided reaches) on perceived facial expressions fit well in the framework of the emotional mirror system ( Bastiaansen, Thioux & Keysers, 2009 ) and are consistent with emotional response categorization theory ( Niedenthal, Halberstadt & Innes-Ker, 1999 ), which implies that humans are tuned to respond to conspecifics in a way that is congruent with their emotional state. Specifically, Fantoni & Gerbino (2014) suggested that action comfort/discomfort may indirectly prime the successive identification of emotions through transient mood induction (for a review of direct and indirect affective priming effects see Janiszewski & Wyer, 2014 ).…”

Section: Introductionmentioning

confidence: 99%

“… Fantoni & Gerbino (2014) showed that subtle postural shifts associated with reaching can have a strong hedonic impact and affect how actors experience facial expressions of emotion. Using a novel Motor Action Mood Induction Procedure (MAMIP), they found consistent congruency effects in participants who performed a facial emotion identification task after a sequence of visually-guided reaches: a face perceived as neutral in a baseline condition appeared slightly happy after comfortable actions and slightly angry after uncomfortable actions.…”

mentioning

confidence: 99%

See 3 more Smart Citations

Bodily action penetrates affective perception

Fantoni

Rigutti

Gerbino

2016

PeerJ

Self Cite

View full text Add to dashboard Cite

Fantoni & Gerbino (2014) showed that subtle postural shifts associated with reaching can have a strong hedonic impact and affect how actors experience facial expressions of emotion. Using a novel Motor Action Mood Induction Procedure (MAMIP), they found consistent congruency effects in participants who performed a facial emotion identification task after a sequence of visually-guided reaches: a face perceived as neutral in a baseline condition appeared slightly happy after comfortable actions and slightly angry after uncomfortable actions. However, skeptics about the penetrability of perception (Zeimbekis & Raftopoulos, 2015) would consider such evidence insufficient to demonstrate that observer’s internal states induced by action comfort/discomfort affect perception in a top-down fashion. The action-modulated mood might have produced a back-end memory effect capable of affecting post-perceptual and decision processing, but not front-end perception.Here, we present evidence that performing a facial emotion detection (not identification) task after MAMIP exhibits systematic mood-congruent sensitivity changes, rather than response bias changes attributable to cognitive set shifts; i.e., we show that observer’s internal states induced by bodily action can modulate affective perception. The detection threshold for happiness was lower after fifty comfortable than uncomfortable reaches; while the detection threshold for anger was lower after fifty uncomfortable than comfortable reaches. Action valence induced an overall sensitivity improvement in detecting subtle variations of congruent facial expressions (happiness after positive comfortable actions, anger after negative uncomfortable actions), in the absence of significant response bias shifts. Notably, both comfortable and uncomfortable reaches impact sensitivity in an approximately symmetric way relative to a baseline inaction condition. All of these constitute compelling evidence of a genuine top-down effect on perception: specifically, facial expressions of emotion are penetrable by action-induced mood. Affective priming by action valence is a candidate mechanism for the influence of observer’s internal states on properties experienced as phenomenally objective and yet loaded with meaning.

show abstract

Section: Introductionmentioning

confidence: 92%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

mentioning

confidence: 99%

See 2 more Smart Citations

Bodily action penetrates affective perception

Fantoni

Rigutti

Gerbino

2016

PeerJ

Self Cite

View full text Add to dashboard Cite

show abstract

“…1), consider our studies on the effects of comfort and discomfort of bodily actions on perceived facial expressions of emotion. Using a novel motor action mood induction procedure (MAMIP), Fantoni and Gerbino (2014;Gerbino et al 2014) demonstrated a congruency effect in participants who performed a facial emotion identification task along a happy-to-angry morph continuum after a sequence of visually guided reaches: A face perceived as neutral in a baseline condition appeared slightly happy after comfortable actions and slightly angry after uncomfortable actions. In agreement with F&S (sect.…”

Section: Lauren L Embersonmentioning

confidence: 99%

Cognition does not affect perception: Evaluating the evidence for “top-down” effects

Firestone¹,

Scholl²

2015

Behav Brain Sci

745

764

View full text Add to dashboard Cite

Abstract:What determines what we see? In contrast to the traditional "modular" understanding of perception, according to which visual processing is encapsulated from higher-level cognition, a tidal wave of recent research alleges that states such as beliefs, desires, emotions, motivations, intentions, and linguistic representations exert direct, top-down influences on what we see. There is a growing consensus that such effects are ubiquitous, and that the distinction between perception and cognition may itself be unsustainable. We argue otherwise: None of these hundreds of studies -either individually or collectively -provides compelling evidence for true top-down effects on perception, or "cognitive penetrability." In particular, and despite their variety, we suggest that these studies all fall prey to only a handful of pitfalls. And whereas abstract theoretical challenges have failed to resolve this debate in the past, our presentation of these pitfalls is empirically anchored: In each case, we show not only how certain studies could be susceptible to the pitfall (in principle), but also how several alleged top-down effects actually are explained by the pitfall (in practice). Moreover, these pitfalls are perfectly general, with each applying to dozens of other top-down effects. We conclude by extracting the lessons provided by these pitfalls into a checklist that future work could use to convincingly demonstrate top-down effects on visual perception. The discovery of substantive top-down effects of cognition on perception would revolutionize our understanding of how the mind is organized; but without addressing these pitfalls, no such empirical report will license such exciting conclusions.

show abstract

Facial expression monitoring system for predicting patient’s sudden movement during radiotherapy using deep learning

Kim

Park

Kim

et al. 2020

J Applied Clin Med Phys

View full text Add to dashboard Cite

Purpose Imaging, breath‐holding/gating, and fixation devices have been developed to minimize setup errors so that the prescribed dose can be exactly delivered to the target volume in radiotherapy. Despite these efforts, additional patient monitoring devices have been installed in the treatment room to view patients’ whole‐body movement. We developed a facial expression recognition system using deep learning with a convolutional neural network (CNN) to predict patients’ advanced movement, enhancing the stability of the radiation treatment by giving warning signs to radiation therapists. Materials and methods Convolutional neural network model and extended Cohn‐Kanade datasets with 447 facial expressions of source images for training were used. Additionally, a user interface that can be used in the treatment control room was developed to monitor real‐time patient's facial expression in the treatment room, and the entire system was constructed by installing a camera in the treatment room. To predict the possibility of patients' sudden movement, we categorized facial expressions into two groups: (a) uncomfortable expressions and (b) comfortable expressions. We assumed that the warning sign about the sudden movement was given when the uncomfortable expression was recognized. Results We have constructed the facial expression monitoring system, and the training and test accuracy were 100% and 85.6%, respectively. In 10 patients, their emotions were recognized based on their comfortable and uncomfortable expressions with 100% detection rate. The detected various emotions were represented by a heatmap and motion prediction accuracy was analyzed for each patient. Conclusion We developed a system that monitors the patient's facial expressions and predicts patient's advanced movement during the treatment. It was confirmed that our patient monitoring system can be complementarily used with the existing monitoring system. This system will help in maintaining the initial setup and improving the accuracy of radiotherapy for the patients using deep learning in radiotherapy.

show abstract

Body Actions Change the Appearance of Facial Expressions

Cited by 19 publications

References 73 publications

Bodily action penetrates affective perception

Bodily action penetrates affective perception

Cognition does not affect perception: Evaluating the evidence for “top-down” effects

Facial expression monitoring system for predicting patient’s sudden movement during radiotherapy using deep learning

Contact Info

Product

Resources

About