Detecting facial emotion recognition deficits in schizophrenia using dynamic stimuli of varying intensities

Hargreaves, April; Mothersill, Omar; Anderson, Michael; Lawless, Séamus; Corvin, Aiden; Donohoe, Gary

doi:10.1016/j.neulet.2016.09.017

Cited by 22 publications

(18 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Dynamic, audio-visual emotion perception was found to be impaired in patients with SCZ compared to healthy individuals, as demonstrated by poorer overall performance (lower accuracy, response speed, ability to discriminate emotional videos and greater omissions). This is in line with previous research showing that dynamic emotion perception is impaired in general in schizophrenia (Chan et al, 2010;Feingold et al, 2016;Hargreaves et al, 2016;Huang et al, 2013;Johnston et al, 2010) and may reflect domain-general deficits, such as poor attention. In addition, patients with SCZ had less activity in the superior temporal gyri, often implicated in audio-visual integration and representation of dynamic emotional expressions (Robins et al, 2009;Said et al, 2010).…”

Section: Discussionsupporting

confidence: 93%

“…Naturalistic emotion displays may better capture the complex neural processes associated with emotion perception (Arsalidou et al, 2011). In line with previous studies (Hargreaves et al, 2016;Johnston et al, 2010) we predicted that SCZ patients would have deficits in discriminating dynamic emotion perception in general, with greater deficits compared to healthy controls when emotion perception relies on prior expectations (Chambon et al, 2011); in other words, detecting emotions congruent with prior expectations. At the neural level, we predicted reduced activation in frontal regions in patients with SCZ during emotion perception that is congruent with prior expectations (Anticevic et al, 2014;Barbalat et al, 2013).…”

Section: Introductionsupporting

confidence: 82%

See 1 more Smart Citation

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

Dzafic

Burianová

Martin

et al. 2018

Schizophrenia Research

View full text Add to dashboard Cite

Impaired emotion perception is a well-established and stable deficit in schizophrenia; however, there is limited knowledge about the underlying aberrant cognitive and brain processes that result in emotion perception deficits. Recent influential work has shown that perceptual deficits in schizophrenia may result from aberrant precision in prior expectations, associated with disrupted activity in frontal regions. In the present study, we investigated the perception of dynamic, multisensory emotion, the influence of prior expectations and the underlying aberrant brain processes in schizophrenia. During a functional Magnetic Resonance Imaging scan, participants completed the Dynamic Emotion Perception task, which induces prior expectations with emotion instruction cues. We delineated neural responses and functional connectivity in whole-brain large-scale networks underlying emotion perception. Compared to healthy individuals, schizophrenia patients had lower accuracy specifically for emotions that were congruent with prior expectations. At the neural level, schizophrenia patients had less engagement of right inferior frontal and parietal regions, as well as right amygdala dysconnectivity during discrimination of emotions congruent with prior expectations. The results indicate that individuals with schizophrenia may have aberrant prior expectations about emotional expressions, associated with under-activity in inferior frontoparietal regions and right amygdala dysconnectivity, which results in impaired perception of emotion.

show abstract

Section: Discussionsupporting

confidence: 93%

Section: Introductionsupporting

confidence: 82%

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

Dzafic

Burianová

Martin

et al. 2018

Schizophrenia Research

View full text Add to dashboard Cite

show abstract

“…Specifically, we found that patients had lower accuracy, response speed and ability to discriminate emotional videos, in line with previous research Feingold et al, 2016;Hargreaves et al, 2016;Huang et al, 2013;Johnston et al, 2010). In addition, patients with SCZ had less activity in the superior temporal gyri, a region often implicated in audio-visual integration and representation of dynamic emotional expressions (Robins et al, 2009;Said et al, 2010).…”

Section: Discussionsupporting

confidence: 91%

“…In line with previous studies (Hargreaves et al, 2016;Johnston et al, 2010) we predicted that SCZ patients would have deficits in discriminating dynamic emotion perception in general, with greater deficits compared to healthy controls when emotion perception requires precise prior expectations (Adams et al, 2016); in other words, detecting emotions congruent with prior expectations. At the neural level, we predicted reduced activation in frontal regions in patients with SCZ during emotion perception that is congruent with prior expectations (Adams et al, 2016;Anticevic et al, 2014).…”

Section: Introductionsupporting

confidence: 86%

The neuroimaging and genetics of emotion perception in schizophrenia

Dzafic¹

View full text Add to dashboard Cite

Impaired emotion perception is a core deficit in schizophrenia (SCZ) that is robustly associated with poor functional outcome. Studies to date have failed to delineate the critical cognitive, neural and genetic factors that underlie 'naturalistic' emotion perception deficits in SCZ. Recently it has been proposed that in SCZ reduced precision in prior expectations impairs perception. Normal perception relies on predictive processing from precise prior expectations, which prioritise attention to context-relevant stimuli. However, no studies to date have explored the aberrancy of prior expectations during naturalistic emotion perception in SCZ and the underlying abnormal neural circuitry or involvement of SCZ genes. The present thesis aims to develop a novel dynamic emotion perception (DEP) task, in order to examine (1) the influence of prior expectations on naturalistic emotion perception in healthy individuals, and (2) emotion perception impairment in SCZ by investigating aberrancy in prior expectations, neural circuitry, and genetics.The aim of Study 1 was to create a novel functional magnetic resonance imaging (fMRI) paradigm to examine the mechanisms of prior expectations and delineate the spatiotemporal activity of brain regions that contribute to emotion perception. The newly developed and validated fMRI DEP task has improved ecological validity, using dynamic, audio-visual videos, instead of static pictures as stimuli. The improved method provided new behavioural and neuroimaging insights into the influence of prior expectations on naturalistic emotion perception. Prior expectations facilitated emotion perception after repeated exposure and learning over the course of the experiment, engaging prefrontal regions and right amygdala. In contrast, emotions incongruent with prior expectations engaged neural correlates of automatic change detection, which in a complex dynamic environment allows for adaptive behaviours in potentially advantageous or threatening situations.In Study 2, the DEP task was utilised to delineate, in the healthy brain, the functional networks that subserve rapid recognition of threatening emotions in situations either congruent or incongruent with prior expectations. The results showed that fast detection of threat congruent with prior expectations engaged a right amygdala subcortical network, which has been previously implicated in fear conditioning and coarse processing of emotion. In contrast, there was a trend association between fast detection of threat incongruent with prior expectations and activity in inferior frontoparietal network connected to the right temporoparietal junction; this has been previously implicated in rapid reorienting of attention to Finally, in Study 4, the association between SCZ polygenic risk score (PRS) and brain activity during the DEP task in healthy adults was investigated in order to assess emotion perception as an endophenotype for SCZ. The results demonstrate that PRS is associated with higher recruitment of regions involved in emotion regulat...

show abstract

“…Emotion recognition is an active research topic in the affective computing community. During the last decade, emotion recognition systems have been integrated in a number of applications across a growing number of domain fields such as cognitive science [31], clinical diagnosis [15], entertainment [38] and human-machine interaction [3]. Automatic emotion analysis and recognition in realworld videos (i.e.…”

Section: Introductionmentioning

confidence: 99%

Modeling multimodal cues in a deep learning-based framework for emotion recognition in the wild

Pini

Ahmed

Cornia

et al. 2017

Proceedings of the 19th ACM International Conference on Multimodal Interaction

View full text Add to dashboard Cite

In this paper, we propose a multimodal deep learning architecture for emotion recognition in video regarding our participation to the audio-video based sub-challenge of the Emotion Recognition in the Wild 2017 challenge. Our model combines cues from multiple video modalities, including static facial features, motion patterns related to the evolution of the human expression over time, and audio information. Specifically, it is composed of three sub-networks trained separately: the first and second ones extract static visual features and dynamic patterns through 2D and 3D Convolutional Neural Networks (CNN), while the third one consists in a pretrained audio network which is used to extract useful deep acoustic signals from video. In the audio branch, we also apply Long Short Term Memory (LSTM) networks in order to capture the temporal evolution of the audio features. To identify and exploit possible relationships among different modalities, we propose a fusion network that merges cues from the different modalities in one representation. The proposed architecture outperforms the challenge baselines (38.81% and 40.47%): we achieve an accuracy of 50.39% and 49.92% respectively on the validation and the testing data. CCS CONCEPTS • Computing methodologies → Activity recognition and understanding; Neural networks;

show abstract

Detecting facial emotion recognition deficits in schizophrenia using dynamic stimuli of varying intensities

Cited by 22 publications

References 65 publications

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

The neuroimaging and genetics of emotion perception in schizophrenia

Modeling multimodal cues in a deep learning-based framework for emotion recognition in the wild

Contact Info

Product

Resources

About