Effects of an Audiovisual Emotion Perception Training for Schizophrenia: A Preliminary Study

Abstract

Individuals with schizophrenia show a reduced ability to integrate facial and vocal information in emotion perception. Although emotion perception has been a target for treatment, no study has yet examined the effect of multimodal training on emotion perception in schizophrenia. In the present study, we developed an audiovisual emotion perception training and test in which a voice and a face were simultaneously presented, and subjects were asked to judge whether the emotions of the voice and the face matched. The voices were either angry or happy, and the faces were morphed on a continuum ranging from angry to happy. Sixteen patients with schizophrenia participated in six training sessions and three test sessions (i.e., pre-training, post-training, and generalization). Eighteen healthy controls participated only in pre-training test session. Prior to training, the patients with schizophrenia performed significantly worse than did the controls in the recognition of anger; however, following the training, the patients showed a significant improvement in recognizing anger, which was maintained and generalized to a new set of stimuli. The patients also improved the recognition of happiness following the training, but this effect was not maintained or generalized. These results provide preliminary evidence that a multimodal, audiovisual training may yield improvements in anger perception for patients with schizophrenia.

Subjective Evaluation of Basic Emotions from Audio–Visual Data

“…The literature of the study area shows that studies have been mainly carried out by selecting only good-quality data-where the underlying emotions are clearly expressed-for further analysis [7,[33][34][35][36]. In addition, a few studies have focused on the perceptual evaluation of audio-visual emotion data to understand the perception of emotions [35,[37][38][39][40][41][42].…”