Identification of emotional intonation evaluated by fMRI

Wildgruber, Dirk; Riecker, Axel; Hertrich, Ingo; Erb, Michael; Grodd, Wolfgang; Ethofer, Thomas; Ackermann, Hermann

doi:10.1016/j.neuroimage.2004.10.034

Cited by 299 publications

(252 citation statements)

References 66 publications

Supporting

Mentioning

219

Contrasting

Unclassified

Order By: Relevance

“…2011), in line with a general suggestion of abstract internal representations that constrain the analysis of subsequent speech inputs (Wildgruber et al. 2005). Taken together these findings, in conjunction with earlier reports on the involvement of these areas, indicate that cortical audio‐visual integration begins at an early stage of processing in the auditory cortex, superior parietal cortex and the middle temporal gyrus, mostly in the left hemisphere.…”

Section: Discussionmentioning

confidence: 99%

“…In addition, electroencephalographic findings showed audio‐visual interaction that speeds up cortical processing of auditory signals within 100 msec of signal onset (Wildgruber et al. 2005). Interestingly, electrophysiological studies on early (<200 msec) audio‐visual speech interactions in auditory cortex indicate a probable role of sensory, attentional and task‐related factors in modulating these early interactions (Besle et al.…”

Section: Introductionmentioning

confidence: 99%

“…The right hemisphere's role typically involves phonologic/acoustic feature extraction, prosody, and emotional expression/perception (Sinai and Pratt, 2003; Wildgruber et al. 2005). Patients who suffer from pure word deafness almost always have bilateral brain damage (Albert et al.…”

Section: Introductionmentioning

confidence: 99%

“…1981; Sinai and Pratt, 2003; Wildgruber et al. 2005), spatial orientation (Sabbagh 1999; Snow 2000), lexical, grammatical, and semantic aspects of language processing (Delis et al. 1983; Faust and Chiarello 1998; Federmeier and Kutas 1999; Nieto et al.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

2015

View full text Add to dashboard Cite

IntroductionSpatio‐temporal distributions of cortical activity to audio‐visual presentations of meaningless vowel‐consonant‐vowels and the effects of audio‐visual congruence/incongruence, with emphasis on the McGurk effect, were studied. The McGurk effect occurs when a clearly audible syllable with one consonant, is presented simultaneously with a visual presentation of a face articulating a syllable with a different consonant and the resulting percept is a syllable with a consonant other than the auditorily presented one.MethodsTwenty subjects listened to pairs of audio‐visually congruent or incongruent utterances and indicated whether pair members were the same or not. Source current densities of event‐related potentials to the first utterance in the pair were estimated and effects of stimulus–response combinations, brain area, hemisphere, and clarity of visual articulation were assessed.ResultsAuditory cortex, superior parietal cortex, and middle temporal cortex were the most consistently involved areas across experimental conditions. Early (<200 msec) processing of the consonant was overall prominent in the left hemisphere, except right hemisphere prominence in superior parietal cortex and secondary visual cortex. Clarity of visual articulation impacted activity in secondary visual cortex and Wernicke's area. McGurk perception was associated with decreased activity in primary and secondary auditory cortices and Wernicke's area before 100 msec, increased activity around 100 msec which decreased again around 180 msec. Activity in Broca's area was unaffected by McGurk perception and was only increased to congruent audio‐visual stimuli 30–70 msec following consonant onset.ConclusionsThe results suggest left hemisphere prominence in the effects of stimulus and response conditions on eight brain areas involved in dynamically distributed parallel processing of audio‐visual integration. Initially (30–70 msec) subcortical contributions to auditory cortex, superior parietal cortex, and middle temporal cortex occur. During 100–140 msec, peristriate visual influences and Wernicke's area join in the processing. Resolution of incongruent audio‐visual inputs is then attempted, and if successful, McGurk perception occurs and cortical activity in left hemisphere further increases between 170 and 260 msec.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

2015

View full text Add to dashboard Cite

show abstract

“…Consensus suggests a right hemisphere advantage for emotional (non-semantic) aspects of language and prosody (Mitchell and Crow, 2005), particularly in the right STS and MTG, whereas more semantic aspects of language recruit more left-sided regions (Mitchell et al, 2003). This hemispheric pattern has been seen using fMRI (Mitchell et al, 2003) (Wildgruber et al, 2005), transcranial Doppler ultrasonography (Vingerhoets et al, 2003), repetitive transcranial magnetic stimulation (van Rijin et al, 2005), event-related potential (Eckstein and Friederici, 2005), and in lesion studies (Pell, 2006). Therefore, it is possible, that the tone processing impairment on the right in the SPD subjects is related to non-semantic aspects of their odd speech.…”

Section: Discussionmentioning

confidence: 90%

Auditory processing abnormalities in schizotypal personality disorder: An fMRI experiment using tones of deviant pitch and duration

Dickey

Mórocz

Niznikiewicz

et al. 2008

Schizophrenia Research

View full text Add to dashboard Cite

Background-One of the cardinal features of schizotypal personality disorder (SPD) is language abnormalities. The focus of this study was to determine whether or not there are also processing abnormalities of pure tones differing in pitch and duration in SPD.Methods-Thirteen neuroleptic-naïve male subjects met full criteria for SPD and were groupmatched on age and parental socioeconomic status to 13 comparison subjects. Verbal learning was measured with the California Verbal Learning Test. Heschl's gyrus volumes were measured using structural MRI. Whole-brain fMRI activation patterns in an auditory task of listening to tones including pitch and duration deviants were compared between SPD and control subjects. In a Contributors Dickey: designed the study, collected the fMRI data, analyzed the clinical and fMRI data, and wrote the manuscript. Morocz: analyzed the fMRI data. Niznikiewicz: collected and analyzed the ERP data, and contributed to the manuscript. Voglmaier: collected and analyzed CVLT data, and performed SCID interview. Dreusicke: analyzed the fMRI data. Toner: aided in fMRI data collection. Yoo: aided in initial fMRI data collection. Khan: aided in final fMRI data presentation. Shenton: reviewed the manuscript. McCarley: reviewed the manuscript. Conflict of interestAll authors declare that they have no conflict of interest. Results-In the region of the STG, SPD subjects demonstrated more activation to pitch deviants bilaterally (p<0.001); and to duration deviants in the left hemisphere (p=0.005) (two-sample t). SPD subjects also showed more bilateral parietal cortex activation to duration deviants. In no region did comparison subjects activate more than SPD subjects in either experiment. Exploratory correlations for SPD subjects suggest a relationship between peak activation on the right for deviant tones in the pitch experiment with odd speech and impaired verbal learning. There was no difference between groups on Heschl's gyrus volume. NIH Public AccessConclusions-These data suggest that SPD subjects have inefficient or hyper-responsive processing of pure tones both in terms of pitch and duration deviance that is not attributable to smaller Heschl's gyrus volumes. Finally, these auditory processing abnormalities may have significance for the odd speech heard in some SPD subjects and downstream language and verbal learning deficits.

show abstract

Reading Affect in the Face and Voice

Wang¹,

Lee²,

Sigman³

et al. 2007

Arch Gen Psychiatry

204

View full text Add to dashboard Cite

Context: Understanding a speaker's communicative intent in everyday interactions is likely to draw on cues such as facial expression and tone of voice. Prior research has shown that individuals with autism spectrum disorders (ASD) show reduced activity in brain regions that respond selectively to the face and voice. However, there is also evidence that activity in key regions can be increased if task demands allow for explicit processing of emotion.Objectives: To examine the neural circuitry underlying impairments in interpreting communicative intentions in ASD using irony comprehension as a test case, and to determine whether explicit instructions to attend to facial expression and tone of voice will elicit more normative patterns of brain activity.Design, Setting, and Participants: Eighteen boys with ASD (aged 7-17 years, full-scale IQ Ͼ70) and 18 typically developing (TD) boys underwent functional magnetic resonance imaging at the Ahmanson-Lovelace Brain Mapping Center, University of California, Los Angeles. Main Outcome Measures:Blood oxygenation leveldependent brain activity during the presentation of short scenarios involving irony. Behavioral performance (accuracy and response time) was also recorded.Results: Reduced activity in the medial prefrontal cortex and right superior temporal gyrus was observed in children with ASD relative to TD children during the perception of potentially ironic vs control scenarios. Importantly, a significant groupϫcondition interaction in the medial prefrontal cortex showed that activity was modulated by explicit instructions to attend to facial expression and tone of voice only in the ASD group. Finally, medial prefrontal cortex activity was inversely related to symptom severity in children with ASD such that children with greater social impairment showed less activity in this region.Conclusions: Explicit instructions to attend to facial expression and tone of voice can elicit increased activity in the medial prefrontal cortex, part of a network important for understanding the intentions of others, in children with ASD. These findings suggest a strategy for future intervention research. Psychiatry. 2007;64:698-708 Arch Gen

show abstract

Identification of emotional intonation evaluated by fMRI

Cited by 299 publications

References 66 publications

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

Auditory processing abnormalities in schizotypal personality disorder: An fMRI experiment using tones of deviant pitch and duration

Reading Affect in the Face and Voice

Contact Info

Product

Resources

About