Primary auditory cortex activation by visual speech: an fMRI study at 3???T

Pekkola, Johanna; Ojanen, Ville; Autti, Taina; Jä̈askëlainen, Iiro P.; Möttönen, Riikka; Tarkiainen, Antti; Sams, Mikko

doi:10.1097/00001756-200502080-00010

Cited by 240 publications

(207 citation statements)

References 19 publications

Supporting

Mentioning

185

Contrasting

Unclassified

Order By: Relevance

“…However, specific distinction between primary auditory cortex and other regions of the temporal cortex cannot be achieved with MEG. Previous studies have also shown a modulation of the activity of areas of HG by visual or spoken language in both hearing and deaf individuals (Calvert et al, 1997(Calvert et al, , 2000Pekkola et al, 2005;Wild et al, 2012). Our stimuli contained linguistic content for signers only.…”

Section: Discussionmentioning

confidence: 98%

“…Speech can also be perceived visually as movements of the face and mouth (speechreading), and both auditory and visual signals contribute to our final perceptual experience (McGurk and MacDonald, 1976;Campbell, 2008). Speechreading (lipreading) not only activates regions typically considered secondary auditory areas or speech processing centres, in both deaf and hearing individuals (Söderfeldt et al, 1997;see Campbell, 2008 for a review), but it also activates regions of HG, more towards its lateral portion (Calvert et al, 1997;Calvert et al, 2000;Pekkola et al, 2005). This activation is significantly greater in the left temporal cortex, including the planum temporale and HG , in congenitally deaf participants (native signers who are also proficient speechreaders) than in hearing nonsigning controls.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Differential activity in Heschl's gyrus between deaf and hearing individuals is due to auditory deprivation rather than language modality

et al. 2016

View full text Add to dashboard Cite

Sensory cortices undergo crossmodal reorganisation as a consequence of sensory deprivation. Congenital deafness in humans represents a particular case with respect to other types of sensory deprivation, because cortical reorganisation is not only a consequence of auditory deprivation, but also of language-driven mechanisms. Visual crossmodal plasticity has been found in secondary auditory cortices of deaf individuals, but it is still unclear if reorganisation also takes place in primary auditory areas, and how this relates to language modality and auditory deprivation. Here, we dissociated the effects of language modality and auditory deprivation on crossmodal plasticity in Heschl's gyrus as a whole, and in cytoarchitectonic region Te1.0 (likely to contain the core auditory cortex). Using fMRI, we measured the BOLD response to viewing sign language in congenitally or early deaf individuals with and without sign language knowledge, and in hearing controls. Results show that differences between hearing and deaf individuals are due to a reduction in activation caused by visual stimulation in the hearing group, which is more significant in Te1.0 than in Heschl's gyrus as a whole. Furthermore, differences between deaf and hearing groups are due to auditory deprivation, and there is no evidence that the modality of language used by deaf individuals contributes to crossmodal plasticity in Heschl's gyrus.

show abstract

Section: Discussionmentioning

confidence: 98%

Section: Introductionmentioning

confidence: 99%

Differential activity in Heschl's gyrus between deaf and hearing individuals is due to auditory deprivation rather than language modality

et al. 2016

View full text Add to dashboard Cite

show abstract

“…In addition to the involvement of primary (Heschl's gyrus) and secondary auditory cortices (BA41,42) in auditory processing, they have also been mentioned in relation to audio‐visual speech perception (Calvert and Campbell 2003; Pekkola et al. 2005) and integration (Besle et al. 2009).…”

Section: Discussionmentioning

confidence: 99%

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

2015

View full text Add to dashboard Cite

IntroductionSpatio‐temporal distributions of cortical activity to audio‐visual presentations of meaningless vowel‐consonant‐vowels and the effects of audio‐visual congruence/incongruence, with emphasis on the McGurk effect, were studied. The McGurk effect occurs when a clearly audible syllable with one consonant, is presented simultaneously with a visual presentation of a face articulating a syllable with a different consonant and the resulting percept is a syllable with a consonant other than the auditorily presented one.MethodsTwenty subjects listened to pairs of audio‐visually congruent or incongruent utterances and indicated whether pair members were the same or not. Source current densities of event‐related potentials to the first utterance in the pair were estimated and effects of stimulus–response combinations, brain area, hemisphere, and clarity of visual articulation were assessed.ResultsAuditory cortex, superior parietal cortex, and middle temporal cortex were the most consistently involved areas across experimental conditions. Early (<200 msec) processing of the consonant was overall prominent in the left hemisphere, except right hemisphere prominence in superior parietal cortex and secondary visual cortex. Clarity of visual articulation impacted activity in secondary visual cortex and Wernicke's area. McGurk perception was associated with decreased activity in primary and secondary auditory cortices and Wernicke's area before 100 msec, increased activity around 100 msec which decreased again around 180 msec. Activity in Broca's area was unaffected by McGurk perception and was only increased to congruent audio‐visual stimuli 30–70 msec following consonant onset.ConclusionsThe results suggest left hemisphere prominence in the effects of stimulus and response conditions on eight brain areas involved in dynamically distributed parallel processing of audio‐visual integration. Initially (30–70 msec) subcortical contributions to auditory cortex, superior parietal cortex, and middle temporal cortex occur. During 100–140 msec, peristriate visual influences and Wernicke's area join in the processing. Resolution of incongruent audio‐visual inputs is then attempted, and if successful, McGurk perception occurs and cortical activity in left hemisphere further increases between 170 and 260 msec.

show abstract

“…There has been debate in the literature as to whether activation of the auditory cortex by lipreading occurs in the primary cortex or only in secondary auditory cortex (Calvert et al, 1997;Bernstein et al, 2002;Pekkola et al, 2005). One patient (patient 10), of seven in whom a primary auditory response could be recorded in the medial part of the transverse gyrus, showed a visual response at the same contacts.…”

Section: Direct Feedforward Visual Activation Of the Secondary Auditomentioning

confidence: 99%

Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans

Besle¹,

Fischer²,

et al. 2008

View full text Add to dashboard Cite

Hemodynamic studies have shown that the auditory cortex can be activated by visual lip movements and is a site of interactions between auditory and visual speech processing. However, they provide no information about the chronology and mechanisms of these crossmodal processes. We recorded intracranial event-related potentials to auditory, visual, and bimodal speech syllables from depth electrodes implanted in the temporal lobe of 10 epileptic patients (altogether 932 contacts). We found that lip movements activate secondary auditory areas, very shortly (Ϸ10 ms) after the activation of the visual motion area MT/V5. After this putatively feedforward visual activation of the auditory cortex, audiovisual interactions took place in the secondary auditory cortex, from 30 ms after sound onset and before any activity in the polymodal areas. Audiovisual interactions in the auditory cortex, as estimated in a linear model, consisted both of a total suppression of the visual response to lipreading and a decrease of the auditory responses to the speech sound in the bimodal condition compared with unimodal conditions. These findings demonstrate that audiovisual speech integration does not respect the classical hierarchy from sensory-specific to associative cortical areas, but rather engages multiple cross-modal mechanisms at the first stages of nonprimary auditory cortex activation.

show abstract

Primary auditory cortex activation by visual speech: an fMRI study at 3???T

Cited by 240 publications

References 19 publications

Differential activity in Heschl's gyrus between deaf and hearing individuals is due to auditory deprivation rather than language modality

Differential activity in Heschl's gyrus between deaf and hearing individuals is due to auditory deprivation rather than language modality

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans

Contact Info

Product

Resources

About