Generalization of the generation of an MMN by illusory McGurk percepts: voiceless consonants

Colin, Cécile; Radeau, Monique; Soquet, Alain; Deltenre, Paul

doi:10.1016/j.clinph.2004.03.027

Cited by 48 publications

(45 citation statements)

References 52 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Controlling for effects due to physical differences in the visual stimuli, we find clear evidence for a McGurk-MMN. That is, perceived phonemic changes in the absence of actual acoustic changes elicited the MMN (Colin et al, 2002(Colin et al, , 2004. In addition, topographic mapping and dipole modeling revealed a dominance of left hemispheric cortical generators during the early and late phases of the McGurk-MMN, consistent with the well-known left hemispheric dominance for the processing of speech.…”

Section: Introductionsupporting

confidence: 48%

“…Sams and colleagues showed that infrequent deviations in the visual articulation of audio-visual syllables (acoustic /pa/ and visual /ka/) interspersed in a sequence of congruent trials (acoustic /pa/ and visual /pa/) gave rise to magnetic mismatch fields in the supratemporal region (see also Möttönen, Krause, Tiippana, & Sams, 2002 for similar results). This MMN-like response associated with the McGurk effect was also found in scalp-recorded ERPs with maximal amplitude between 200 and 300 ms after auditory onset (Colin et al, 2002;Colin, Radeau, Soquet, & Deltenre, 2004). …”

Section: Introductionmentioning

confidence: 81%

“…1). A close inspection of the visual-alone data of Sams et al (1991) and Colin et al (2002Colin et al ( , 2004) also shows no obvious visual MMN. It is not clear why no visual MMN appears to be elicited by visual articulatory stimuli in oddball designs, but the finding strengthens our conclusion that the auditory MMN obtained in our study is not affected by an overlapping visual MMN.…”

Section: Discussionmentioning

confidence: 99%

See 2 more Smart Citations

Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion

et al. 2007

View full text Add to dashboard Cite

Seeing a speaker's facial articulatory gestures powerfully affects speech perception, helping us overcome noisy acoustical environments. One particularly dramatic illustration of visual influences on speech perception is the "McGurk illusion", where dubbing an auditory phoneme onto video of an incongruent articulatory movement can often lead to illusory auditory percepts. This illusion is so strong that even in the absence of any real change in auditory stimulation, it activates the automatic auditory change-detection system, as indexed by the mismatch negativity (MMN) component of the auditory event-related potential (ERP). We investigated the putative left hemispheric dominance of McGurk-MMN using high-density ERPs in an oddball paradigm. Topographic mapping of the initial McGurk-MMN response showed a highly lateralized left hemisphere distribution, beginning at 175 ms. Subsequently, scalp activity was also observed over bilateral fronto-central scalp with a maximal amplitude at ~290 ms, suggesting later recruitment of right temporal cortices. Strong left hemisphere dominance was again observed during the last phase of the McGurk-MMN waveform (350-400 ms). Source analysis indicated bilateral sources in the temporal lobe just posterior to primary auditory cortex. While a single source in the right superior temporal gyrus (STG) accounted for the right hemisphere activity, two separate sources were required, one in the left transverse gyrus and the other in STG, to account for left hemisphere activity. These findings support the notion that visually driven multisensory illusory phonetic percepts produce an auditory-MMN cortical response and that left hemisphere temporal cortex plays a crucial role in this process.

show abstract

Section: Introductionsupporting

confidence: 48%

Section: Introductionmentioning

confidence: 81%

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion

et al. 2007

View full text Add to dashboard Cite

show abstract

“…The neural correlates underlying AV integration of speech have been addressed by several neurogimaging approaches, including fMRI, MEG and EEG (Callan et al, 2010;Calvert, 2001;Calvert et al, 2000;Calvert et al, 2001;Colin et al, 2002a;Colin et al, 2004;Colin et al, 2002b;Miller and D'Esposito, 2005;Skipper et al, 2005;van Wassenhove et al, 2005). However, these investigations have exclusively addressed native language processing.…”

Section: Introductionmentioning

confidence: 99%

Neural correlates of audiovisual speech processing in a second language

et al. 2013

View full text Add to dashboard Cite

Abbreviations: L1 = native language, L2 = non-native language, pSTS = posterior superior temporal sulcus, STG = superior temporal gyrus, AV = audiovisual, AVc = audiovisual congruent, AVi = audiovisual incongruent, A = auditory, V = visual, B = baseline, MSI = multisensory interaction 2 AbstractNeuroimaging studies of audiovisual speech processing have exclusively addressed listeners' native language (L1). Yet, several behavioural studies now show that AV processing plays an important role in non-native (L2) speech perception. The current fMRI study measured brain activity during auditory, visual, audiovisual congruent and audiovisual incongruent utterances in L1 and L2. BOLD responses to congruent AV speech in the pSTS were stronger than in either unimodal condition in both L1 and L2. Yet no differences in AV processing were expressed according to the language background in this area. Instead, the regions in the bilateral occipital lobe had a stronger congruency effect on the BOLD response (congruent higher than incongruent) in L2 as compared to L1. According to these results, language background differences are predominantly expressed in these unimodal regions, whereas the pSTS is similarly involved in AV integration regardless of language dominance.

show abstract

“…that can engage a broad range of perceptual and cognitive processes Use of stimuli that engage higher levels of psycholinguistic processing (e.g., spoken words or sentences) complicate interpretation of results (Calvert et al, 1999;Calvert et al, 2000). Therefore, isolation of audiovisual phonetic integration effects requires phonetic level stimulus control and variation (Besle et al, 2004;Colin et al, 2004;Colin et al, 2002;Jones and Callan, 2003;Miller and d'Esposito, 2005), which can be accomplished by using nonsense syllables that are without semantic content.…”

Section: Introductionmentioning

confidence: 99%

Spatiotemporal dynamics of audiovisual speech processing

Bernstein

Auer

Wagner³

et al. 2008

NeuroImage

View full text Add to dashboard Cite

The cortical processing of auditory-alone, visual-alone, and audiovisual speech information is temporally and spatially distributed, and functional magnetic resonance imaging (fMRI) cannot adequately resolve its temporal dynamics. In order to investigate a hypothesized spatio-temporal organization for audiovisual speech processing circuits, event-related potentials (ERPs) were recorded using electroencephalography (EEG). Stimuli were congruent audiovisual /bα/, incongruent auditory /bα/ synchronized with visual /gα/, auditory-only /bα/, and visual-only /bα/ and /gα/. Current density reconstructions (CDRs) of the ERP data were computed across the latency interval of 50-250 milliseconds. The CDRs demonstrated complex spatio-temporal activation patterns that differed across stimulus conditions. The hypothesized circuit that was investigated here comprised initial integration of audiovisual speech by the middle superior temporal sulcus (STS), followed by recruitment of the intraparietal sulcus (IPS), followed by activation of Broca's area (Miller and d'Esposito, 2005). The importance of spatio-temporally sensitive measures in evaluating processing pathways was demonstrated. Results showed, strikingly, early (< 100 msec) and simultaneous activations in areas of the supramarginal and angular gyrus (SMG/AG), the IPS, the inferior frontal gyrus, and the dorsolateral prefrontal cortex. Also, emergent left hemisphere SMG/AG activation, not predicted based on the unisensory stimulus conditions was observed at approximately 160 to 220 msec. The STS was neither the earliest nor most prominent activation site, although it is frequently considered the sine qua non of audiovisual speech integration. As discussed here, the relatively late activity of the SMG/AG solely under audiovisual conditions is a possible candidate audiovisual speech integration response.

show abstract

Generalization of the generation of an MMN by illusory McGurk percepts: voiceless consonants

Abstract: Provided that the MMN is computed with deviant stimuli only, the present results confirm the elicitation of genuine audiovisual MMN. Possible refractoriness effects and N2b confound have, however, to be controlled for in further studies.

Cited by 48 publications

References 52 publications

Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion

Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion

Neural correlates of audiovisual speech processing in a second language

Spatiotemporal dynamics of audiovisual speech processing

Contact Info

Product

Resources

About