Repeatedly experiencing the McGurk effect induces long-lasting changes in auditory speech perception

Magnotti, John F.; Lado, Anastasia; Zhang, Yue; Maasø, Arnt; Nath, Audrey; Beauchamp, Michael S.

doi:10.1038/s44271-024-00073-w

Cited by 3 publications

(4 citation statements)

References 57 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A possible concern is confounding of talker differences and syllable content. This concern was mitigated by the fact that the stimulus set contained examples of both pairings recorded from the same talkers ( Magnotti et al, 2024 ). For talker Audrey Nath, the ApaVka pairing evoked 72% fusion responses while AbaVga evoked 6% fusion responses.…”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

The noisy encoding of disparity model predicts perception of the McGurk effect in native Japanese speakers

Magnotti,

Lado,

Beauchamp

2024

Front. Neurosci.

Self Cite

View full text Add to dashboard Cite

In the McGurk effect, visual speech from the face of the talker alters the perception of auditory speech. The diversity of human languages has prompted many intercultural studies of the effect in both Western and non-Western cultures, including native Japanese speakers. Studies of large samples of native English speakers have shown that the McGurk effect is characterized by high variability in the susceptibility of different individuals to the illusion and in the strength of different experimental stimuli to induce the illusion. The noisy encoding of disparity (NED) model of the McGurk effect uses principles from Bayesian causal inference to account for this variability, separately estimating the susceptibility and sensory noise for each individual and the strength of each stimulus. To determine whether variation in McGurk perception is similar between Western and non-Western cultures, we applied the NED model to data collected from 80 native Japanese-speaking participants. Fifteen different McGurk stimuli that varied in syllable content (unvoiced auditory “pa” + visual “ka” or voiced auditory “ba” + visual “ga”) were presented interleaved with audiovisual congruent stimuli. The McGurk effect was highly variable across stimuli and participants, with the percentage of illusory fusion responses ranging from 3 to 78% across stimuli and from 0 to 91% across participants. Despite this variability, the NED model accurately predicted perception, predicting fusion rates for individual stimuli with 2.1% error and for individual participants with 2.4% error. Stimuli containing the unvoiced pa/ka pairing evoked more fusion responses than the voiced ba/ga pairing. Model estimates of sensory noise were correlated with participant age, with greater sensory noise in older participants. The NED model of the McGurk effect offers a principled way to account for individual and stimulus differences when examining the McGurk effect in different cultures.

show abstract

Section: Resultsmentioning

confidence: 99%

“…To sample currently available McGurk stimuli, 15 different stimuli (s1–s15) were collected from popular online demonstrations and previously published studies ( Table 1 ). Previous in-person and online studies presented many of the same stimuli ( Basu Mallick et al, 2015 ; Magnotti et al, 2015 , 2024 ).…”

Section: Methodsmentioning

confidence: 99%

The noisy encoding of disparity model predicts perception of the McGurk effect in native Japanese speakers

Magnotti,

Lado,

Beauchamp

2024

Front. Neurosci.

Self Cite

View full text Add to dashboard Cite

show abstract

“…The stimulus set consisted of 15 McGurk videos, each containing the incongruent pairing of auditory ba with visual ga (AbaVga, AbabaVgaga) or auditory pa and visual ka (ApaVka, ApapaVkaka) (McGurk and MacDonald, 1976). The stimulus set was the same as in the original description of the NED model (Magnotti and Beauchamp, 2015) with an additional recording of ApapaVkaka recorded by Arnt Maasø, as described in (Magnotti et al, 2024). There were 8 male talkers and 7 female talkers; two talkers (1 M and 1F) were native Japanese speakers.…”

Section: Methodsmentioning

confidence: 99%

“…A possible concern is confounding of talker differences and syllable content. This concern was mitigated by the fact that the stimulus set contained examples of both pairings recorded from the same talkers (Magnotti et al, 2024). For talker Audrey Nath, the pa/ka pairing evoked 72% fusion responses while ba/ga evoked 6% fusion responses.…”

Section: Stimulus Differencesmentioning

confidence: 99%

The Noisy Encoding of Disparity Model Predicts Perception of the McGurk Effect in Native Japanese Speakers

Magnotti,

Lado,

Beauchamp

2024

Preprint

Self Cite

View full text Add to dashboard Cite

The McGurk effect is an illusion that demonstrates the influence of information from the face of the talker on the perception of auditory speech. The diversity of human languages has prompted many intercultural studies of the effect, including in native Japanese speakers. Studies of large samples of native English speakers have shown that the McGurk effect is characterized by high variability, both in the susceptibility of different individuals to the illusion and in the frequency with which different experimental stimuli induce the illusion. The noisy encoding of disparity (NED) model of the McGurk effect uses Bayesian principles to account for this variability by separately estimating the susceptibility and sensory noise for each individual and the strength of each stimulus. To test whether the NED model could account for McGurk perception in a non-Western culture, we applied it to data collected from 80 native Japanese-speaking participants. Fifteen different McGurk stimuli were presented, along with audiovisual congruent stimuli. The McGurk effect was highly variable across stimuli and participants, with the percentage of illusory fusion responses ranging from 3% to 78% across stimuli and from 0% to 91% across participants. Despite this variability, the NED model accurately predicted perception, predicting fusion rates for individual stimuli with 2.1% error and for individual participants with 2.4% error. Stimuli containing the unvoiced pa/ka pairing evoked more fusion responses than the voiced ba/ga pairing. Model estimates of sensory noise was correlated with participant age, with greater sensory noise in older participants. The NED model of the McGurk effect offers a principled way to account for individual and stimulus differences when examining the McGurk effect within and across cultures.

show abstract

Behavioral Evidence for Two Modes of Attention

Gupta,

Matthews,

Penhune

et al. 2024

Preprint

View full text Add to dashboard Cite

Attention modulates sensory gain to select and optimize the processing of behaviorally relevant events. It has been hypothesized that attention can operate in either a rhythmic or continuous mode, depending on the nature of sensory stimulation. Despite this conceptual framework, direct behavioral evidence has been scarce. Our study explores when attention operates in a rhythmic mode through a series of nine interrelated behavioral experiments with varying stream lengths, stimulus types, attended features, and tasks. The rhythmic mode optimally operates at approximately 1.5 Hz and is prevalent in perceptual tasks involving long (> 7 s) auditory streams. Our results are supported by a model of coupled oscillators, illustrating that variations in the system’s noise level can induce shifts between continuous and rhythmic modes. Finally, the rhythmic mode is absent in syllable categorization tasks. Overall, this study provides empirical evidence for two modes of attention and defines their conditions of operation.

show abstract

Repeatedly experiencing the McGurk effect induces long-lasting changes in auditory speech perception

Cited by 3 publications

References 57 publications

The noisy encoding of disparity model predicts perception of the McGurk effect in native Japanese speakers

The noisy encoding of disparity model predicts perception of the McGurk effect in native Japanese speakers

The Noisy Encoding of Disparity Model Predicts Perception of the McGurk Effect in Native Japanese Speakers

Behavioral Evidence for Two Modes of Attention

Contact Info

Product

Resources

About