Sound alters visual evoked potentials in humans

Shams, Ladan; Kamitani, Yukiyasu; Thompson, Samuel V.; Shimojo, Shinsuke

doi:10.1097/00001756-200112040-00049

Cited by 168 publications

(142 citation statements)

References 6 publications

Supporting

Mentioning

119

Contrasting

Order By: Relevance

“…The ERP correlates of illusory and real flash perception have been compared previously (Shams et al, 2001) using three recording channels over occipital cortex. Both the illusory and real flash difference waveforms were reported to display a positive deflection at ϳ200 ms, which was interpreted as a common neural basis for the illusory and real percepts.…”

Section: Discussionmentioning

confidence: 99%

“…Previous ERP/magnetoencephalographic (Shams et al, 2001(Shams et al, , 2005aArden et al, 2003) and functional magnetic resonance (fMRI) investigations (Watkins et al, 2006) of the neural basis of the double-flash illusion have suggested that visual cortex activation underlies the perception of the illusory second flash. However, the exact timing of this visual cortex activity and the participation of other brain regions in engendering the illusion still remain unclear.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Mishra¹,

Martı́nez²,

Sejnowski³

et al. 2007

J. Neurosci.

231

228

View full text Add to dashboard Cite

When a single flash of light is presented interposed between two brief auditory stimuli separated by 60 -100 ms, subjects typically report perceiving two flashes (Shams et al., 2000, 2002). We investigated the timing and localization of the cortical processes that underlie this illusory flash effect in 34 subjects by means of 64-channel recordings of event-related potentials (ERPs). A difference ERP calculated to isolate neural activity associated with the illusory second flash revealed an early modulation of visual cortex activity at 30 -60 ms after the second sound, which was larger in amplitude in subjects who saw the illusory flash more frequently. These subjects also showed this early modulation in response to other combinations of auditory and visual stimuli, thus pointing to consistent individual differences in the neural connectivity that underlies cross-modal integration. The overall pattern of cortical activity associated with the cross-modally induced illusory flash, however, differed markedly from that evoked by a real second flash. A trial-by-trial analysis showed that shortlatency ERP activity localized to auditory cortex and polymodal cortex of the temporal lobe, concurrent with gamma bursts in visual cortex, were associated with perception of the double-flash illusion. These results provide evidence that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Mishra¹,

Martı́nez²,

Sejnowski³

et al. 2007

J. Neurosci.

231

228

View full text Add to dashboard Cite

show abstract

“…If that is the case, we would expect familiar and unfamiliar objects to be processed differently in the context of the sound-induced flash illusion. The sound-induced flash illusion represents a good way to test the role of visual familiarity in early audio-visual interactions because the illusion originates early in the processing stream [21,27,30,35] and because audition, not vision, dominates in this task [28][29].…”

Section: Page 5 Of 21mentioning

confidence: 99%

“…In this circumstance participants tend to perceive two visual stimuli instead of one, due to the higher reliability of audition compared to vision in tasks requiring rapid temporal discrimination [1]. The illusion constitutes a robust phenomenological perception [20] that has been ascribed to early cross-sensory interactions [21,27,30,35].…”

Section: Introductionmentioning

confidence: 99%

Familiarity of objects affects susceptibility to the sound-induced flash illusion

Setti

Chan

2011

Neuroscience Letters

View full text Add to dashboard Cite

A c c e p t e d M a n u s c r i p t  Visual familiarity reduces susceptibility to the sound induced flash-illusion  The effect of familiarity holds for faces and buildings  Early audio-visual multisensory interactions are modulated by high level processing AbstractAudition is accepted as more reliable (thus dominant) than vision when temporal discrimination is required by the task. However, it is not known whether the characteristics of the visual stimulus, for example its familiarity to the perceiver, affect auditory dominance. In this study we manipulated familiarity of the visual stimulus in a well-established multisensory phenomenon, i.e. the sound-induced flash illusion. This illusion occurs when, for example, one brief visual stimulus (e.g. a flash) is presented in close temporal proximity with two brief sounds; participants perceive two flashes instead of one. We found that when the visual faces or buildings stimuli were familiar, participants were less susceptible to the illusion than when they were unfamiliar. As the illusion has been ascribed to early cross-sensory interactions between vision and audition, the present work offers behavioural evidence that high level processing of objects" characteristics such as familiarity, affect early temporal multisensory integration. Possible mechanisms underlying the effect of familiarity are discussed.

show abstract

“…Sounds (short transient beeps) are presented concurrently with the visual flashes and evoke additional, illusory flashes; the number of presented beeps influences the number of flashes perceived (Shams et al, 2000). EEG activity measured during the task has shown that the perception of illusory flashes concurs with increased early EEG activity above the visual cortex (Shams, Kamitani, Thompson, & Shimojo, 2001) indicating auditoryvisual integration at a low, sensory, level. Additional evidence comes from a study by Arden, Wolf, and Messiter (2003), who showed that sound alone does not drive primary visual cortex (V1), yet the combination of the auditory and visual stimuli triggers additional activity in V1, which may drive the illusion.…”

mentioning

confidence: 99%

Brief Report: Can You See What is Not There? Low-level Auditory–visual Integration in Autism Spectrum Disorder

Smagt

Engeland

Kemner

2007

J Autism Dev Disord

View full text Add to dashboard Cite

Patients diagnosed with Autism Spectrum Disorder, show impaired integration of information across different senses. The processing-level from which this impairment originates, however, remains unclear. We investigated low-level integration of auditory and visual stimuli in subjects with Autism Spectrum Disorder. High-functioning adult subjects with Autism Spectrum Disorder as well as age-and IQ-matched adults were tested using a task that evokes illusory visual stimuli, by presenting sounds concurrently with visual flashes. In both groups the number of sounds presented significantly affected the number of flashes perceived, yet there was no difference between groups. This finding implicates that any problems arising from integrating auditory and visual information must stem from higher processing stages in high-functioning adults with Autism Spectrum Disorder.

show abstract

Sound alters visual evoked potentials in humans

Cited by 168 publications

References 6 publications

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Familiarity of objects affects susceptibility to the sound-induced flash illusion

Brief Report: Can You See What is Not There? Low-level Auditory–visual Integration in Autism Spectrum Disorder

Contact Info

Product

Resources

About