Early modulation of visual cortex by sound: an MEG study

Shams, Ladan; Iwaki, Sunao; Chawla, Aman; Bhattacharya, Joydeep

doi:10.1016/j.neulet.2004.12.035

Cited by 126 publications

(117 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although online effects of vision on audition are well known (Ma, Zhou, Ross, Foxe, & Parra, 2009;McGurk & MacDonald, 1976), less is known about the degree to which auditory information affects online visual processing and visual attention. There is now accumulating evidence that sounds affect visual perception (Sekuler, Sekuler, & Lau, 1997;Shams, Kamitani, & Shimojo, 2002), with modulations of early visual cortex by sounds detected in as little as 35-65 msec (Shams, Iwaki, Chawla, & Bhattacharya, 2005). The finding that spoken labels facilitated the deployment of visual attention can be viewed as an instance of such cross-modal facilitation (Molholm, Ritter, Javitt, & Foxe, 2004), albeit one in which verbal labels do not merely facilitate the recognition of a single object, but facilitate the visual processing of multiple objects from the named category in parallel.…”

Section: Discussionmentioning

confidence: 99%

Redundant spoken labels facilitate perception of multiple items

Lupyan

Spivey

2010

Attention, Perception & Psychophysics

View full text Add to dashboard Cite

Section: Discussionmentioning

confidence: 99%

Redundant spoken labels facilitate perception of multiple items

Lupyan

Spivey

2010

Attention, Perception & Psychophysics

View full text Add to dashboard Cite

“…If that is the case, we would expect familiar and unfamiliar objects to be processed differently in the context of the sound-induced flash illusion. The sound-induced flash illusion represents a good way to test the role of visual familiarity in early audio-visual interactions because the illusion originates early in the processing stream [21,27,30,35] and because audition, not vision, dominates in this task [28][29].…”

Section: Page 5 Of 21mentioning

confidence: 99%

“…Integration of the audio-visual stimuli of the flash illusion appears to occur at early stages of stimulus processing [21,27,30,35] and it is linked to activity in the visual cortex (V1) although it is unclear whether the activity in V1 is due to direct inputs from the primary auditory cortex or to back-projections from the superior temporal polysensory area [35]. As for the time course of familiar stimuli processing, evidence from face recognition studies shows that recognising a face as familiar involves a series of processes [3], including the processing of visual features of familiar individuals, then the unique semantic information associated to the person, and then his/her name (see also [16]).…”

Section: Page 5 Of 21mentioning

confidence: 99%

See 1 more Smart Citation

Familiarity of objects affects susceptibility to the sound-induced flash illusion

Setti

Chan

2011

Neuroscience Letters

View full text Add to dashboard Cite

A c c e p t e d M a n u s c r i p t  Visual familiarity reduces susceptibility to the sound induced flash-illusion  The effect of familiarity holds for faces and buildings  Early audio-visual multisensory interactions are modulated by high level processing AbstractAudition is accepted as more reliable (thus dominant) than vision when temporal discrimination is required by the task. However, it is not known whether the characteristics of the visual stimulus, for example its familiarity to the perceiver, affect auditory dominance. In this study we manipulated familiarity of the visual stimulus in a well-established multisensory phenomenon, i.e. the sound-induced flash illusion. This illusion occurs when, for example, one brief visual stimulus (e.g. a flash) is presented in close temporal proximity with two brief sounds; participants perceive two flashes instead of one. We found that when the visual faces or buildings stimuli were familiar, participants were less susceptible to the illusion than when they were unfamiliar. As the illusion has been ascribed to early cross-sensory interactions between vision and audition, the present work offers behavioural evidence that high level processing of objects" characteristics such as familiarity, affect early temporal multisensory integration. Possible mechanisms underlying the effect of familiarity are discussed.

show abstract

“…Previous ERP/magnetoencephalographic (Shams et al, 2001(Shams et al, , 2005aArden et al, 2003) and functional magnetic resonance (fMRI) investigations (Watkins et al, 2006) of the neural basis of the double-flash illusion have suggested that visual cortex activation underlies the perception of the illusory second flash. However, the exact timing of this visual cortex activity and the participation of other brain regions in engendering the illusion still remain unclear.…”

Section: Introductionmentioning

confidence: 99%

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Mishra¹,

Martı́nez²,

Sejnowski³

et al. 2007

J. Neurosci.

232

228

View full text Add to dashboard Cite

When a single flash of light is presented interposed between two brief auditory stimuli separated by 60 -100 ms, subjects typically report perceiving two flashes (Shams et al., 2000, 2002). We investigated the timing and localization of the cortical processes that underlie this illusory flash effect in 34 subjects by means of 64-channel recordings of event-related potentials (ERPs). A difference ERP calculated to isolate neural activity associated with the illusory second flash revealed an early modulation of visual cortex activity at 30 -60 ms after the second sound, which was larger in amplitude in subjects who saw the illusory flash more frequently. These subjects also showed this early modulation in response to other combinations of auditory and visual stimuli, thus pointing to consistent individual differences in the neural connectivity that underlies cross-modal integration. The overall pattern of cortical activity associated with the cross-modally induced illusory flash, however, differed markedly from that evoked by a real second flash. A trial-by-trial analysis showed that shortlatency ERP activity localized to auditory cortex and polymodal cortex of the temporal lobe, concurrent with gamma bursts in visual cortex, were associated with perception of the double-flash illusion. These results provide evidence that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.

show abstract

Early modulation of visual cortex by sound: an MEG study

Cited by 126 publications

References 44 publications

Redundant spoken labels facilitate perception of multiple items

Redundant spoken labels facilitate perception of multiple items

Familiarity of objects affects susceptibility to the sound-induced flash illusion

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Contact Info

Product

Resources

About