Multisensory integration: methodological approaches and emerging principles in the human brain

Calvert, Gemma A.; Thesen, Thomas

doi:10.1016/j.jphysparis.2004.03.018

Cited by 333 publications

(240 citation statements)

References 86 publications

Supporting

Mentioning

222

Contrasting

Unclassified

Order By: Relevance

“…electrode Pz). However, since these authors were mainly interested in crossmodal synchrony effects during the RHI, they restricted their analysis to high-beta and low-gamma bands (20-100 Hz); frequency bands known to be associated with bimodal integration (for a review, see Calvert and Thesen, 2004). As such, no direct comparison can be made with our results that show illusory hand ownership to be selectively associated with mu-band power suppression.…”

Section: Electrophysiology Of Ownershipmentioning

confidence: 76%

Shared electrophysiology mechanisms of body ownership and motor imagery

Evans

Blanke

2013

NeuroImage

View full text Add to dashboard Cite

Although we feel, see, and experience our hands as our own (body or hand ownership), recent research has shown that illusory hand ownership can be induced for fake or virtual hands and may be useful for neuroprosthetics and brain-computer interfaces. Despite the vast amount of behavioral data on illusory hand ownership, neuroimaging studies are rare, in particular electrophysiological studies. Thus, while the neural systems underlying hand ownership are relatively well described, the spectral signatures of body ownership as measured by electroencephalography (EEG) remain elusive. Here we induced illusory hand ownership in an automated, computer-controlled manner using virtual reality while recording 64-channel EEG and found that illusory hand ownership is reflected by a body-specific modulation in the mu-band over fronto-parietal cortex. In a second experiment in the same subjects, we then show that mu as well as beta-band activity in highly similar fronto-parietal regions was also modulated during a motor imagery task often used in paradigms employing non-invasive brain-computer interface technology. These data provide insights into the electrophysiological brain mechanisms of illusory hand ownership and their strongly overlapping mechanisms with motor imagery in fronto-parietal cortex. They also highlight the potential of combining high-resolution EEG with virtual reality setups and automatized stimulation protocols for systematic, reproducible stimulus presentation in cognitive neuroscience, and may inform the design of non-invasive brain-computer interfaces.

show abstract

Section: Electrophysiology Of Ownershipmentioning

confidence: 76%

Shared electrophysiology mechanisms of body ownership and motor imagery

Evans

Blanke

2013

NeuroImage

View full text Add to dashboard Cite

show abstract

“…The parallel influx of information through several sensory pathways jointly contributes to the detection and identification of objects and to the selection of appropriate behavioral responses. One of the main goals of contemporary research on multi-sensory processing is to better understand how the different modalities contribute to perception in humans (Calvert & Thesen, 2004). Accordingly, the study of cognitive processing subserving object perception will benefit from an approach where dynamic interactions are studied not only within a single sensory system, but between perceptual systems.…”

Section: Discussionmentioning

confidence: 99%

Multisensory Identification of Natural Objects in a Two-Way Crossmodal Priming Paradigm

Schneider

Engel

Debener

2008

Experimental Psychology

122

View full text Add to dashboard Cite

Abstract. The question of how vision and audition interact in natural object identification is currently a matter of debate. We developed a large set of auditory and visual stimuli representing natural objects in order to facilitate research in the field of multisensory processing. Normative data was obtained for 270 brief environmental sounds and 320 visual object stimuli. Each stimulus was named, categorized, and rated with regard to familiarity and emotional valence by N = 56 participants (Study 1). This multimodal stimulus set was employed in two subsequent crossmodal priming experiments that used semantically congruent and incongruent stimulus pairs in a S1-S2 paradigm. Task-relevant targets were either auditory (Study 2) or visual stimuli (Study 3). The behavioral data of both experiments expressed a crossmodal priming effect with shorter reaction times for congruent as compared to incongruent stimulus pairs. The observed facilitation effect suggests that object identification in one modality is influenced by input from another modality. This result implicates that congruent visual and auditory stimulus pairs were perceived as the same object and demonstrates a first validation of the multimodal stimulus set.

show abstract

“…Human eventrelated potential (ERP) recordings have demonstrated that unisensory areas can be engaged in cross-modal processing at both very early and late time periods after stimulus onset (Giard and Peronnet, 1999;Molholm et al, 2002;Murray et al, 2005;Meylan and Murray, 2007;Talsma et al, 2007). Furthermore, the cross-modal interactions in these brain regions can be modulated by various factors such as temporal and spatial congruence of stimuli, extent of content association, and attention (Calvert and Thesen, 2004;Busse et al, 2005;Teder-Sälejärvi et al, 2005;Baier et al, 2006;Johnson and Zatorre, 2006). Thus, the emerging brain model of multisensory integration is of a dynamic and highly interactive network of brain regions.…”

Section: Introductionmentioning

confidence: 99%

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Mishra¹,

Martı́nez²,

Sejnowski³

et al. 2007

J. Neurosci.

229

226

View full text Add to dashboard Cite

When a single flash of light is presented interposed between two brief auditory stimuli separated by 60 -100 ms, subjects typically report perceiving two flashes (Shams et al., 2000, 2002). We investigated the timing and localization of the cortical processes that underlie this illusory flash effect in 34 subjects by means of 64-channel recordings of event-related potentials (ERPs). A difference ERP calculated to isolate neural activity associated with the illusory second flash revealed an early modulation of visual cortex activity at 30 -60 ms after the second sound, which was larger in amplitude in subjects who saw the illusory flash more frequently. These subjects also showed this early modulation in response to other combinations of auditory and visual stimuli, thus pointing to consistent individual differences in the neural connectivity that underlies cross-modal integration. The overall pattern of cortical activity associated with the cross-modally induced illusory flash, however, differed markedly from that evoked by a real second flash. A trial-by-trial analysis showed that shortlatency ERP activity localized to auditory cortex and polymodal cortex of the temporal lobe, concurrent with gamma bursts in visual cortex, were associated with perception of the double-flash illusion. These results provide evidence that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.

show abstract

Multisensory integration: methodological approaches and emerging principles in the human brain

Cited by 333 publications

References 86 publications

Shared electrophysiology mechanisms of body ownership and motor imagery

Shared electrophysiology mechanisms of body ownership and motor imagery

Multisensory Identification of Natural Objects in a Two-Way Crossmodal Priming Paradigm

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Contact Info

Product

Resources

About