Semantic confusion regarding the development of multisensory integration: a practical solution

Stein, Barry E.; Burr, David; Constantinidis, Christos; Laurienti, Paul J.; Meredith, M. Alex; Perrault, Thomas J.; Ramachandran, Ramnarayan; Röder, Brigitte; Rowland, Benjamin A.; Sathian, K.; Schroeder, Charles E.; Shams, Ladan; Stanford, Terrence R.; Wallace, Mark T.; Yu, Liping; Lewkowicz, David J.

doi:10.1111/j.1460-9568.2010.07206.x

Cited by 113 publications

(98 citation statements)

References 32 publications

(58 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, other studies have found that adolescents with ASD catch up to their typically developing peers and that these deficits are ameliorated upon entering adolescence (39,40). Also the terminology of "multisensory integration" is inconsistent (28,41), making the interpretation of results complex. Thus, a second goal of the present study was to test for a specific, well-studied property of cue combination.…”

Section: Significancementioning

confidence: 99%

Self-motion perception in autism is compromised by visual noise but integrated optimally across multiple senses

Zaidel

Goin-Kochel

Angelaki³

2015

Proc. Natl. Acad. Sci. U.S.A.

105

View full text Add to dashboard Cite

Perceptual processing in autism spectrum disorder (ASD) is marked by superior low-level task performance and inferior complex-task performance. This observation has led to theories of defective integration in ASD of local parts into a global percept. Despite mixed experimental results, this notion maintains widespread influence and has also motivated recent theories of defective multisensory integration in ASD. Impaired ASD performance in tasks involving classic random dot visual motion stimuli, corrupted by noise as a means to manipulate task difficulty, is frequently interpreted to support this notion of global integration deficits. By manipulating task difficulty independently of visual stimulus noise, here we test the hypothesis that heightened sensitivity to noise, rather than integration deficits, may characterize ASD. We found that although perception of visual motion through a cloud of dots was unimpaired without noise, the addition of stimulus noise significantly affected adolescents with ASD, more than controls. Strikingly, individuals with ASD demonstrated intact multisensory (visual-vestibular) integration, even in the presence of noise. Additionally, when vestibular motion was paired with pure visual noise, individuals with ASD demonstrated a different strategy than controls, marked by reduced flexibility. This result could be simulated by using attenuated (less reliable) and inflexible (not experiencedependent) Bayesian priors in ASD. These findings question widespread theories of impaired global and multisensory integration in ASD. Rather, they implicate increased sensitivity to sensory noise and less use of prior knowledge in ASD, suggesting increased reliance on incoming sensory information.autism | multisensory integration | noise | coherence | Bayesian

show abstract

Section: Significancementioning

confidence: 99%

Self-motion perception in autism is compromised by visual noise but integrated optimally across multiple senses

Zaidel

Goin-Kochel

Angelaki³

2015

Proc. Natl. Acad. Sci. U.S.A.

105

View full text Add to dashboard Cite

show abstract

“…Note that we follow the terminology suggested by Stein et al (2010) by using "cross-modal" when referring to the stimulus complex or the experimental condition and "multisensory" when referring to the (observed) biological consequences. The auditory (A) and visual (V) stimuli were delivered modality specific, or in combination (cross-modal, AV).…”

Section: Methodsmentioning

confidence: 99%

Auditory Event-Related Response in Visual Cortex Modulates Subsequent Visual Responses in Humans

Naue

Rach²,

Strüber³

et al. 2011

J. Neurosci.

View full text Add to dashboard Cite

Growing evidence from electrophysiological data in animal and human studies suggests that multisensory interaction is not exclusively a higher-order process, but also takes place in primary sensory cortices. Such early multisensory interaction is thought to be mediated by means of phase resetting. The presentation of a stimulus to one sensory modality resets the phase of ongoing oscillations in another modality such that processing in the latter modality is modulated. In humans, evidence for such a mechanism is still sparse. In the current study, the influence of an auditory stimulus on visual processing was investigated by measuring the electroencephalogram (EEG) and behavioral responses of humans to visual, auditory, and audiovisual stimulation with varying stimulus-onset asynchrony (SOA). We observed three distinct oscillatory EEG responses in our data. An initial gamma-band response around 50 Hz was followed by a beta-band response around 25 Hz, and a theta response around 6 Hz. The latter was enhanced in response to cross-modal stimuli as compared to either unimodal stimuli. Interestingly, the beta response to unimodal auditory stimuli was dominant in electrodes over visual areas. The SOA between auditory and visual stimuli-albeit not consciously perceived-had a modulatory impact on the multisensory evoked beta-band responses; i.e., the amplitude depended on SOA in a sinusoidal fashion, suggesting a phase reset. These findings further support the notion that parameters of brain oscillations such as amplitude and phase are essential predictors of subsequent brain responses and might be one of the mechanisms underlying multisensory integration.

show abstract

“…Stein et al 2010). Previous event-related potential (ERP) studies in young adults showed that sensory-specific regions, namely primary auditory, primary visual, ventral occipito-temporal and superior temporal cortices displayed increased activity in response to temporally-and semantically-congruent cross-modal inputs (Cappe, Thut, Romei & Murray, 2010;Raij et al, 2010;Teder-Sälejärvi, Russo, McDonald & Hillyard, 2005).…”

Section: Introductionmentioning

confidence: 99%

Visual dominance and multisensory integration changes with age

2013

View full text Add to dashboard Cite

Objects comprise of visual and auditory signatures that arrive through distinct sensory channels. Exposure to cross-modal events sets up expectations about what a given object most likely "sounds" like, and vice versa, thereby facilitating detection and recognition. Whereas episodic and working memory functions decline with age, the extent to which multisensory integration processes change with age remains an open question. In the present study, we examined whether multisensory integration processes play a compensatory role in normal aging. Magnetoencephalography recordings of semantically-related cross-modal and unimodal auditory and visual stimuli captured the spatiotemporal dynamics of multisensory responses in young and older adults. Whereas sensory-specific regions showed increased activity in response to cross-modal compared to unimodal stimuli 100 ms after stimulus onset in both age groups, posterior parietal and medial prefrontal regions responded preferentially to cross-modal stimuli between 150 and 300 ms in the older group only. Additionally, faster detection of cross-modal stimuli correlated with increased activity in inferior parietal and medial prefrontal regions 100 ms after stimulus onset in older compared to younger adults. Age-related differences in visual dominance were also observed with older adults exhibiting significantly larger multisensory facilitation effects relative to the auditory modality. Using structural equation modeling, we showed that age-related increases in parietal and medial prefrontal source activity predicted faster detection of cross-modal stimuli. Furthermore, the relationship between performance and source activity was mediated by age-related reductions in gray matter volume in those regions. Thus, we propose that multisensory integration processes change with age such that posterior parietal and medial prefrontal activity underlies the integrated response in older adults. AbstractObjects comprise of visual and auditory signatures that arrive through distinct sensory channels. Exposure to cross-modal events sets up expectations about what a given object most likely "sounds" like, and vice versa, thereby facilitating detection and recognition. Whereas episodic and working memory functions decline with age, the extent to which multisensory integration processes change with age remains an open question. In the present study, we examined whether multisensory integration processes play a compensatory role in normal aging. Magnetoencephalography recordings of semantically-related cross-modal and unimodal auditory and visual stimuli captured the spatiotemporal dynamics of multisensory responses in young and older adults. Whereas sensory-specific regions showed increased activity in response to cross-modal compared to unimodal stimuli 100ms after stimulus onset in both age groups, posterior parietal and medial prefrontal regions responded preferentially to cross-modal stimuli between 150 and 300ms in the older group only. Additionally, faster detection of cross-moda...

show abstract

Semantic confusion regarding the development of multisensory integration: a practical solution

Cited by 113 publications

References 32 publications

Self-motion perception in autism is compromised by visual noise but integrated optimally across multiple senses

Self-motion perception in autism is compromised by visual noise but integrated optimally across multiple senses

Auditory Event-Related Response in Visual Cortex Modulates Subsequent Visual Responses in Humans

Visual dominance and multisensory integration changes with age

Contact Info

Product

Resources

About