Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex

Lakatos, Péter L.; Chen, Chi Ming; O’Connell, Monica N.; Mills, Aimee; Schroeder, Charles E.

doi:10.1016/j.neuron.2006.12.011

Cited by 885 publications

(1,026 citation statements)

References 56 publications

Supporting

Mentioning

892

Contrasting

Unclassified

Order By: Relevance

“…In particular, because of rapid somatosensory input into supragranular layers of A1 (at ϳ8 ms), corresponding auditory signals may arrive (ϳ9 ms) at an optimal excitable phase (hence producing an enhanced response, potentially analogous to our result for the AVC condition) but may arrive during an opposing non-excitable phase when somatosensory inputs do not correspond (hence producing a depressed response, potentially analogous to our result for the NC condition, although note that enhanced audiotactile CSDs have been observed at various SOAs because of the oscillatory nature of the underlying mechanism). Although some analogies can be drawn to our fMRI results, the sluggish temporal resolution of fMRI (compared with MUA and CSD) precludes any links between our study and that of Lakatos et al (2007) from being pushed too far. Electroencephalography (EEG) or magnetoencephalography (MEG) might be more suitable for studying the timing and oscillatory nature of the present effects, or our present paradigm could be applied to monkeys during invasive recordings (because the only task required is fixation monitoring).…”

Section: Comparison Of Our Two Multisensory Conditions With the Unisementioning

confidence: 71%

“…Our finding of enhanced BOLD signal in the AVC condition, but reduced in the NC, relative to unisensory baselines is reminiscent in some respects of an interesting recent audiotactile (rather than audiovisual) study by Lakatos et al (2007). Unlike the present whole-brain human fMRI method, they measured laminaspecific multiunit activity (MUA) invasively in macaque primary auditory cortex and calculated current-source density distributions (CSDs).…”

Section: Comparison Of Our Two Multisensory Conditions With the Unisementioning

confidence: 93%

“…Given recent results from invasive recording in monkey primary auditory cortex Ghazanfar et al, 2005;Lakatos et al, 2007), we anticipated that audiovisual correspondence in temporal patterning might affect sensory-specific "auditory" cortex. We tested this with human whole-brain fMRI, which also allowed assessment of any impact on sensory-specific "visual" cortex (and mSTS) concurrently.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

Noesselt

Rieger²,

Schoenfeld³

et al. 2007

J. Neurosci.

258

235

View full text Add to dashboard Cite

The brain should integrate related but not unrelated information from different senses. Temporal patterning of inputs to different modalities may provide critical information about whether those inputs are related or not. We studied effects of temporal correspondence between auditory and visual streams on human brain activity with functional magnetic resonance imaging (fMRI). Streams of visual flashes with irregularly jittered, arrhythmic timing could appear on right or left, with or without a stream of auditory tones that coincided perfectly when present (highly unlikely by chance), were noncoincident with vision (different erratic, arrhythmic pattern with same temporal statistics), or an auditory stream appeared alone. fMRI revealed blood oxygenation level-dependent (BOLD) increases in multisensory superior temporal sulcus (mSTS), contralateral to a visual stream when coincident with an auditory stream, and BOLD decreases for noncoincidence relative to unisensory baselines. Contralateral primary visual cortex and auditory cortex were also affected by audiovisual temporal correspondence or noncorrespondence, as confirmed in individuals. Connectivity analyses indicated enhanced influence from mSTS on primary sensory areas, rather than vice versa, during audiovisual correspondence. Temporal correspondence between auditory and visual streams affects a network of both multisensory (mSTS) and sensory-specific areas in humans, including even primary visual and auditory cortex, with stronger responses for corresponding and thus related audiovisual inputs.

show abstract

Section: Comparison Of Our Two Multisensory Conditions With the Unisementioning

confidence: 71%

Section: Comparison Of Our Two Multisensory Conditions With the Unisementioning

confidence: 93%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

Noesselt

Rieger²,

Schoenfeld³

et al. 2007

J. Neurosci.

258

235

View full text Add to dashboard Cite

show abstract

“…However, the early visually mediated enhancement of auditory cortex activity does not seem to be content specific (Arnal, Morillon, Kell, & Giraud, 2009;Van Wassenhove et al, 2005). It is possible that early detection of lip motion predicts the timing of auditory events and synchronizes the activity of auditory cortex neurons (Arnal & Giraud, 2012;Lakatos, Chen, O'Connell, Mills, & Schroeder, 2007;Schroeder, Lakatos, Kajikawa, Partan, & Puce, 2008). The timing units of the model, which here were initialized by hand so that the first sequence unit was in its active state at the beginning of the simulation, could provide an appropriate model for such an early resetting.…”

Section: Timing and Oscillationsmentioning

confidence: 99%

Prediction across sensory modalities: A neurocomputational model of the McGurk effect

Olasagasti

Bouton

Giraud

2015

Cortex

View full text Add to dashboard Cite

Audiovisual integrationComputational modeling McGurk effect a b s t r a c tThe McGurk effect is a textbook illustration of the automaticity with which the human brain integrates audio-visual speech. It shows that even incongruent audiovisual (AV) speech stimuli can be combined into percepts that correspond neither to the auditory nor to the visual input, but to a mix of both. Typically, when presented with, e.g., visual /aga/ and acoustic /aba/ we perceive an illusory /ada/. In the inverse situation, however, when acoustic /aga/ is paired with visual /aba/, we perceive a combination of both stimuli, i.e., /abga/ or /agba/. Here we assessed the role of dynamic cross-modal predictions in the outcome of AV speech integration using a computational model that processes continuous audiovisual speech sensory inputs in a predictive coding framework. The model involves three processing levels: sensory units, units that encode the dynamics of stimuli, and multimodal recognition/identity units. The model exhibits a dynamic prediction behavior because evidence about speech tokens can be asynchronous across sensory modality, allowing for updating the activity of the recognition units from one modality while sending topedown predictions to the other modality. We explored the model's response to congruent and incongruent AV stimuli and found that, in the two-dimensional feature space spanned by the speech second formant and lip aperture, fusion stimuli are located in the neighborhood of congruent /ada/, which therefore provides a valid match. Conversely, stimuli that lead to combination percepts do not have a unique valid neighbor. In that case, acoustic and visual cues are both highly salient and generate conflicting predictions in the other modality that cannot be fused, forcing the elaboration of a combinatorial solution.We propose that dynamic predictive mechanisms play a decisive role in the dichotomous perception of incongruent audiovisual inputs.

show abstract

“…A visual stimulus can reset the phase of an ongoing alpha rhythm 61 , and cortical connections can also modify the phase of ongoing oscillations 62,63 . Thus, the phase and amplitude of cortical oscillations can be modulated to alter the precision and timing of spike volleys.…”

Section: The Contribution Of Cortical Oscillations To Precisionmentioning

confidence: 99%

Regulation of spike timing in visual cortical circuits

2008

View full text Add to dashboard Cite

A train of action potentials (a spike train) can carry information in both the average firing rate and the pattern of spikes in the train. But can such a spike-pattern code be supported by cortical circuits? Neurons in vitro produce a spike pattern in response to the injection of a fluctuating current. However, cortical neurons in vivo are modulated by local oscillatory neuronal activity and by top-down inputs. In a cortical circuit, precise spike patterns thus reflect the interaction between internally generated activity and sensory information encoded by input spike trains. We review the evidence for precise and reliable spike timing in the cortex and discuss its computational role.Reliability and precision are two different quantities. When you make an appointment with your friend, she can either keep the appointment or not show up at all. If she does show up, she might or might not be on time. The former uncertainty is related to reliability, whereas the latter is related to precision. When the same stimulus waveform is repeatedly injected at the soma of a neuron in vitro (FIG. 1a), a similar spike train is obtained on each trial 1,2 (FIG. 1b). When approximately the same number of spikes occur on each trial the neuron is said to be reliable, whereas when the spikes occur almost at the same time across trials it is said to be precise (FIG. 1c). For a single neuron, the potential information content of precise and reliable spike times is many times larger than that which is contained in the firing rate, which is averaged across a typical interval of a hundred milliseconds [3][4][5][6] . The information contained in spike timing is available immediately, rather than after an averaging period. Furthermore, the timing of patterns of spikes can potentially transmit even more information than the timing of the individual constituent spikes 3,7 . The potential relevance of spike patterns becomes apparent when we consider neurons at the population level: when a group of similar neurons (a 'pool') produces precise and reliable spike trains, the neurons they project to receive volleys of synchronous spikes 8,9 . This opens up the possibility of communicating between different cortical areas through synchronous spike volleys.In contrast to the in vitro situation described above, in the intact cortex most excitatory synaptic inputs arrive at the dendrites rather than at the soma (FIG. 1d), and synaptic transmission is typically unreliable [10][11][12][13] . Furthermore, most of these dendritic inputs are not directly related to ongoing sensory stimulation; rather, they reflect spatiotemporally structured internal activity. Therefore, when the same stimulus is presented repeatedly, the resulting spike trains are usually neither precise nor reliable when they are aligned to the stimulus onset 6 . Instead, HHMI Author ManuscriptHHMI Author Manuscript HHMI Author Manuscript neural activity in vivo might be dominated by internally generated complex reverberations or rhythmic oscillations, and precise and reliable sp...

show abstract

Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex

Cited by 885 publications

References 56 publications

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

Prediction across sensory modalities: A neurocomputational model of the McGurk effect

Regulation of spike timing in visual cortical circuits

Contact Info

Product

Resources

About