Abstract:This study aimed to characterize the neural generators of the early components of the visual evoked potential (VEP) to isoluminant checkerboard stimuli. Multichannel scalp recordings, retinotopic mapping and dipole modeling techniques were used to estimate the locations of the cortical sources giving rise to the early C1, P1, and N1 components. Dipole locations were matched to anatomical brain regions visualized in structural magnetic resonance imaging (MRI) and to functional MRI (fMRI) activations elicited by the same stimuli. These converging methods confirmed previous reports that the C1 component (onset latency 55 msec; peak latency 90 -92 msec) was generated in the primary visual area (striate cortex; area 17). The early phase of the P1 component (onset latency 72-80 msec; peak latency 98 -110 msec) was localized to sources in dorsal extrastriate cortex of the middle occipital gyrus, while the late phase of the P1 component (onset latency 110 -120 msec; peak latency 136 -146 msec) was localized to ventral extrastriate cortex of the fusiform gyrus. Among the N1 subcomponents, the posterior N150 could be accounted for by the same dipolar source as the early P1, while the anterior N155 was localized to a deep source in the parietal lobe. These findings clarify the anatomical origin of these VEP components, which have been studied extensively in relation to visual-perceptual processes. Hum. Brain Mapping 15: 95-111, 2001.

We investigated the cortical mechanisms of visual-spatial attention while subjects discriminated patterned targets within distractor arrays. Functional magnetic resonance imaging (fMRI) was used to map the boundaries of retinotopic visual areas and to localize attention-related changes in neural activity within several of those areas, including primary visual (striate) cortex. Event-related potentials (ERPs) and modeling of their neural sources, however, indicated that the initial sensory input to striate cortex at 50-55 milliseconds after the stimulus was not modulated by attention. The earliest facilitation of attended signals was observed in extrastriate visual areas, at 70-75 milliseconds. We hypothesize that the striate cortex modulation found with fMRI may represent a delayed, re-entrant feedback from higher visual areas or a sustained biasing of striate cortical neurons during attention. ERP recordings provide critical temporal information for analyzing the functional neuroanatomy of visual attention.

The internal organization of a higher level visual area in the human parietal cortex was mapped. Functional magnetic resonance images were acquired while the polar angle of a peripheral target for a delayed saccade was gradually changed. A region in the superior parietal cortex showed robust retinotopic mapping of the remembered target angle. The map reversed when the direction of rotation of the remembered targets was reversed and persisted unchanged when study participants detected rare target reappearances while maintaining fixation, or when the eccentricity of successive remembered targets was unpredictable. This region may correspond to the lateral intraparietal area in macaque monkeys.

Recordings of event-related potentials (ERPs) were combined with structural and functional magnetic resonance imaging (fMRI) to study the spatio-temporal patterns of cortical activity that underlie visual-spatial attention. Small checkerboard stimuli were flashed in random order to the four quadrants of the visual field at a rapid rate while subjects attended to stimuli in one quadrant at a time. Attended stimuli elicited enhanced ERP components in the latency range 80-200 ms that were co-localized with fMRI activations in multiple extrastriate cortical regions. The earliest ERP component (C1 at 50-90 ms) was unaffected by attention and was localized by dipole modeling to calcarine cortex. A longer latency deflection in the 150-225 ms range that was accounted for by this same calcarine source, however, did show consistent modulation with attention. This late attention effect, like the C1, inverted in polarity for upper versus lower field stimuli, consistent with a neural generator in primary visual cortex (area V1). These results provide support to current hypotheses that spatial attention in humans is associated with delayed feedback to area V1 from higher extrastriate areas that may have the function of improving the salience of stimuli at attended locations.

Electrophysiological studies have revealed a pre-attentive change-detection system in the auditory modality. This system emits a signal termed the mismatch negativity (MMN) when any detectable change in a regular pattern of auditory stimulation occurs. The precise intracranial sources underlying MMN generation, and in particular whether these vary as a function of the acoustic feature that changes, is a matter of some debate. Using functional magnetic resonance imaging, we show that anatomically distinct networks of auditory cortices are activated as a function of the deviating acoustic feature--in this case, tone frequency and tone duration--strongly supporting the hypothesis that MMN generators in auditory cortex are feature dependent. We also detail regions of the frontal and parietal cortices activated by change-detection processes. These regions also show feature dependence and we hypothesize that they reflect recruitment of attention-switching mechanisms.

Patients with schizophrenia show both failure to activate and failure to deactivate during performance of a working memory task. The area of failure of deactivation is in the anterior prefrontal/anterior cingulate cortex and corresponds to one of the two midline components of the 'default mode network' implicated in functions related to maintaining one's sense of self.

When a single flash of light is presented interposed between two brief auditory stimuli separated by 60 -100 ms, subjects typically report perceiving two flashes (Shams et al., 2000, 2002). We investigated the timing and localization of the cortical processes that underlie this illusory flash effect in 34 subjects by means of 64-channel recordings of event-related potentials (ERPs). A difference ERP calculated to isolate neural activity associated with the illusory second flash revealed an early modulation of visual cortex activity at 30 -60 ms after the second sound, which was larger in amplitude in subjects who saw the illusory flash more frequently. These subjects also showed this early modulation in response to other combinations of auditory and visual stimuli, thus pointing to consistent individual differences in the neural connectivity that underlies cross-modal integration. The overall pattern of cortical activity associated with the cross-modally induced illusory flash, however, differed markedly from that evoked by a real second flash. A trial-by-trial analysis showed that shortlatency ERP activity localized to auditory cortex and polymodal cortex of the temporal lobe, concurrent with gamma bursts in visual cortex, were associated with perception of the double-flash illusion. These results provide evidence that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.

Using high-field (3 Tesla) functional magnetic resonance imaging (fMRI), we demonstrate that auditory and somatosensory inputs converge in a subregion of human auditory cortex along the superior temporal gyrus. Further, simultaneous stimulation in both sensory modalities resulted in activity exceeding that predicted by summing the responses to the unisensory inputs, thereby showing multisensory integration in this convergence region. Recently, intracranial recordings in macaque monkeys have shown similar auditory-somatosensory convergence in a subregion of auditory cortex directly caudomedial to primary auditory cortex (area CM). The multisensory region identified in the present investigation may be the human homologue of CM. Our finding of auditory-somatosensory convergence in early auditory cortices contributes to mounting evidence for multisensory integration early in the cortical processing hierarchy, in brain regions that were previously assumed to be unisensory.