Using noninvasive functional magnetic resonance imaging (fMRI) technique, we analyzed the responses in human area MT with regard to visual motion, color, and luminance contrast sensitivity, and retinotopy. As in previous PET studies, we found that area MT responded selectively to moving (compared to stationary) stimuli. The location of human MT in the present fMRI results is consistent with that of MT in earlier PET and anatomical studies. In addition we found that area MT has a much higher contrast sensitivity than that in several other areas, including primary visual cortex (V1). Functional MRI half-amplitudes in V1 and MT occurred at approximately 15% and 1% luminance contrast, respectively. High sensitivity to contrast and motion in MT have been closely associated with magnocellular stream specialization in nonhuman primates. Human psychophysics indicates that visual motion appears to diminish when moving color-varying stimuli are equated in luminance. Electrophysiological results from macaque MT suggest that the human percept could be due to decreases in firing of area MT cells at equiluminance. We show here that fMRI activity in human MT does in fact decrease at and near individually measured equiluminance. Tests with visuotopically restricted stimuli in each hemifield produced spatial variations in fMRI activity consistent with retinotopy in human homologs of macaque areas V1, V2, V3, and VP. Such activity in area MT appeared much less retinotopic, as in macaque. However, it was possible to measure the interhemispheric spread of fMRI activity in human MT (half amplitude activation across the vertical meridian = approximately 15 degrees).

The small visual area known as MT or V5 has played a major role in our understanding of the primate cerebral cortex. This area has been historically important in the concept of cortical processing streams and the idea that different visual areas constitute highly specialized representations of visual information. MT has also proven to be a fertile culture dish--full of direction- and disparity-selective neurons--exploited by many labs to study the neural circuits underlying computations of motion and depth and to examine the relationship between neural activity and perception. Here we attempt a synthetic overview of the rich literature on MT with the goal of answering the question, What does MT do?

A critical step in the interpretation of the visual world is the integration of the various local motion signals generated by moving objects. This process is complicated by the fact that local velocity measurements can differ depending on contour orientation and spatial position. Specifically, any local motion detector can measure only the component of motion perpendicular to a contour that extends beyond its field of view. This "aperture problem" is particularly relevant to direction-selective neurons early in the visual pathways, where small receptive fields permit only a limited view of a moving object. Here we show that neurons in the middle temporal visual area (known as MT or V5) of the macaque brain reveal a dynamic solution to the aperture problem. MT neurons initially respond primarily to the component of motion perpendicular to a contour's orientation, but over a period of approximately 60 ms the responses gradually shift to encode the true stimulus direction, regardless of orientation. We also report a behavioural correlate of these neural responses: the initial velocity of pursuit eye movements deviates in a direction perpendicular to local contour orientation, suggesting that the earliest neural responses influence the oculomotor response.

The early stages of primate visual processing appear to be divided up into several component parts so that, for example, colour, form and motion are analysed by anatomically distinct streams. We have found that further subspecialization occurs within the motion processing stream. Neurons representing two different kinds of information about visual motion are segregated in columnar fashion within the middle temporal area of the owl monkey. These columns can be distinguished by labelling with 2-deoxyglucose in response to large-field random-dot patterns. Neurons in lightly labelled interbands have receptive fields with antagonistic surrounds: the response to a centrally placed moving stimulus is suppressed by motion in the surround. Neurons in more densely labelled bands have surrounds that reinforce the centre response so that they integrate motion cues over large areas of the visual field. Interband cells carry information about local motion contrast that may be used to detect motion boundaries or to indicate retinal slip during visual tracking. Band cells encode information about global motion that might be useful for orienting the animal in its environment.