Even within the early sensory areas, the majority of the input to any given cortical neuron comes from other cortical neurons. To extend our knowledge of the contextual information that is transmitted by such lateral and feedback connections, we investigated how visually nonstimulated regions in primary visual cortex (V1) and visual area V2 are influenced by the surrounding context. We used functional magnetic resonance imaging (fMRI) and pattern-classification methods to show that the cortical representation of a nonstimulated quarter-field carries information that can discriminate the surrounding visual context. We show further that the activity patterns in these regions are significantly related to those observed with feed-forward stimulation and that these effects are driven primarily by V1. These results thus demonstrate that visual context strongly influences early visual areas even in the absence of differential feed-forward thalamic stimulation.linear classifier | natural visual scenes | cortical feedback | lateral interaction I t is well known that the majority of input that arrives to a specific neuron in the early visual system comes from other cortical neurons (either local or long-range connections). Such connections provide one way for prior knowledge and context to modulate the responses of neurons in early vision. However, studies that investigate the role of such mechanisms within natural vision are relatively rare. In the present experiments we devised a paradigm in which we analyzed the influence of surrounding context on visually nonstimulated parts of primary visual cortex (V1) and visual area V2. We set out to investigate whether blood oxygen level-dependent (BOLD) functional MRI (fMRI) activity in nonstimulated early visual regions carries information about a surrounding visual context. Our goal was to test the hypothesis that lateral and feedback connections modulate and possibly prime regions of visual cortex by transmitting relevant contextual information.If this hypothesis is true, we would expect such mechanisms to work most productively when participants are presented with natural visual stimuli, because these stimuli contain a multitude of rich contextual associations across space and time (1). Therefore we presented participants with natural visual scenes in all the experiments reported here. Support for the above hypothesis is provided by recent demonstrations illustrating that V1 receives feedback even in regions that extend beyond the bottom-up stimulated area. For instance, the size of the activated region in retinotopic cortex corresponds to perceived size, not absolute size, in the context of a size illusion (2); moreover, the subjectively perceived apparent-motion illusion activates nonstimulated V1 on the motion trace (3), and object classification triggers discriminable activity at nonstimulated foveal representations (4). Other work has shown that feature-based attention spreads to nonstimulated regions of V2-V4 (5). Therefore contextual influences can extend beyond the r...