The integration of motion and disparity cues to depth in dorsal visual cortex

Ban, Hiroshi; Preston, Tim; Meeson, Alan; Welchman, Andrew E.

doi:10.1038/nn.3046

Cited by 100 publications

(184 citation statements)

References 49 publications

Supporting

Mentioning

146

Contrasting

Order By: Relevance

“…Despite this, in the same study (Ogawa & Macaluso, 2013), fMRI revealed enhanced activation in region V3 as well as increased connectivity to auditory cortex for audiocongruent, stereo-looming motion, consistent with depth cues being used in audio-visual motion integration. This is consistent with recent neuroimaging data providing evidence for the integration of binocular disparity and relative motion cues in the dorsal visual area V3B (Ban, Preston, Meeson, & Welchman, 2012).…”

Section: Introductionsupporting

confidence: 93%

The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio–visual motion in depth

et al. 2015

View full text Add to dashboard Cite

Motion is represented by low-level signals, such as size-expansion in vision or loudness changes in the auditory modality. The visual and auditory signals from the same object or event may be integrated and facilitate detection. We explored behavioural and electrophysiological correlates of congruent and incongruent audio-visual depth motion in conditions where auditory level changes, visual expansion, and visual disparity cues were manipulated. In Experiment 1 participants discriminated auditory motion direction whilst viewing looming or receding, 2D or 3D, visual stimuli. Responses were faster and more accurate for congruent than for incongruent audio-visual cues, and the congruency effect (i.e., difference between incongruent and congruent conditions) was larger for visual 3D cues compared to 2D cues. In Experiment 2, event-related potentials (ERPs) were collected during presentation of the 2D and 3D, looming and receding, audio-visual stimuli, while participants Page 2 of 44 detected an infrequent deviant sound. Our main finding was that audio-visual congruity was affected by retinal disparity at an early processing stage (135 -160 ms) over occipito-parietal scalp. Topographic analyses suggested that similar brain networks were activated for the 2D and 3D congruity effects, but that cortical responses were stronger in the 3D condition.Differences between congruent and incongruent conditions were observed between 140 -200 ms, 220 -280 ms, and 350 -500 ms after stimulus onset.

show abstract

Section: Introductionsupporting

confidence: 93%

The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio–visual motion in depth

et al. 2015

View full text Add to dashboard Cite

show abstract

“…Multiple signals, including texture (available monocularly) and binocular disparity, are used to determine 3D orientation (5,6). Single-unit (7)(8)(9)(10) and functional MRI (fMRI) (11)(12)(13) studies indicate that different orientation cues are combined in high-level cortical areas.…”

mentioning

confidence: 99%

Reliability-dependent contributions of visual orientation cues in parietal cortex

Rosenberg

Angelaki

2014

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Creating accurate 3D representations of the world from 2D retinal images is a fundamental task for the visual system. However, the reliability of different 3D visual signals depends inherently on viewing geometry, such as how much an object is slanted in depth. Human perceptual studies have correspondingly shown that texture and binocular disparity cues for object orientation are combined according to their slant-dependent reliabilities. Where and how this cue combination occurs in the brain is currently unknown. Here, we search for neural correlates of this property in the macaque caudal intraparietal area (CIP) by measuring slant tuning curves using mixed-cue (texture + disparity) and cue-isolated (texture or disparity) planar stimuli. We find that texture cues contribute more to the mixed-cue responses of CIP neurons that prefer larger slants, consistent with theoretical and psychophysical results showing that the reliability of texture relative to disparity cues increases with slant angle. By analyzing responses to binocularly viewed texture stimuli with conflicting texture and disparity information, some cells that are sensitive to both cues when presented in isolation are found to disregard one of the cues during cue conflict. Additionally, the similarity between texture and mixed-cue responses is found to be greater when this cue conflict is eliminated by presenting the texture stimuli monocularly. The present findings demonstrate reliability-dependent contributions of visual orientation cues at the level of the CIP, thus revealing a neural correlate of this property of human visual perception.vision | 3D orientation | perspective | reliability | cue combination T ransforming 2D retinal images into accurate 3D representations of the world is a fundamental, albeit complex, problem the brain must solve. The computation of 3D object orientation is essential to this process and necessary for a wide range of behaviors, including object recognition (1), reaching (2), and grasping (3, 4). Multiple signals, including texture (available monocularly) and binocular disparity, are used to determine 3D orientation (5, 6). Single-unit (7-10) and functional MRI (fMRI) (11-13) studies indicate that different orientation cues are combined in high-level cortical areas. Object orientation is often described using angular variables called slant (rotation about an axis perpendicular to the line of sight) and tilt (rotation about an axis parallel to the line of sight) (14, 15) (Fig. S1). As a consequence of perspective geometry, which determines how a scene projects onto each retina (16), the reliability of texture cues for 3D orientation increases with slant (i.e., as depth variation increases) (17) (Fig. 1A). In contrast, the reliability of disparity cues is largely independent of slant (18). Thus, if robust orientation estimates are created by combining texture and disparity cues according to their reliabilities, the relative contributions of the cues will depend on the object's slant. Human perceptual studies corresponding...

show abstract

“…A number of psychophysical studies in humans [63 -65] and monkeys [32] have provided evidence that depth perception involves integration of disparity and motion parallax cues, but until recently very little was known about neural integration of these cues. In humans, Ban et al [66] used fMRI pattern analysis techniques to identify brain regions that appear to integrate disparity and motion parallax cues to depth. In animals, a few studies have examined how neurons signal three-dimensional surface orientation based on combinations of motion and disparity gradients [67] or perspective gradients and disparity gradients [68,69].…”

Section: Integration Of Binocular Disparity and Motion Parallax Cues mentioning

confidence: 99%

The neural basis of depth perception from motion parallax

Kim

Angelaki

DeAngelis

2016

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

One contribution of 15 to a theme issue 'Vision in our three-dimensional world'. In addition to depth cues afforded by binocular vision, the brain processes relative motion signals to perceive depth. When an observer translates relative to their visual environment, the relative motion of objects at different distances (motion parallax) provides a powerful cue to three-dimensional scene structure. Although perception of depth based on motion parallax has been studied extensively in humans, relatively little is known regarding the neural basis of this visual capability. We review recent advances in elucidating the neural mechanisms for representing depth-sign (near versus far) from motion parallax. We examine a potential neural substrate in the middle temporal visual area for depth perception based on motion parallax, and we explore the nature of the signals that provide critical inputs for disambiguating depth-sign.This article is part of the themed issue 'Vision in our three-dimensional world'.

show abstract

The integration of motion and disparity cues to depth in dorsal visual cortex

Cited by 100 publications

References 49 publications

The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio–visual motion in depth

The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio–visual motion in depth

Reliability-dependent contributions of visual orientation cues in parietal cortex

The neural basis of depth perception from motion parallax

Contact Info

Product

Resources

About