Detectability of sine- versus square-wave disparity gratings: A challenge for current models of depth perception

Allenmark, Fredrik; Read, Jenny C. A.

doi:10.1167/10.8.17

Cited by 16 publications

(40 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Interestingly, 2 of our 4 human observers also displayed this tendency (Figure 10 of [10]), while neither humans nor model ever displayed an earlier drop for square-waves than for sine-waves.…”

Section: Resultsmentioning

confidence: 71%

“…We therefore tested human observers on dense random-dot stereograms depicting square-wave gratings. We found that the model's prediction was not borne out: humans never showed significantly better ability to detect square-wave than sine-wave gratings [10]. Figure 2 shows example human and model data near the upper frequency limit, illustrating the marked qualitative difference between the model and the human observers.…”

Section: Introductionmentioning

confidence: 93%

See 1 more Smart Citation

Spatial Stereoresolution for Depth Corrugations May Be Set in Primary Visual Cortex

Allenmark

Read

2011

PLoS Comput Biol

View full text Add to dashboard Cite

Stereo “3D” depth perception requires the visual system to extract binocular disparities between the two eyes' images. Several current models of this process, based on the known physiology of primary visual cortex (V1), do this by computing a piecewise-frontoparallel local cross-correlation between the left and right eye's images. The size of the “window” within which detectors examine the local cross-correlation corresponds to the receptive field size of V1 neurons. This basic model has successfully captured many aspects of human depth perception. In particular, it accounts for the low human stereoresolution for sinusoidal depth corrugations, suggesting that the limit on stereoresolution may be set in primary visual cortex. An important feature of the model, reflecting a key property of V1 neurons, is that the initial disparity encoding is performed by detectors tuned to locally uniform patches of disparity. Such detectors respond better to square-wave depth corrugations, since these are locally flat, than to sinusoidal corrugations which are slanted almost everywhere. Consequently, for any given window size, current models predict better performance for square-wave disparity corrugations than for sine-wave corrugations at high amplitudes. We have recently shown that this prediction is not borne out: humans perform no better with square-wave than with sine-wave corrugations, even at high amplitudes. The failure of this prediction raised the question of whether stereoresolution may actually be set at later stages of cortical processing, perhaps involving neurons tuned to disparity slant or curvature. Here we extend the local cross-correlation model to include existing physiological and psychophysical evidence indicating that larger disparities are detected by neurons with larger receptive fields (a size/disparity correlation). We show that this simple modification succeeds in reconciling the model with human results, confirming that stereoresolution for disparity gratings may indeed be limited by the size of receptive fields in primary visual cortex.

show abstract

Section: Resultsmentioning

confidence: 71%

Section: Introductionmentioning

confidence: 93%

Spatial Stereoresolution for Depth Corrugations May Be Set in Primary Visual Cortex

Allenmark

Read

2011

PLoS Comput Biol

View full text Add to dashboard Cite

show abstract

“…More recently, however, similarity-based matching has been implicit in models that measure disparity using cross-correlation (Banks et al, 2004; Filippini and Banks, 2009; Allenmark and Read, 2010, 2011) or cross-correlation-like (Fleet et al, 1996; Qian and Zhu, 1997; Chen and Qian, 2004) procedures. Such models encode similarity by cross-correlating spatially extended image patches.…”

Section: Introductionmentioning

confidence: 99%

Mechanisms for similarity matching in disparity measurement

Goutcher

Hibbard

2014

Front. Psychol.

View full text Add to dashboard Cite

Early neural mechanisms for the measurement of binocular disparity appear to operate in a manner consistent with cross-correlation-like processes. Consequently, cross-correlation, or cross-correlation-like procedures have been used in a range of models of disparity measurement. Using such procedures as the basis for disparity measurement creates a preference for correspondence solutions that maximize the similarity between local left and right eye image regions. Here, we examine how observers’ perception of depth in an ambiguous stereogram is affected by manipulations of luminance and orientation-based image similarity. Results show a strong effect of coarse-scale luminance similarity manipulations, but a relatively weak effect of finer-scale manipulations of orientation similarity. This is in contrast to the measurements of depth obtained from a standard cross-correlation model. This model shows strong effects of orientation similarity manipulations and weaker effects of luminance similarity. In order to account for these discrepancies, the standard cross-correlation approach may be modified to include an initial spatial frequency filtering stage. The performance of this adjusted model most closely matches human psychophysical data when spatial frequency filtering favors coarser scales. This is consistent with the operation of disparity measurement processes where spatial frequency and disparity tuning are correlated, or where disparity measurement operates in a coarse-to-fine manner.

show abstract

“…Our formulation of the relationship between disparity threshold and image contrasts in the two eyes is based on the cross-correlation model, which has received support from many psychophysical experiments (Allenmark & Read, 2010Banks, Gepshtein, & Landy, 2004;Cormack et al, 1991;Filippini & Banks, 2009;Harris, McKee, & Smallman, 1997;Nienborg, Bridge, Parker, & Cumming, 2004), and has found many successful applications in computer vision (Clerc & Mallat, 2002;Donate, Liu, & Collins, 2011;Heo, Lee, & Lee, 2011;Kanade & Okutomi, 1994). The product rule in the cross-correlation model is consistent with the prevailing disparity energy models of V1 neurons (Anzai et al, 1999a(Anzai et al, , 1999bChen & Qian, 2004;Filippini & Banks, 2009;Ohzawa, 1998;Ohzawa, DeAngelis, & Freeman, 1990Qian, 1994Qian, , 1997 when the outputs of binocular complex cells with opposite preferred polarities of disparity are compared to extract the polarity of the perceived disparity.…”

Section: Elaboration Of the MCM To Model Stereo Depth Perceptionmentioning

confidence: 99%

Contrast gain-control in stereo depth and cyclopean contrast perception

Hou¹,

Huang²,

Liang³

et al. 2013

Journal of Vision

View full text Add to dashboard Cite

Although human observers can perceive depth from stereograms with considerable contrast difference between the images presented to the two eyes (Legge & Gu, 1989), how contrast gain control functions in stereo depth perception has not been systematically investigated. Recently, we developed a multipathway contrast gain-control model (MCM) for binocular phase and contrast perception (Huang, Zhou, Lu, & Zhou, 2011; Huang, Zhou, Zhou, & Lu, 2010) based on a contrast gain-control model of binocular phase combination (Ding & Sperling, 2006). To extend the MCM to simultaneously account for stereo depth and cyclopean contrast perception, we manipulated the contrasts (ranging from 0.08 to 0.4) of the dynamic random dot stereograms (RDS) presented to the left and right eyes independently and measured both disparity thresholds for depth perception and perceived contrasts of the cyclopean images. We found that both disparity threshold and perceived contrast depended strongly on the signal contrasts in the two eyes, exhibiting characteristic binocular contrast gain-control properties. The results were well accounted for by an extended MCM model, in which each eye exerts gain control on the other eye's signal in proportion to its own signal contrast energy and also gain control over the other eye's gain control; stereo strength is proportional to the product of the signal strengths in the two eyes after contrast gain control, and perceived contrast is computed by combining contrast energy from the two eyes. The new model provided an excellent account of our data (r(2) = 0.945), as well as some challenging results in the literature.

show abstract

Detectability of sine- versus square-wave disparity gratings: A challenge for current models of depth perception

Cited by 16 publications

References 42 publications

Spatial Stereoresolution for Depth Corrugations May Be Set in Primary Visual Cortex

Spatial Stereoresolution for Depth Corrugations May Be Set in Primary Visual Cortex

Mechanisms for similarity matching in disparity measurement

Contrast gain-control in stereo depth and cyclopean contrast perception

Contact Info

Product

Resources

About