A physiologically-based explanation of disparity attraction and repulsion

Westheimer and Levi [(1987) Vision Research, 27, 1361-1368] found that when a few isolated features are viewed foveally, the perceived depth of a feature depends not only on its own disparity but also on those of its neighbors. The nature of this interaction is a function of the lateral separation between the features: When the distance is small the features appear to attract each other in depth but the interaction becomes repulsive at larger distances. Here we introduce a two-dimensional extension of our recent stereo model based on the physiological studies of Ohzawa, DeAngelis and Freeman [(1990) Science, 249, 1037-1041] and demonstrate through analyses and simulations that these observations can be naturally explained without introducing ad hoc assumptions about the connectivity between disparity-tuned units. In particular, our model can explain the distance-dependent attraction/repulsion phenomena in both the vertical-line configuration used by Westheimer [(1986) Journal for Neurophysiology, 370, 619-629], and the horizontal-line-and-point configuration used by Westheimer and Levi. Thus, the psychophysically observed disparity interaction may be viewed as a direct consequence of the known physiological organization of the binocular receptive fields. We also find that the transition distance at which the disparity interaction between features changes from attraction to repulsion is largely determined by the preferred spatial frequency and orientation distributions of the cells used in the disparity computation. This result may explain the observed variations of the transition distance among different subjects in the psychophysical experiments. Finally, our model can also reproduce the observed effect on the perceived disparity when the disparity magnitude of the neighboring features is changed.

[1]  P. O. Bishop,et al.  Binocular simple cells for local stereopsis: Comparison of receptive field organizations for the two eyes , 1984, Vision Research.

[2]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[3]  Pulfrich-like Phenomena,et al.  A Physiological Model for Motion-Stereo Integration and a Unified Explanation of , 1997 .

[4]  Terrence J. Sejnowski,et al.  Learning to Solve Random-Dot Stereograms of Dense and Transparent Surfaces with Recurrent Backpropagation , 1989 .

[5]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[6]  R. Sekuler,et al.  Mutual repulsion between moving visual targets. , 1979, Science.

[7]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[8]  Ning Qian,et al.  Binocular Receptive Field Models, Disparity Tuning, and Characteristic Disparity , 1996, Neural Computation.

[9]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[10]  Lawrence K. Cormack,et al.  Depth attraction and repulsion in random dot stereograms , 1991, Vision Research.

[11]  N. Qian Binocular Disparity and the Perception of Depth , 1997, Neuron.

[12]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[13]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[14]  P. Lennie,et al.  Spatial frequency analysis in the visual system. , 1985, Annual review of neuroscience.

[15]  D. Ringach,et al.  Predictions of a Recurrent Model of Orientation , 1997 .

[16]  S M Würger,et al.  Depth Interpolation with Sparse Disparity Cues , 1989, Perception.

[17]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[18]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[19]  I. Ohzawa,et al.  Encoding of binocular disparity by simple cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[20]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[21]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[22]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[23]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[24]  G. Westheimer,et al.  Depth attraction and repulsion of disparate foveal stimuli , 1987, Vision Research.

[25]  S. Lehky,et al.  Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity [published erratum appears in J Neurosci 1991 Mar;11(3):following Table of Contents] , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  H. Bouma,et al.  Induced changes in the perceived orientation of line segments. , 1970, Vision research.

[27]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[28]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[29]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[30]  Jonathan A. Marshall,et al.  Neural model of visual stereomatching : slant , transparency and clouds , 1996 .

[31]  P. O. Bishop,et al.  Binocular interaction fields of single units in the cat striate cortex , 1971, The Journal of physiology.

[32]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information I. Simple cells. , 1999, Journal of neurophysiology.

[33]  C. Blakemore,et al.  Lateral Inhibition between Orientation Detectors in the Human Visual System , 1970, Nature.

[34]  Vision Research , 1961, Nature.

[35]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[36]  G. Westheimer Spatial interaction in the domain of disparity signals in human stereoscopic vision. , 1986, The Journal of physiology.

[37]  E. Land The retinex theory of color vision. , 1977, Scientific American.