Planarity and Segmentation in Stereoscopic Matching

The matching of stereograms which contain periodic patterns suggests ways in which the stereo correspondence problem may be solved in human vision. The stereograms seem to be segmented by coarse-scale features. Within each segment a set of matches approximating a plane is chosen. In regions with periodic patterns there may be many such planar sets, and the disparity of coarse-scale features seems to guide the choice of a particular set. This emphasis on planarity may reflect the occurrence of correlation-like operations in cortical neurons. An attractive possibility is that segmentation effectively delimits areas of the visual field within which disparities are likely to be slow changing (eg local tangent planes to surfaces) so that the correlation sums evaluated in a segment can give the best estimate of depth. A mechanism of this kind cannot account for all of stereo matching, since not all visual objects are well described by ensembles of planes. But it is likely to be a component of the matching system which is particularly important where images are ‘noisy’ and averaging is needed to extract reliable disparities.

[1]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  G. J. Mitchison,et al.  The resolution of ambiguous stereoscopic matches by interpolation , 1987, Vision Research.

[3]  G. Westheimer,et al.  The perception of depth in simple figures , 1984, Vision Research.

[4]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[5]  S. McKee,et al.  The role of retinal correspondence in stereoscopic matching , 1988, Vision Research.

[6]  G. J. Mitchison,et al.  Interpolation in stereoscopic matching , 1985, Nature.

[7]  V S Ramachandran,et al.  Capture of stereopsis and apparent motion by illusory contours , 1986, Perception & psychophysics.

[8]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[9]  B. Julesz,et al.  A disparity gradient limit for binocular fusion. , 1980, Science.

[10]  G. J. Mitchison,et al.  Interpolation and the detection of fine structure in stereoscopic matching , 1987, Vision Research.

[11]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[12]  S Grossberg,et al.  Cortical dynamics of three-dimensional form, color, and brightness perception: II. Binocular theory , 1988, Perception & psychophysics.

[13]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[14]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[15]  B. C. Motter,et al.  Responses of neurons in visual cortex (V1 and V2) of the alert macaque to dynamic random-dot stereograms , 1985, Vision Research.

[16]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[17]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[18]  P. Cavanagh,et al.  Subjective contours capture stereopsis , 1985, Nature.

[19]  T. Poggio,et al.  Retinal ganglion cells: a functional interpretation of dendritic morphology. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[21]  D. Hubel,et al.  Stereoscopic Vision in Macaque Monkey: Cells sensitive to Binocular Depth in Area 18 of the Macaque Monkey Cortex , 1970, Nature.

[22]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[23]  T. Poggio,et al.  A generalized ordering constraint for stereo correspondence , 1984 .

[24]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[25]  R. Gregory,et al.  Cognitive Contours , 1972, Nature.