On Interpreting Stereo Disparity

The problems under consideration center around the interpretation of binocular stereo disparity. In particular, the goal is to establish a set of mappings from stereo disparity to corresponding three-dimensional scene geometry. An analysis has been developed that shows how disparity information can be interpreted in terms of three-dimensional scene properties, such as surface depth, discontinuities, and orientation. These theoretical developments have been embodied in a set of computer algorithms for the recovery of scene geometry from input stereo disparity. The results of applying these algorithms to several disparity maps are presented. Comparisons are made to the interpretation of stereo disparity by biological systems.

[1]  Induced size effect. I : A new phenomenon in binocular vision associated with the relative sizes of the images in the two eyes , 1938 .

[2]  S. S. Wilks,et al.  Linear Regression Analysis of Economic Time Series. , 1938 .

[3]  K. N. Ogle.  Researches in binocular vision. , 1950 .

[4]  F. Massey,et al.  The Distribution of the Maximum Deviation Between two Sample Cumulative Step Functions , 1951 .

[5]  C. Truesdell,et al.  The Classical Field Theories , 1960 .

[6]  Cleve Moler,et al.  Mathematical Handbook for Scientists and Engineers , 1961 .

[7]  R. Aris.  Vectors, Tensors and the Basic Equations of Fluid Mechanics , 1962 .

[8]  L. Kaufman.  SOME NEW STEREOSCOPIC PHENOMENA AND THEIR IMPLICATIONS FOR THE THEORY OF STEREOPSIS. , 1965, The American journal of psychology.

[9]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[10]  B. Gillam,et al.  Perception of slant when perspective and stereopsis conflict: experiments with aniseikonic lenses. , 1968, Journal of experimental psychology.

[11]  A. Oppenheim,et al.  Nonlinear filtering of multiplied and convolved signals , 1968 .

[12]  George A. Kaplan,et al.  Kinetic disruption of optical texture: The perception of depth at an edge , 1969 .

[13]  D. Hubel,et al.  Stereoscopic Vision in Macaque Monkey: Cells sensitive to Binocular Depth in Area 18 of the Macaque Monkey Cortex , 1970, Nature.

[14]  W. Richards,et al.  Anomalous stereoscopic depth perception. , 1971, Journal of the Optical Society of America.

[15]  B. Julesz.  Foundations of Cyclopean Perception , 1971 .

[16]  C. Blakemore,et al.  A second neural mechanism of binocular depth discrimination , 1972, The Journal of physiology.

[17]  J. M. Foley,et al.  Effects of voluntary eye movement and convergence on the binocular appreciation of depth , 1972 .

[18]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[19]  M. Spivak.  A comprehensive introduction to differential geometry , 1979 .

[20]  F. Rigaudière.  Fusion binoculaire et localisation spatiale de mires verticales et horizontales de frequences spatiales differentes , 1975, Vision Research.

[21]  Jan J. Koenderink,et al.  Local structure of movement parallax of the plane , 1976 .

[22]  Robert B. Lawson,et al.  Human stereopsis : a psychophysical analysis , 1976 .

[23]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[24]  Tomaso Poggio,et al.  A Theory of Human Stereo Vision , 1977 .

[25]  Whitman Richards.  Stereopsis with and without monocular contours , 1977, Vision Research.

[26]  P. O. Bishop,et al.  Discrimination of orientation and position disparities by binocularly activated neurons in cat straite cortex. , 1977, Journal of neurophysiology.

[27]  Ian P. Howard,et al.  A Craik-O'Brien-Cornsweet illusion for visual depth , 1978, Vision Research.

[28]  Orientation and Position Disparities in Stereopsis , 1978 .

[29]  Joachim Rüdiger von der Heydt,et al.  Stereoskopische Wahrnehmung der Orientierungsdisparation , 1979 .

[30]  Hans P. Moravec.  Visual Mapping by a Robot Rover , 1979, IJCAI.

[31]  W F Clocksin,et al.  Perception of Surface Slant and Edge Labels from Optical Flow: A Computational Approach , 1980, Perception.

[32]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[33]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[34]  J. M. Foley.  Binocular distance perception. , 1980, Psychological review.

[35]  W. Grimson.  The Implicit Constraints of the Primal Sketch. , 1981 .

[36]  W. Eric L. Grimson,et al.  From images to surfaces , 1981 .

[37]  J. Anthony Movshon,et al.  A simple explanation of the induced size effect , 1981, Vision Research.

[38]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[39]  Nirmala Prakash.  Differential geometry : an integrated approach / Nirmala Prakash , 1981 .

[40]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[41]  D. Ferster.  A comparison of binocular depth mechanisms in areas 17 and 18 of the cat visual cortex , 1981, The Journal of physiology.

[42]  Eugene S. McVey,et al.  Some Accuracy and Resolution Aspects of Computer Vision Distance Measurements , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Valdis Berzins,et al.  Edge Detection in Optical Flow Fields , 1982, AAAI.

[44]  John E. W. Mayhew,et al.  The induced effect: Arguments against the theory of Arditi, Kaufman and Movshon (1981) , 1982, Vision Research.

[45]  J Mayhew,et al.  The Interpretation of Stereo-Disparity Information: The Computation of Surface Orientation and Depth , 1982, Perception.

[46]  H. C. Longuet-Higgins.  The Role of the Vertical Dimension in Stereoscopic Vision , 1982, Perception.

[47]  J. E. W. Mayhew,et al.  A computational model of binocular depth perception , 1982, Nature.

[48]  G. van den Brink,et al.  Detection of vertical disparities , 1982, Vision Research.

[49]  Aries Arditi,et al.  The dependence of the induced effect on orientation and a hypothesis concerning disparity computations in general , 1982, Vision Research.

[50]  W E Grimson,et al.  A computational theory of visual surface interpolation. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[51]  B. Rogers,et al.  Anisotropies in the perception of three-dimensional surfaces. , 1983, Science.

[52]  J. Canny.  Finding Edges and Lines in Images , 1983 .

[53]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[54]  B. Gillam,et al.  The induced effect, vertical disparity, and stereoscopic theory , 1983, Perception & psychophysics.

[55]  J. Marroquín.  Surface Reconstruction Preserving Discontinuities , 1984 .

[56]  B Gillam,et al.  Evidence for disparity change as the primary stimulus for stereoscopic processing , 1984, Perception & psychophysics.

[57]  H. K. Nishihara,et al.  Practical Real-Time Imaging Stereo Matcher , 1984 .

[58]  G. Westheimer,et al.  The perception of depth in simple figures , 1984, Vision Research.

[59]  J. E. W. Mayhew,et al.  Vertical disparity pooling and the induced effect , 1984, Nature.

[60]  Andrew Blake,et al.  Reconstructing a Visible Surface , 1984, AAAI.

[61]  T. Poggio,et al.  Vertical image registration in stereopsis , 1984, Vision Research.

[62]  J. Ninio.  Orientational versus Horizontal Disparity in the Stereoscopic Appreciation of Slant , 1985, Perception.

[63]  T. Boult.  Reproducing Kernels for Visual Surface Interpolation. , 1985 .

[64]  Valdis Berzins,et al.  Dynamic Occlusion Analysis in Optical Flow Fields , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Kenichi Kanatani.  Structure from Motion Without Correspondence: General Principle , 1985, IJCAI.

[66]  William B. Thompson,et al.  Analysis of Accretion and Deletion at Boundaries in Dynamic Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  W. Eric L. Grimson,et al.  Discontinuity detection for visual surface reconstruction , 1985, Comput. Vis. Graph. Image Process..

[68]  G. J. Mitchison,et al.  Interpolation in stereoscopic matching , 1985, Nature.

[69]  Alessandro Verri,et al.  Absolute depth estimate in stereopsis , 1986 .

[70]  J. Harris.  The Coupled Depth/Slope Approach to Surface Reconstruction , 1986 .

[71]  I. Ohzawa,et al.  The binocular organization of simple cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[72]  Demetri Terzopoulos.  Regularization ofInverseVisualProblemsInvolving Discontinuities , 1986 .

[73]  G. J. Mitchison,et al.  Interpolation and the detection of fine structure in stereoscopic matching , 1987, Vision Research.

[74]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[75]  Anselm Spoerri,et al.  The early detection of motion boundaries , 1990, ICCV 1987.

[76]  John K. Tsotsos,et al.  The Sensitivity of Motion and Structure Computations , 1987, AAAI.

[77]  Narendra Ahuja,et al.  EXTRACTING SURFACES FROM STEREO IMAGES: AN INTEGRATED APPROACH. , 1987 .

[78]  Steven D. Blostein,et al.  Error Analysis in Stereo Determination of 3-D Point Positions , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  A. Waxman,et al.  Using disparity functional for stereo correspondence and surface reconstruction , 1987 .

[80]  G. J. Mitchison,et al.  The resolution of ambiguous stereoscopic matches by interpolation , 1987, Vision Research.

[81]  B Gillam,et al.  Postfusional latency in stereoscopic slant perception and the primitives of stereopsis. , 1988, Journal of experimental psychology. Human perception and performance.

[82]  Steven D. Blostein,et al.  Correction to "Error Analysis in Stereo Determination of 3-D Point Positions" , 1988, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Robert M. Haralick,et al.  The Use of the Facet Model and the Topographic Primal Sketch in Image Analysis , 1988 .

[84]  David Lee,et al.  One-Dimensional Regularization with Discontinuities , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Jan J. Koenderink,et al.  Two-dimensional curvature operators , 1988 .

[86]  G Mitchison,et al.  Planarity and Segmentation in Stereoscopic Matching , 1988, Perception.

[87]  B Gillam,et al.  The role of vertical disparity in the scaling of stereoscopic depth perception: An empirical and theoretical study , 1988, Perception & psychophysics.

[88]  Ramakant Nevatia,et al.  Stereo Error Detection, Correction, and Evaluation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..