Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection

An approach is described that integrates the processes of feature matching, contour detection, and surface interpolation to determine the three-dimensional distance, or depth, of objects from a stereo pair of images. Integration is necessary to ensure that the detected surfaces are smooth. Surface interpolation takes into account detected occluding and ridge contours in the scene; interpolation is performed within regions enclosed by these contours. Planar and quadratic patches are used as local models of the surface. Occluded regions in the image are identified, and are not used for matching and interpolation. A coarse-to-fine algorithm is presented that generates a multiresolution hierarchy of surface maps, one at each level of resolution. Experimental results are given for a variety of stereo images. >

[1]  Hans P. Moravec.  Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[2]  Liang-Hua Chen,et al.  Analysis of two new stereo algorithms , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  J P Frisby,et al.  The Computation of Binocular Edges , 1980, Perception.

[4]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[5]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  William Hoff.  Surfaces from stereo: an integrated approach , 1987 .

[7]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[8]  Michael Brady,et al.  Artificial Intelligence Approaches to Image Understanding , 1982 .

[9]  James D. Foley,et al.  Fundamentals of interactive computer graphics , 1982 .

[10]  Tomaso Poggio,et al.  A Theory of Human Stereo Vision , 1977 .

[11]  J. Pokorny.  Foundations of Cyclopean Perception , 1972 .

[12]  Hans P. Morevec.  Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[13]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  B Gillam,et al.  Evidence for disparity change as the primary stimulus for stereoscopic processing , 1984, Perception & psychophysics.

[15]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[16]  Narendra Ahuja,et al.  SURFACES FROM STEREO. , 1986 .

[17]  Kim L. Boyer,et al.  Structural Stereopsis for 3-D Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[19]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  James J. Clark,et al.  A theoretical basis for diffrequency stereo , 1986 .

[21]  Whitman Richards.  Stereopsis with and without monocular contours , 1977, Vision Research.

[22]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[24]  Steven W. Zucker,et al.  The Local Structure of Image Discontinuities in One Dimension , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[26]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  A. Waxman,et al.  Using disparity functional for stereo correspondence and surface reconstruction , 1987 .