Recovering LSHGCs and SHGCs from stereo

We examine the problem of computing shape descriptions from stereo, where by shape descriptions we mean 3-D volumetric descriptions of objects rather than a 2 /12-D depth map of the scene. We argue that intermediate 2 /12-D depth measurements may not be always directly available from stereo, especially when there are curved surfaces in the scene, and that 3-D volumetric descriptions of objects may have to be derived directly from stereo correspondences. We then present methods to recover volumetric shape from stereo using LSHGCs and SHGCs as the shape models. Our methods are based on some invariant properties of LSHGCs and SHGCs in their monocular and stereo projections. Experimental results on both synthetic and real images of objects with curved surfaces are given. Our technique allows dense surface descriptions to be recovered even for objects without much texture, and it is not restricted to narrow stereo angles or low resolution images. Our technique can also handle objects in close range where perspective distortion in the images can be significant.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[3]  Ramakant Nevatia,et al.  Recovering LSHGCs and SHGCs from stereo , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Kent A. Stevens,et al.  The Visual Interpretation of Surface Contours , 1981, Artif. Intell..

[5]  A. Macworth Interpreting pictures of polyhedral scenes , 1973 .

[6]  R. Nevatia,et al.  Use of monocular groupings and occlusion analysis in a hierarchical stereo system , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  F. Ulupinar,et al.  Inferring shape from contour for curved surfaces , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[8]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jean Ponce,et al.  Invariant Properties of Straight Homogeneous Generalized Cylinders and Their Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[13]  Radu Horaud,et al.  On the geometric interpretation of image contours , 1989 .

[14]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[16]  Alan K. Mackworth Interpreting Pictures of Polyhedral Scenes , 1973, IJCAI.

[17]  Michel Dhome,et al.  Inverse Perspective Transform Using Zero-Curvature Contour Points: Application to the Localization of Some Generalized Cylinders from a Single View , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Hiromi T. Tanaka,et al.  Right straight homogeneous generalized cylinders with symmetrical cross-sections: recovery of pose and shape from image contours , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[20]  M. B. Clowes,et al.  On Seeing Things , 1971, Artif. Intell..

[21]  Ramakant Nevatia,et al.  Computing volume descriptions from sparse 3-D data , 1988, International Journal of Computer Vision.

[22]  T. Kanade,et al.  The Theory of Straight Homogeneous Generalized Cylinders , 1983 .