Volumetric descriptions from a single intensity image

Since the early days of computer vision research, shape from contour has been one of the most challenging problems. Many researchers in the field have attempted to understand this problem and proposed different approaches to solve it. Shape from contour still remains one of the hardest problems in the field. The problem has two major difficulties. First, 2D properties of contours of viewed objects are generally not sufficient by themselves to uniquely determine 3D shape, as one dimension is lost in the projection. Second, real images produce imperfect contours that make their interpretation particularly difficult. The first problem has received some attention in the research community but in the context of perfect contours. The second one, however, has received very little.In this work, we propose a promising methodology to address this last problem for a large class of objects: generalized cylinders. It is based on exploiting mathematical invariant properties of the contours of generalized cylinders in a perceptual grouping approach. We show that using these properties greatly helps addressing the figure-ground problem in a more rigorous way than previous (intuitive) perceptual grouping methods. Our approach exploits the interplay between local and global features by handling different levels of the feature hierarchy. We have developed and implemented a method that handles SHGCs in complex seenes with markings and occlusion.We demonstrate the application of our method of shape description and scene segmentation on complex real images. We also demonstrate the usage of the obtained descriptions for recovery of complete 3-D object centered descriptions of viewed objects from a single intensity image.

[1]  H. Piaggio Differential Geometry of Curves and Surfaces , 1952, Nature.

[2]  M. B. Clowes,et al.  On Seeing Things , 1971, Artif. Intell..

[3]  A. Macworth Interpreting pictures of polyhedral scenes , 1973 .

[4]  Alan K. Mackworth Interpreting Pictures of Polyhedral Scenes , 1973, IJCAI.

[5]  D. Marr,et al.  Analysis of occluding contour , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[7]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[8]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[9]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[10]  T. Kanade,et al.  The Theory of Straight Homogeneous Generalized Cylinders , 1983 .

[11]  S. Shafer Shadow geometry and occluding contours of generalized cylinders (artificial intelligence) , 1983 .

[12]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[13]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  R. Brooks Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jean Ponce,et al.  Finding the limbs and cusps of generalized cylinders , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[17]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[18]  V. S. Nalwa Line drawing interpretation: bilateral symmetry , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[19]  Gérard G. Medioni,et al.  Useful geometric properties of the generalized cone , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[21]  Ramakant Nevatia,et al.  Descriptions of complex objects from incomplete and imperfect data , 1989 .

[22]  Radu Horaud,et al.  On the geometric interpretation of image contours , 1989 .

[23]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Jean Ponce,et al.  Invariant Properties of Straight Homogeneous Generalized Cylinders and Their Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Richard S. Weiss,et al.  Perceptual Grouping Of Curved Lines , 1989, Other Conferences.

[26]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[27]  F. Ulupinar,et al.  Inferring shape from contour for curved surfaces , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[28]  Terrance E. Boult,et al.  Recovery of generalized cylinders from a single intensity image , 1990 .

[29]  Ramakant Nevatia,et al.  Recovering shape from contour for constant cross section generalized cylinders , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Michel Dhome,et al.  Inverse Perspective Transform Using Zero-Curvature Contour Points: Application to the Localization of Some Generalized Cylinders from a Single View , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[32]  Ramakant Nevatia,et al.  Recovery of 3-D objects with multiple curved surfaces from 2-D contours , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  R. Nevatia,et al.  Quasi-invariant properties and 3-D shape recovery of non-straight, non-constant generalized cylinders , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Ramakant Nevatia,et al.  Using Invariance and Quasi-Invariance for the Segmentation and Recovery of Curved Objects , 1993, Applications of Invariance in Computer Vision.

[35]  James L. McClelland,et al.  B-Spline Contour Representation and Symmetry Detection , 1993 .

[36]  A. U.S.,et al.  Recovering Surface Shape and Orientation from Texture , 2002 .

[37]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[38]  K. Price,et al.  USC IMAGE UNDERSTANDING RESEARCH : 1994-1995 , .