Class-based grouping in perspective images

In any object recognition system a major and primary task is to associate those image features, within an image of a complex scene, that arise from an individual object. The key idea here is that a geometric class defined in 3D induces relationships in the image which must hold between points on the image outline (the perspective projection of the object). The resulting image constraints enable both identification and grouping of image features belonging to objects of that class. The classes include surfaces of revolution, canal surfaces (pipes) and polyhedra. Recognition proceeds by first recognising an object as belonging to one of the classes (for example a surface of revolution) and subsequently identifying the object (for example as a particular vase). This differs from conventional object recognition systems where recognition is generally targetted at particular objects. These classes also support the computation of 3D invariant descriptions including symmetry axes, canonical coordinate frames and projective signatures. The constraints and grouping methods are viewpoint invariant, and proceed with no information on object pose. We demonstrate the effectiveness of this class-based grouping on real, cluttered scenes using grouping algorithms developed for rotationally symmetric surfaces, canal-surfaces and polyhedra.<<ETX>>

[1]  C. E. Springer,et al.  Geometry and Analysis of Projective Spaces , 1967 .

[2]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[3]  Peter Giblin,et al.  Local Symmetry of Plane Curves , 1985 .

[4]  Vishvjit S. Nalwa Line-Drawing Interpretation: Bilateral Symmetry , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jean Ponce,et al.  Invariant Properties of Straight Homogeneous Generalized Cylinders and Their Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Michel Dhome,et al.  Spatial Localization Of Modelled Objects Of Revolution In Monocular Perspective Vision , 1990, ECCV.

[7]  Jean Ponce,et al.  On characterizing ribbons and finding skewed symmetries , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[8]  Terrance E. Boult,et al.  Recovery of generalized cylinders from a single intensity image , 1990 .

[9]  David A. Forsyth,et al.  Recognising rotationally symmetric surfaces from their outlines , 1992, ECCV.

[10]  David A. Forsyth,et al.  Efficient recognition of rotationally symmetric surfaces and straight homogeneous generalized cylinders , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  David A. Forsyth,et al.  Extracting projective structure from single perspective views of 3D point sets , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  Ramakant Nevatia,et al.  Using Invariance and Quasi-Invariance for the Segmentation and Recovery of Curved Objects , 1993, Applications of Invariance in Computer Vision.

[13]  Luc Van Gool,et al.  Matching Perspective Views of Parallel Plane Structures , 1993, Applications of Invariance in Computer Vision.

[14]  Andrew Zisserman,et al.  Viewpoint-invariant representation of generalized cylinders using the symmetry set , 1994, Image Vis. Comput..

[15]  Andrew Zisserman,et al.  Viewpoint-invariant representation of generalized cylinders using the symmetry set , 1995, Image Vis. Comput..

[16]  Andrew Zisserman,et al.  Shape from symmetry: detecting and exploiting symmetry in affine images , 1995, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[17]  David A. Forsyth,et al.  3D Object Recognition Using Invariance , 1995, Artif. Intell..

[18]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .