Planar object recognition using projective shape representation

We describe a model based recognition system, called LEWIS, for the identification of planar objects based on a projectively invariant representation of shape. The advantages of this shape description include simple model acquisition (direct from images), no need for camera calibration or object pose computation, and the use of index functions. We describe the feature construction and recognition algorithms in detail and provide an analysis of the combinatorial advantages of using index functions. Index functions are used to select models from a model base and are constructed from projective invariants based on algebraic curves and a canonical projective coordinate frame. Examples are given of object recognition from images of real scenes, with extensive object libraries. Successful recognition is demonstrated despite partial occlusion by unmodelled objects, and realistic lighting conditions.

[1]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[2]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  F. Bookstein.  Fitting conic sections to scattered data , 1979 .

[4]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[5]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[6]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[7]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Olivier D. Faugeras,et al.  HYPER: A New Approach for the Recognition and Positioning of Two-Dimensional Objects , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Edith Schonberg,et al.  Two-Dimensional, Model-Based, Boundary Matching Using Footprints , 1986 .

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  D. W. Thompson,et al.  Three-dimensional model matching from an unconstrained viewpoint , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[13]  George C. Stockman,et al.  Object recognition and localization via pose clustering , 1987, Comput. Vis. Graph. Image Process..

[14]  Chris Goad,et al.  Special purpose automatic programming for 3D model-based vision , 1987 .

[15]  David W. Murray,et al.  Model-based recognition using 3D structure from motion , 1987, Image Vis. Comput..

[16]  Olivier D. Faugeras,et al.  Building a Consistent 3D Representation of a Mobile Robot Environment by Combining Multiple Stereo Views , 1987, IJCAI.

[17]  Micha Sharir,et al.  Identification of Partially Obscured Objects in Two and Three Dimensions by Matching Noisy Characteristic Curves , 1987 .

[18]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Gil J. Ettinger,et al.  Large hierarchical object recognition using libraries of parameterized model sub-parts , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[22]  Isaac Weiss,et al.  Projective invariants of shapes , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Lars Nielsen,et al.  Automated guidance of vehicles using vision and projective invariant marking , 1988, Autom..

[24]  D. Huttenlocher.  Three-Dimensional Recognition of Solid Objects from a Two- Dimensional Image , 1988 .

[25]  Tony P. Pridmore,et al.  Geometrical Modeling from Multiple Stereo Views , 1989, Int. J. Robotics Res..

[26]  Robert B. Fisher.  From Surfaces to Objects: Computer Vision and Three Dimensional Scene Analysis , 1989 .

[27]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[28]  Luc Van Gool,et al.  Recognition and semi-differential invariants , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Rakesh Mohan,et al.  Multidimensional indexing for recognizing visual shapes , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[32]  David W. Jacobs,et al.  Model group indexing for recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  David W. Jacobs,et al.  Space and Time Bounds on Indexing 3D Models from 2D Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  I. Rigoutsos,et al.  Implementation of geometric hashing on the Connection Machine , 1991, [1991 Proceedings] Workshop on Directions in Automated CAD-Based Vision.

[35]  Daniel P. Huttenlocher,et al.  Fast affine point matching: an output-sensitive method , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Peter C. Wayner,et al.  Efficiently using invariant theory for model-based matching , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Todd A. Cass,et al.  Polynomial-Time Object Recognition in the Presence of Clutter, Occlusion, and Uncertainty , 1992, ECCV.

[38]  Paul A. Beardsley,et al.  Affine and Projective Structure from Motion , 1992, BMVC.

[39]  P. Beardsley,et al.  Affine and Projective Structure from Motion , 1992 .

[40]  Andrew Blake,et al.  Planar Region Detection and Motion Recovery , 1992, BMVC.

[41]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[42]  D. Jacobs.  Space Efficient 3D Model Indexing , 1992 .

[43]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Gérard G. Medioni,et al.  Structural Indexing: Efficient 3-D Object Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Patrick Gros,et al.  Invariants of a pair of conics revisited , 1992, Image Vis. Comput..

[46]  Ingemar J. Cox,et al.  A Bayesian Multiple Hypothesis Approach to Contour Grouping , 1992, ECCV.

[47]  G. Taubin,et al.  Object recognition based on moment (or algebraic) invariants , 1992 .

[48]  S. Carlsson.  Projectively invariant decomposition of planar shapes , 1992 .

[49]  David A. Forsyth,et al.  Efficient recognition of rotationally symmetric surfaces and straight homogeneous generalized cylinders , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[50]  D. Forsyth,et al.  Extracting Projective Information from Single Views of 3D Point Sets , 1993 .

[51]  Charlie Rothwell,et al.  Hierarchical Object Description Using Invariants , 1993, Applications of Invariance in Computer Vision.

[52]  Andrew Blake,et al.  Planar region detection and motion recovery , 1993, Image Vis. Comput..

[53]  Nicholas Ayache,et al.  New developments on geometric hashing for curve matching , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Stephen J. Maybank,et al.  Classification Based on the Cross Ratio , 1993, Applications of Invariance in Computer Vision.

[55]  Shree K. Nayar,et al.  Reflectance ratio: A photometric invariant for object recognition , 1993, 1993 (4th) International Conference on Computer Vision.

[56]  Emanuele Trucco,et al.  Geometric Invariance in Computer Vision , 1995 .

[57]  Charlie Rothwell.  Object Recognition through Invariant Indexing , 1995 .

[58]  Refractor.  Vision , 2000, The Lancet.

[59]  David A. Forsyth,et al.  Recognizing algebraic surfaces from their outlines , 1993, Vision.

[60]  David G. Lowe,et al.  The viewpoint consistency constraint , 2015, International Journal of Computer Vision.

[61]  Stephen J. Maybank,et al.  Probabilistic analysis of the application of the cross ratio to model based vision , 1995, International Journal of Computer Vision.