A Similarity-Based Aspect-Graph Approach to 3D Object Recognition

This paper describes a view-based method for recognizing 3D objects from 2D images. We employ an aspect-graph structure, where the aspects are not based on the singularities of visual mapping but are instead formed using a notion of shape similarity between views. Specifically, the viewing sphere is endowed with a metric of dis-similarity for each pair of views and the problem of aspect generation is viewed as a “segmentation” of the viewing sphere into homogeneous regions. The viewing sphere is sampled at regular (5 degree) intervals and the similarity metric is used in an iterative procedure to combine views into aspects with a prototype representing each aspect. This is done in a “region-growing” regime which stands in contrast to the usual “edge detection” styles to computing the aspect graph. The aspect growth is constrained such that two aspects of an object remain distinct under the given similarity metric. Once the database of 3D objects is organized as a set of aspects, and prototypes for these aspects for each object, unknown views of database objects are compared with the prototypes and the results are ordered by similarity. We use two similarity metrics for shape, one based on curve matching and the other based on matching shock graphs, which for a database of 64 objects and unknown views of objects from the database give a recall rate of (90.3%, 74.2%, 59.7%) and (95.2%, 69.0%, 57.5%), respectively, for the top three matches; cumulative recall rate based on the top three matches is 98% and 100%, respectively. The result of indexing unknown views of objects not in the database also produce intuitive matches. We also develop a hierarchical indexing scheme to prune unlikely objects at an early stage to improve the efficiency of indexing, resulting in savings of 35% at the top level and of 55% at the next level, cumulatively.

[1]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[2]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[3]  Benjamin B. Kimia,et al.  3D Object Recognition Using Shape Similarity-Based Aspect Graph , 2001, ICCV.

[4]  Raimund Seidel,et al.  Efficiently Computing and Representing Aspect Graphs of Polyhedral Objects , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Kevin W. Bowyer,et al.  Aspect graphs: An introduction and survey of recent results , 1990, Int. J. Imaging Syst. Technol..

[6]  Azriel Rosenfeld,et al.  3-D Shape Recovery Using Distributed Aspect Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Benjamin B. Kimia,et al.  Curves vs skeletons in object recognition , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[8]  Daphna Weinshall,et al.  Dual Computation of Projective Shape and Camera Positions from Multiple Images , 1998, International Journal of Computer Vision.

[9]  Philip N. Klein,et al.  Shock-Based Indexing into Large Shape Databases , 2002, ECCV.

[10]  David J. Kriegman,et al.  Computing exact aspect graphs of curved objects: Solids of revolution , 2004, International Journal of Computer Vision.

[11]  Gunter Bellaire Feature-Based Computation of Hierarchical Aspect-Graphs , 1993 .

[12]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[13]  Barr,et al.  Superquadrics and Angle-Preserving Transformations , 1981, IEEE Computer Graphics and Applications.

[14]  Michael Werman,et al.  On View Likelihood and Stability , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Benjamin B. Kimia,et al.  The Shock Scaffold for Representing 3D Shape , 2001, IWVF.

[16]  B. Kimia,et al.  3D object recognition using shape similiarity-based aspect graph , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  David G. Lowe,et al.  Learning object recognition models from images , 1993, 1993 (4th) International Conference on Computer Vision.

[18]  A. Yuille,et al.  Two- and Three-Dimensional Patterns of the Face , 2001 .

[19]  Anil K. Jain,et al.  BONSAI: 3D Object Recognition Using Constrained Search , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Kevin W. Bowyer,et al.  Creating The Perspective Projection Aspect Graph Of Polyhedral Objects , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[21]  G. Medioni,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, [1988 Proceedings] Second International Conference on Computer Vision.

[22]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Dmitry B. Goldgof,et al.  The Scale Space Aspect Graph , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Gabriella Sanniti di Baja,et al.  Proceedings of the 4th International Workshop on Visual Form , 2001 .

[26]  Philip N. Klein,et al.  Recognition of Shapes by Editing Shock Graphs , 2001, ICCV.

[27]  R. Bajcsy,et al.  Three dimensional object representation revisited , 1987 .

[28]  Philip N. Klein,et al.  Shape matching using edit-distance: an implementation , 2001, SODA '01.

[29]  R. Jain,et al.  Generating aspect graphs for curved objects , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[30]  W. Brent Seales,et al.  Viewpoint from occluding contour , 1992, CVGIP Image Underst..

[31]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[32]  David B. Cooper,et al.  Describing Complicated Objects by Implicit Polynomials , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Shimon Ullman,et al.  Recognizing solid objects by alignment with an image , 1990, International Journal of Computer Vision.

[34]  Ronen Basri,et al.  The Alignment Of Objects With Smooth Surfaces , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[35]  J. Koenderink,et al.  The singularities of the visual mapping , 1976, Biological Cybernetics.

[36]  Ali Shokoufandeh,et al.  View-based object recognition using saliency maps , 1999, Image Vis. Comput..

[37]  David J. Kriegman,et al.  Computing exact aspect graphs of curved objects: Algebraic surfaces , 1990, International Journal of Computer Vision.

[38]  Jake K. Aggarwal,et al.  Model Construction and Shape Recognition from Occluding Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Takeo Kanade,et al.  Automatic generation of object recognition programs , 1988, Proc. IEEE.

[40]  John K. Tsotsos,et al.  Active object recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Philip N. Klein,et al.  Alignment-Based Recognition of Shape Outlines , 2001, IWVF.

[42]  Philip N. Klein,et al.  Constructing 2D curve atlases , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[43]  Michael J Tarr,et al.  What defines a view? , 2001, Vision Research.

[44]  Isaac Weiss,et al.  Model-Based Recognition of 3D Objects from Single Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Marc Rioux,et al.  Recognition and Shape Synthesis of 3-D Objects Based on Attributed Hypergraphs , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  James V. Stone,et al.  Object recognition: view-specificity and motion-specificity , 1999, Vision Research.

[47]  Ramakant Nevatia,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Hiroshi Murase,et al.  Real-time 100 object recognition system , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[50]  J. Koenderink,et al.  The internal representation of solid shape with respect to vision , 1979, Biological Cybernetics.

[51]  Kevin W. Bowyer,et al.  Computing the Perspective Projection Aspect Graph of Solids of Revolution , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  J. Brian Burns,et al.  Recognition in 2D Images of 3D Objects from Large Model Bases Using Prediction Hierarchies , 1987, IJCAI.

[53]  Daphna Weinshall Model-based invariants for 3-D vision , 2005, International Journal of Computer Vision.

[54]  Philip N. Klein,et al.  On Aligning Curves , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Jean Ponce,et al.  Finite-Resolution Aspect Graphs of Polyhedral Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..