3D object recognition: Representation and matching

Three-dimensional object recognition entails a number of fundamental problems in computer vision: representation of a 3D object, identification of the object from its image, estimation of its position and orientation, and registration of multiple views of the object for automatic model construction. This paper surveys three of those topics, namely representation, matching, and pose estimation. It also presents an overview of the free-form surface matching problem, and describes COSMOS, our framework for representing and recognizing free-form objects. The COSMOS system recognizes arbitrarily curved 3D rigid objects from a single view using dense surface data. We present both the theoretical aspects and the experimental results of a prototype recognition system based on COSMOS.

[1]  Ruzena Bajcsy,et al.  Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  David C. Hogg,et al.  Automated Pivot Location for the Cartesian-Polar Hybrid Point Distribution Model , 1995, BMVC.

[3]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  Wei-Chung Lin,et al.  A Neural Network Approach to CSG-Based 3-D Object Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[6]  David E. Breen,et al.  Interactive Occlusion and Automatic Object Placement for Augmented Reality , 1996, Comput. Graph. Forum.

[7]  Martial Hebert,et al.  Report on the 1996 International Workshop on Object Representation in Computer Vision , 1996, Object Representation in Computer Vision.

[8]  Yehezkel Lamdan,et al.  Affine invariant model-based object recognition , 1990, IEEE Trans. Robotics Autom..

[9]  L. Stark,et al.  Dissertation Abstract , 1994, Journal of Cognitive Education and Psychology.

[10]  Gérard G. Medioni,et al.  Structural Indexing: Efficient 3-D Object Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Harry G. Barrow,et al.  Subgraph Isomorphism, Matching Relational Structures and Maximal Cliques , 1976, Inf. Process. Lett..

[12]  Daniel Lee Swets.  The self-organizing hierarchical optimal subspace learning and inference framework for view-based object recognition and image retrieval , 1996 .

[13]  Kevin W. Bowyer,et al.  Computing the Perspective Projection Aspect Graph of Solids of Revolution , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Anil K. Jain,et al.  3D object recognition using invariant feature indexing of interpretation tables , 1992, CVGIP Image Underst..

[15]  Martial Hebert,et al.  Object representation in computer vision II : ECCV '96 International Workshop, Cambridge, U.K., April 13-14, 1996 : proceedings , 1996, ECCV 1996.

[16]  A.K. Jain,et al.  Obtaining generic parts from range images using a multi-view represen-tation , 1994 .

[17]  George C. Stockman,et al.  Object recognition and localization via pose clustering , 1987, Comput. Vis. Graph. Image Process..

[18]  Ping Liang,et al.  Orientation-Based Differential Geometric Representations for Computer Vision Applications , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  R. Bajcsy,et al.  Surface and volumetric segmentation of range images using biquadrics and superquadrics , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[20]  Ramakant Nevatia,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Jake K. Aggarwal,et al.  Model-based object recognition in dense-range images—a review , 1993, CSUR.

[22]  R. Bajcsy,et al.  Quantitative and qualitative measures for the evaluation of the superquadric models , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[23]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jin-Long Chen,et al.  Determining Pose of 3D Objects With Curved Surfaces , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Chitra Dorai,et al.  Shape Spectrum Based View Grouping and Matching of 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Anil K. Jain,et al.  Evidence-Based Recognition of 3-D Objects , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[28]  Anil K. Jain,et al.  BONSAI: 3D Object Recognition Using Constrained Search , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Daniel G. Bobrow,et al.  The Role of Intelligent Systems in the National Information Infrastructure , 1995, AI Mag..

[30]  David Casasent,et al.  Determination of Three-Dimensional Object Location and Orientation from Range Images , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Avinash C. Kak,et al.  A robot vision system for recognition of generic shaped objects , 1991, CVGIP Image Underst..

[33]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[34]  Dimitris N. Metaxas,et al.  Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Azriel Rosenfeld,et al.  3-D Shape Recovery Using Distributed Aspect Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[37]  Baba C. Vemuri,et al.  Representation and recognition of objects from dense range maps , 1987 .

[38]  Alex Pentland,et al.  Recovery of non-rigid motion and structure , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[40]  Richard A. Volz,et al.  Recognizing Partially Occluded Parts , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Paul J. Besl,et al.  The Free-Form Surface Matching Problem , 1990 .

[42]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[43]  Katsushi Ikeuchi,et al.  Determining linear shape change: Toward automatic generation of object recognition programs, , 1991, CVGIP Image Underst..

[44]  Robert B. Fisher,et al.  Class-based recognition of 3D objects represented by volumetric primitives , 1997, Image Vis. Comput..

[45]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[47]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[48]  Glenn Beheim,et al.  Fiber-optic projected-fringe digital interferometry , 1990 .

[49]  W. Brent Seales,et al.  Viewpoint from occluding contour , 1992, CVGIP Image Underst..

[50]  Katsushi Ikeuchi,et al.  The Complex EGI: A New Representation for 3-D Pose Determination , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Shinji Umeyama.  Parameterized Point Pattern Matching and Its Application to Recognition of Object Families , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Avinash C. Kak,et al.  A robot vision system for recognizing 3D objects in low-order polynomial time , 1989, IEEE Trans. Syst. Man Cybern..

[53]  Paul J. Besl,et al.  Surfaces in Range Image Understanding , 1988, Springer Series in Perception Engineering.

[54]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[55]  Roy Kalawsky,et al.  The science of virtual reality and virtual environments - a technical, scientific and engineering reference on virtual environments , 1993 .

[56]  Marc Rioux,et al.  Recognition and Shape Synthesis of 3-D Objects Based on Attributed Hypergraphs , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[58]  R. Bajcsy,et al.  Three dimensional object representation revisited , 1987 .

[59]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[60]  Michael Brady,et al.  Generating and Generalizing Models of Visual Objects , 1987, Artif. Intell..

[61]  W. Grimson,et al.  Model-Based Recognition and Localization from Sparse Range or Tactile Data , 1984 .

[62]  Ramesh Jain,et al.  Range image analysis , 1994 .

[63]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[64]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Alex Pentland,et al.  Perceptual Organization and the Representation of Natural Form , 1986, Artif. Intell..

[66]  David Harwood,et al.  An iterative hough procedure for three-dimensional object recognition , 1984, Pattern Recognit..

[67]  Anil K. Jain,et al.  Three-Dimensional Object Recognition Systems , 1993 .

[68]  David B. Cooper,et al.  Describing Complicated Objects by Implicit Polynomials , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Berthold K. P. Horn.  Extended Gaussian images , 1984, Proceedings of the IEEE.

[70]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[72]  Hiroshi Matsuo,et al.  3-D object recognition using MEGI model from range data , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[73]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[75]  Katsushi Ikeuchi,et al.  A spherical representation for the recognition of curved objects , 1993, 1993 (4th) International Conference on Computer Vision.

[76]  David J. Kriegman,et al.  On using CAD models to compute the pose of curved 3D objects , 1992, CVGIP Image Underst..

[77]  S. Ullman,et al.  The alignment of objects with smooth surfaces , 1993 .

[78]  C. Dorai.  Cosmos: a framework for representation and recognition of 3d free-form objects , 1996 .

[79]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.