3-D Shape Recovery Using Distributed Aspect Matching

An approach to the recovery of 3-D volumetric primitives from a single 2-D image is presented. The approach first takes a set of 3-D volumetric modeling primitives and generates a hierarchical aspect representation based on the projected surfaces of the primitives; conditional probabilities capture the ambiguity of mappings between levels of the hierarchy. From a region segmentation of the input image, the authors present a formulation of the recovery problem based on the grouping of the regions into aspects. No domain-independent heuristics are used; only the probabilities inherent in the aspect hierarchy are exploited. Once the aspects are recovered, the aspect hierarchy is used to infer a set of volumetric primitives and their connectivity. As a front end to an object recognition system, the approach provides the indexing power of complex 3-D object-centered primitives while exploiting the convenience of 2-D viewer-centered aspect matching; aspects are used to represent a finite vocabulary of 3-D parts from which objects can be constructed. >

[1]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[2]  Urs Ramer,et al.  An iterative procedure for the polygonal approximation of plane curves , 1972, Comput. Graph. Image Process..

[3]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[4]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[5]  David G. Kirkpatrick,et al.  On the completeness of a generalized matching problem , 1978, STOC.

[6]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[7]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Herbert Freeman,et al.  Characteristic Views As A Basis For Three-Dimensional Object Recognition , 1982, Other Conferences.

[9]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[10]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[11]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Prasanna G. Mulgaonkar,et al.  Matching 'sticks, plates and blobs' objects using geometric and relational constraints , 1984, Image and Vision Computing.

[13]  Irving Biederman,et al.  Human image understanding: Recent research and a theory , 1985, Comput. Vis. Graph. Image Process..

[14]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[15]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[16]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[17]  Robert C. Bolles,et al.  Perceptual Organization and Curve Partitioning , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Alex Pentland,et al.  Perceptual Organization and the Representation of Natural Form , 1986, Artif. Intell..

[19]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  A. Pentland.  Recognition by Parts , 1987 .

[21]  Alex P. Pentland,et al.  Toward An Ideal 3-D Cad System , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[22]  R. Bajcsy,et al.  Shape recovery and segmentation with deformable part models , 1987 .

[23]  Azriel Rosenfeld,et al.  Recognizing Unexpected Objects: a Proposed Approach , 1987, Int. J. Pattern Recognit. Artif. Intell..

[24]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[25]  Raimund Seidel,et al.  Efficiently Computing And Representing Aspect Graphs Of Polyhedral Objects , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[26]  Yehezkel Lamdan,et al.  On recognition of 3-D objects from 2-D images , 2011, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[27]  Jitendra Malik,et al.  Computing the aspect graph for line drawings of polyhedral objects , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[28]  Kevin W. Bowyer,et al.  Aspect Graphs And Nonlinear Optimization In 3-D Object Recognition , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[29]  Kevin W. Bowyer,et al.  Creating The Perspective Projection Aspect Graph Of Polyhedral Objects , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[30]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Takeo Kanade,et al.  Automatic generation of object recognition programs , 1988, Proc. IEEE.

[32]  Alex Pentland,et al.  Part Segmentation for Object Recognition , 1989, Neural Computation.

[33]  Robert Bergevin,et al.  Generic object recognition: building coarse 3D descriptions from line drawings , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[34]  Ramakant Nevatia,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  R. Jain,et al.  Generating aspect graphs for curved objects , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[36]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[37]  Ramakant Nevatia,et al.  Perceptual organization for segmentation and description , 1989 .

[38]  D. Eggert,et al.  Computing the orthographic projection aspect graph of solids of revolution , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[39]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Francine Berman,et al.  Generalized Planar Matching , 1990, J. Algorithms.

[41]  Kevin W. Bowyer,et al.  Direct construction of the perspective projection aspect graph of convex polyhedra , 1990, Comput. Vis. Graph. Image Process..

[42]  Sven J. Dickinson,et al.  A Representation for Qualitative 3-D Object Recognition Integrating Object-Centered and Viewer-Centered Models , 1990 .

[43]  Alex Pentland,et al.  Closed-Form Solutions for Physically Based Shape Modeling and Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Sven J. Dickinson,et al.  From volumes to views: an approach to 3-D object recognition , 1991, [1991 Proceedings] Workshop on Directions in Automated CAD-Based Vision.

[45]  Dimitris N. Metaxas,et al.  Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..