Three-dimensional object recognition

A general-purpose computer vision system must be capable of recognizing three-dimensional (3-D) objects. This paper proposes a precise definition of the 3-D object recognition problem, discusses basic concepts associated with this problem, and reviews the relevant literature. Because range images (or depth maps) are often used as sensor input instead of intensity images, techniques for obtaining, processing, and characterizing range data are also surveyed.

[1]  R. Anderson,et al.  Tables of orthogonal polynomial values extended to N=104 , 1942 .

[2]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[3]  B. O'neill.  Elementary Differential Geometry , 1966 .

[4]  B. O'neill.  CHAPTER VII – Riemannian Geometry , 1966 .

[5]  Adolfo Guzmán-Arenas,et al.  COMPUTER RECOGNITION OF THREE-DIMENSIONAL OBJECTS IN A VISUAL SCENE , 1968 .

[6]  David L. Waltz,et al.  Generating Semantic Descriptions From Drawings of Scenes With Shadows , 1972 .

[7]  Robert F. Sproull,et al.  Principles in interactive computer graphics , 1973 .

[8]  Ramakant Nevatia,et al.  Structured Descriptions of Complex Objects , 1973, IJCAI.

[9]  Mark A. Lavin.  An Application of Line-labeling and other Scene-analysis Techniques to the Problem of Hidden-line Removal , 1974 .

[10]  Robert A. Schumacker,et al.  A Characterization of Ten Hidden-Surface Algorithms , 1974, CSUR.

[11]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[12]  Clarence L. Coates,et al.  Visual Learning from Multiple Views , 1975, IEEE Transactions on Computers.

[13]  Ann Patricia Fothergill,et al.  Forming Models Of Plane-And-Cylinder Faceled Bodies From Light Stripes , 1975, IJCAI.

[14]  James William Mckee.  Computer recognition of partial views of three-dimensional curved objects. , 1975 .

[15]  Gilles Lafue,et al.  Recognition of three-dimensional objects from orthographic views , 1976, SIGGRAPH.

[16]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[17]  Yoram Yakimovsky,et al.  A system for extracting three-dimensional measurements from a stereo pair of TV cameras , 1976 .

[18]  Azriel Rosenfeld,et al.  Digital Picture Processing , 1976 .

[19]  Herbert Freeman,et al.  A Cyclic-Order Property of Bodies with Three-Face Vertices , 1977, IEEE Transactions on Computers.

[20]  Jayaram K. Udupa,et al.  New Concepts for Three-Dimensional Shape Analysis , 1977, IEEE Transactions on Computers.

[21]  A. R. Johnston,et al.  A Scanning Laser Rangefinder for a Robotic Vechicle , 1977, IJCAI.

[22]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[23]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[24]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[25]  Robert J. Douglass.  Recognition and Depth Perception of Objects in Real World Scenes , 1977, IJCAI.

[26]  Robert E. Shostak,et al.  On the SUP-INF Method for Proving Presburger Formulas , 1977, JACM.

[27]  A. E. Brain,et al.  The measurement and use of registered reflectance and range data in scene analysis , 1977, Proceedings of the IEEE.

[28]  Herbert Freeman,et al.  Reconstruction of Curved-Surface Bodies from a Set of Imperfect Projections , 1977, IJCAI.

[29]  H. Baker,et al.  Three-Dimensional Modeling , 2019, IJCAI.

[30]  Norman I. Badler,et al.  Three-dimensional representations for computer graphics and computer vision , 1978, SIGGRAPH.

[31]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[32]  I. Faux,et al.  Computational Geometry for Design and Manufacture , 1979 .

[33]  Richard O. Duda,et al.  Use of Range and Reflectance Data to Find Planar Surface Regions , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Kokichi Sugihara,et al.  Range-Data Analysis Guided by a Junction Dictionary , 1979, Artif. Intell..

[35]  Robert F. Sproull,et al.  Principles of interactive computer graphics (2nd ed.) , 1979 .

[36]  Rodney A. Brooks,et al.  The ACRONYM Model-Based Vision System , 1979, IJCAI.

[37]  S. Ullman.  The Interpretation of Visual Motion , 1979 .

[38]  Donald B. Gennery,et al.  Object Detection and Measurement Using Stereo Vision , 1979, IJCAI.

[39]  Norman I. Badler,et al.  Decomposition of Three-Dimensional Objects into Spheres , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  P. Wintz,et al.  An efficient three-dimensional aircraft recognition algorithm using normalized fourier descriptors , 1980 .

[41]  ARISTIDES A. G. REQUICHA,et al.  Representations for Rigid Solids: Theory, Methods, and Systems , 1980, CSUR.

[42]  Robert C. Bolles,et al.  Locating Partially Visible Objects: The Local Feature Focus Method , 1980, AAAI.

[43]  Ernest L. Hall,et al.  Three-Dimensional Moment Invariants , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Robert C. Bolles,et al.  A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data , 1981, IJCAI.

[45]  Michael Brady,et al.  Preface - The Changing Shape of Computer Vision , 1981, Artif. Intell..

[46]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[47]  David K. Lynch.  Range image enhancement via one-dimensional spatial filtering , 1981 .

[48]  Olivier D. Faugeras,et al.  Triangulation of 3-D Objects , 1981, IJCAI.

[49]  Andrew P. Witkin,et al.  Recovering Surface Shape and Orientation from Texture , 1981, Artif. Intell..

[50]  Martin D. Altschuler,et al.  The Numerical Stereo Camera , 1981, Other Conferences.

[51]  Christopher M. Brown,et al.  Some Mathematical and Representational Aspects of Solid Modeling , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[53]  Katsushi Ikeuchi.  Recognition of 3-D Objects Using the Extended Gaussian Image , 1981, IJCAI.

[54]  Hsien-Che Lee.  A computer vision system for generating object description , 1981 .

[55]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[56]  Robert J. Woodham,et al.  Analysing Images of Curved Surfaces , 1981, Artif. Intell..

[57]  H. Keith Nishihara,et al.  Intensity, Visible-Surface, and Volumetric Representations , 1981, Artif. Intell..

[58]  H. Barrow,et al.  Computational vision , 1981, Proceedings of the IEEE.

[59]  Allen R. Hanson,et al.  3D Object Representation and Matching with B-Splines and Surface Patches , 1981, IJCAI.

[60]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[61]  J. C. Bocquet,et al.  Expert system for reconstruction of mechanical object from projections , 1982 .

[62]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[63]  Ernest L. Hall,et al.  Measuring Curved Surfaces for Robot Vision , 1982, Computer.

[64]  Herbert Freeman,et al.  Characteristic Views As A Basis For Three-Dimensional Object Recognition , 1982, Other Conferences.

[65]  Thomas C. Henderson.  Efficient Segmentation Method For Range Data , 1982, Other Conferences.

[66]  James D. Foley,et al.  Fundamentals of interactive computer graphics , 1982 .

[67]  Jochen Ludewig.  Computer-Aided Specification of Process Control Systems , 1982, Computer.

[68]  Yukio Sato,et al.  Shape Measurement of Curved Objects Using Multiple Slit-Ray Projections , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Donald Meagher,et al.  Geometric modeling using octree encoding , 1982, Comput. Graph. Image Process..

[70]  Requicha,et al.  Solid Modeling: A Historical Summary and Contemporary Assessment , 1982, IEEE Computer Graphics and Applications.

[71]  I. Chakravarty.  The use of characteristic views as a basis for recognition of three-dimensional objects , 1982 .

[72]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[73]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[74]  M. Potmesil.  Generating three-dimensional surface models of solid objects from multiple projections , 1982 .

[75]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[76]  J. Birk,et al.  Laser Rangefinder For Robot Control And Inspection , 1982, Other Conferences.

[77]  Marc H. Raibert,et al.  Design and Implementation of a VLSI Tactile Sensing Computer , 1982 .

[78]  C. Dane.  An object-centered three-dimensional model builder , 1982 .

[79]  R. Bolles,et al.  Recognizing and Locating Partially Visible Objects: The Local-Feature-Focus Method , 1982 .

[80]  Bir Bhanu,et al.  THREE-POINT SEED METHOD FOR THE EXTRACTION OF PLANAR FACES FROM RANGE DATA. , 1982 .

[81]  Michael Brady,et al.  Computational Approaches to Image Understanding , 1982, CSUR.

[82]  Ray A. Jarvis,et al.  A Laser Time-of-Flight Range Scanner for Robotic Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  T. Kanade,et al.  The Theory of Straight Homogeneous Generalized Cylinders , 1983 .

[84]  Steven A. Shafer,et al.  Correspondence in Line Drawings of Multiple Views of Objects , 1983, IJCAI.

[85]  Dana H. Ballard,et al.  Viewer Independent Shape Recognition , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  T. Kanade,et al.  The theory of straight homogeneous generalized cylinders and A taxonomy of generalized cylinders , 1983 .

[87]  Katsushi Ikeuchi,et al.  Picking up an Object from a Pile of Objects. , 1983 .

[88]  Jake K. Aggarwal,et al.  Experiments in combining intensity and range edge maps , 1983, Comput. Vis. Graph. Image Process..

[89]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[90]  Robert B. Fisher.  Using Surfaces and Object Models to Recognize Partially Obscured Objects , 1983, IJCAI.

[91]  Takeo Kanade,et al.  The 3D MOSAIC Scene Understanding System , 1983, IJCAI.

[92]  H. Voelcker,et al.  Solid modeling: current status and research directions , 1983, IEEE Computer Graphics and Applications.

[93]  P. Meyrueis,et al.  Three-Dimensional Automated Pattern Recognition Using The Moire Techniques , 1983, Optics & Photonics.

[94]  Hermann Tropf,et al.  An ATN Model for 3-D Recognition of Solids in Single Images , 1983, IJCAI.

[95]  R. Haralick,et al.  The Topographic Primal Sketch , 1983 .

[96]  Darwin T. Kuan,et al.  Model-Based Interpretation of Range Imagery , 1983, AAAI.

[97]  Frank J. Pipitone,et al.  A Wide-field Scanning Triangulation Rangefinder for Machine Vision , 1983 .

[98]  Yukio Sato,et al.  Pseudodistance Measures for Recognition of Curved Objects , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  Robert Barnhill,et al.  A survey of the representation and design of surfaces , 1983, IEEE Computer Graphics and Applications.

[100]  Norihiro Abe,et al.  Toward Generation of 3-Dimensional Models of Objects Using 2-Dimensional Figures and Explanations in Language , 1983, IJCAI.

[101]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[102]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[103]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[104]  David Casasent,et al.  Synthetic Discriminant Functions For Three-Dimensional Object Recognition , 1983, Optics & Photonics.

[105]  James J. Little,et al.  An iterative method for reconstructing convex polyhedra from extended gaussian images , 1983, AAAI 1983.

[106]  Jake K. Aggarwal,et al.  Detection of Edges Using Range Information , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[107]  Yoshiaki Shirai,et al.  Object Recognition Using Three-Dimensional Information , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  King-Sun Fu,et al.  Generating Object Descriptions for Model Retrieval , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[109]  Olivier D. Faugeras,et al.  A 3-D Recognition and Positioning Algorithm Using Geometrical Matching Between Primitive Surfaces , 1983, IJCAI.

[110]  Thomas C. Henderson.  Efficient 3-D Object Representations for Industrial Vision Systems , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[111]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[112]  Wayne Tiller,et al.  Rational B-Splines for Curve and Surface Representation , 1983, IEEE Computer Graphics and Applications.

[113]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[114]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .

[115]  Charles Csuri,et al.  Displays on display , 1984, IEEE Computer Graphics and Applications.

[116]  J. K. Aggarwal,et al.  RECOGNITION WITH RANGE AND INTENSITY DATA. , 1984 .

[117]  Paul J. Besl,et al.  Surface characterization for three-dimensional object recognition in depth maps , 1984 .

[118]  Robert M. Haralick,et al.  Digital Step Edges from Zero Crossing of Second Directional Derivatives , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[119]  Robert C. Bolles,et al.  3DPO's strategy for matching three-dimensional objects in range data , 1984, ICRA.

[120]  Ramesh Jain,et al.  Dynamic scene analysis , 1984 .

[121]  Yuan-Fang Wang,et al.  Matching Three-Dimensional Objects Using Silhouettes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[122]  Wei-Chung Lin,et al.  Estimation of Three-Dimensional Object Orientation for Computer Vision Systems with Feedback , 2007, J. Field Robotics.

[123]  David H. Marimont.  A Representation for Image Curves , 1984, AAAI.

[124]  Olivier D. Faugeras,et al.  Polyhedral approximation of 3-D objects without holes , 1984, Comput. Vis. Graph. Image Process..

[125]  R. Lee,et al.  Two-Dimensional Critical Point Configuration Graphs , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[126]  Azriel Rosenfeld,et al.  Image analysis: Problems, progress and prospects , 1984, Pattern Recognit..

[127]  Wei-Chung Lin,et al.  A Syntactic Approach to 3-D Object Representation , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[128]  Berthold K. P. Horn.  Extended Gaussian images , 1984, Proceedings of the IEEE.

[129]  D. J. Langridge.  Detection of discontinuities in the first derivatives of surfaces , 1984 .

[130]  L. Nackman.  Two-Dimensional Critical Point Configuration Graphs , 1984, IEEE Trans. Pattern Anal. Mach. Intell..

[131]  Ramesh Jain,et al.  Axial motion stereo , 1984 .

[132]  Bir Bhanu,et al.  Representation and Shape Matching of 3-D Objects , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[133]  Berthold K. P. Horn,et al.  The Mechanical Manipulation of Randomly Oriented Parts , 1984 .

[134]  J. K. Aggarwal,et al.  3-DIMENSIONAL RECONSTRUCTION OF OBJECTS FROM RANGE DATA. , 1984 .

[135]  C. Ian Connolly,et al.  Cumulative generation of octree models from range data , 1984, ICRA.

[136]  David B. Cooper,et al.  Bayesian Recognition of Local 3-D Shape by Approximating Image Intensity Functions with Quadric Polynomials , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[137]  Lee R. Nackman,et al.  Three-Dimensional Shape Description Using the Symmetric Axis Transform I: Theory , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[138]  Richard A. Volz,et al.  Object recognition using multiple views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[139]  Rida T. Farouki,et al.  A Hierarchy of Geometric Forms , 1985, IEEE Computer Graphics and Applications.

[140]  Ramesh Jain,et al.  Techniques For Real-Time, 3D, Feature Extraction Using Range Information , 1985, Other Conferences.

[141]  Takeo Kanade,et al.  Autonomous scene description with range imagery , 1985, Comput. Vis. Graph. Image Process..

[142]  Ramesh C. Jain,et al.  Automatic visual solder joint inspection , 1985, IEEE J. Robotics Autom..

[143]  C. Ian Connolly,et al.  The determination of next best views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[144]  Malcolm S. Casale,et al.  An Overview of Analytic Solid Modeling , 1985, IEEE Computer Graphics and Applications.

[145]  Thomas W. Sederberg,et al.  Steiner Surface Patches , 1985, IEEE Computer Graphics and Applications.

[146]  Robert M. Haralick,et al.  Topographic classification of digital image intensity surfaces using generalized splines and the discrete cosine transformation , 1984, Comput. Vis. Graph. Image Process..

[147]  Jean Ponce,et al.  Describing surfaces , 1985, Comput. Vis. Graph. Image Process..

[148]  Jean Ponce,et al.  Toward a surface primal sketch , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[149]  Larry S. Davis,et al.  Object recognition using oriented model points , 1986 .

[150]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[151]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[152]  Joan Wellington,et al.  INITIAL GRAPHICS EXCHANGE SPECIFICATION (IGES), VERSION 3.0 , 1986 .

[153]  Robert C. Bolles,et al.  3DPO: a three-dimensional part orientation system , 1987 .

[154]  Chris Goad,et al.  Special purpose automatic programming for 3D model-based vision , 1987 .

[155]  R. Haralick.  Digital Step Edges from Zero Crossing of Second Directional Derivatives , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[156]  Pnvid H Ivl,et al.  A Representation for Image Curves , 1984, AAAI.