Model-based recognition in robot vision

This paper presents a comparative study and survey of model-based object-recognition algorithms for robot vision. The goal of these algorithms is to recognize the identity, position, and orientation of randomly oriented industrial parts. In one form this is commonly referred to as the "bin-picking" problem, in which the parts to be recognized are presented in a jumbled bin. The paper is organized according to 2-D, 2½-D, and 3-D object representations, which are used as the basis for the recognition algorithms. Three central issues common to each category, namely, feature extraction, modeling, and matching, are examined in detail. An evaluation and comparison of existing industrial part-recognition systems and algorithms is given, providing insights for progress toward future robot vision systems.

[1]  Manfred H. Hueckel.  An Operator Which Locates Edges in Digitized Pictures , 1971, J. ACM.

[2]  Yoshiaki Shirai,et al.  Recognition of polyhedrons with a range finder , 1971, IJCAI.

[3]  Bruce G. Baumgart.  Winged edge polyhedron representation. , 1972 .

[4]  C. Chow,et al.  Automatic boundary detection of the left ventricle from cineangiograms. , 1972, Computers and biomedical research, an international journal.

[5]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[6]  Ruzena Bajcsy,et al.  Computer identification of visual surfaces , 1973, Comput. Graph. Image Process..

[7]  W. Dobaczewska,et al.  First international symposium , 1974 .

[8]  Y. Shirai,et al.  Edge Finding, Segmentation Of Edges And Recognition Of Complex Objects , 1975, IJCAI.

[9]  Ann Patricia Fothergill,et al.  Forming Models Of Plane-And-Cylinder Faceled Bodies From Light Stripes , 1975, IJCAI.

[10]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[11]  Berthold K. P. Horn.  A problem in computer vision , 1975 .

[12]  Berthold K. P. Horn.  Orienting silicon integrated circuit chips for lead bonding , 1975 .

[13]  Masakazu Ejiri,et al.  A Transistor Wire-Bonding System Utilizing Multiple Local Pattern Matching Techniques , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[15]  J. Koenderink,et al.  Visual perception of rigidity of solid shape , 1976, Journal of mathematical biology.

[16]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[17]  Takafumi Miyatake,et al.  An Automatic Position Recognition Technique for LSI Assembly , 1977, IJCAI.

[18]  Andrzej Kasprzak,et al.  A Syntactic Description and Recognition of Rotary Machine Elements , 1977, IEEE Transactions on Computers.

[19]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[20]  Masahiko Yachida,et al.  A Versatile Machine Vision System for Complex Industrial Parts , 1977, IEEE Transactions on Computers.

[21]  David Marr,et al.  Representing Visual Information , 1977 .

[22]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  T. Vámos,et al.  Industrial Objects and Machine Parts Recognition , 1977 .

[24]  Norman I. Badler,et al.  Three-dimensional representations for computer graphics and computer vision , 1978, SIGGRAPH.

[25]  Berthold K. P. Horn,et al.  Determining Shape and Reflectance Using Multiple Images , 1978 .

[26]  W. A. Perkins,et al.  A Model-Based Vision System for Industrial Parts , 1978, IEEE Transactions on Computers.

[27]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[28]  David A. Smith.  Using Enhanced Spherical Images for Object Representation , 1979 .

[29]  Richard O. Duda,et al.  Use of Range and Reflectance Data to Find Planar Surface Regions , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Kokichi Sugihara,et al.  Range-Data Analysis Guided by a Junction Dictionary , 1979, Artif. Intell..

[31]  Berthold K. P. Horn.  Sequins and Quills - Representations for Surface Topography. , 1979 .

[32]  L. Lieberman.  Model-Driven Vision for Industrial Automation , 1979 .

[33]  Michael Shneier,et al.  A Compact Relational Structure Representation , 1979, IJCAI.

[34]  Yoshiaki Shirai,et al.  A scene description method using three-dimensional information , 1979, Pattern Recognit..

[35]  Robert C. Bolles,et al.  Symmetry Analysis of Two-Dimensional Patterns for Computer Vision , 1979, IJCAI.

[36]  Lothar Rossol,et al.  CONSIGHT-I: A Vision-Controlled Robot System for Transferring Parts from Belt Conveyors , 1979 .

[37]  Robert C. Bolles,et al.  Robust Feature Matching Through Maximal Cliques , 1979, Other Conferences.

[38]  Robert C. Bolles,et al.  Prospects for Industrial Vision , 1979 .

[39]  Indranil Chakravarty,et al.  A Generalized Line and Junction Labeling Scheme with Application to scene Analysis , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Robert B. Kelley,et al.  Image Feature Extraction Using Diameter-Limited Gradient Direction Histograms , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  C. A. Rosen,et al.  Machine Vision and Robotics: Industrial Requirements , 1979 .

[42]  A. Rosenfeld,et al.  Image segmentation and image models , 1979, Proceedings of the IEEE.

[43]  Robert J. Woodham,et al.  Photometric Stereo: A Reflectance Map Technique For Determining Surface Orientation From Image Intensity , 1979, Optics & Photonics.

[44]  Joseph L. Mundy,et al.  Visual Inspection System Design , 1980, Computer.

[45]  W. A. Perkins,et al.  Area Segmentation of Images Using Edge Points , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Henry Fuchs,et al.  On visible surface generation by a priori tree structures , 1980, SIGGRAPH '80.

[47]  Gerald J. Agin.  Computer Vision Systems for Industrial Inspection and Assembly , 1980, Computer.

[48]  ARISTIDES A. G. REQUICHA,et al.  Representations for Rigid Solids: Theory, Methods, and Systems , 1980, CSUR.

[49]  Masahiko Yachida,et al.  Industrial Computer Vision in Japan , 1980, Computer.

[50]  John F. Jarvis.  Visual Inspection Automation , 1980, Computer.

[51]  Michael J. Flynn,et al.  Directions and Issues in Architecture and Language , 1980, Computer.

[52]  Ware Myers,et al.  Industry Begins to Use Visual Pattern Recognition , 1980, Computer.

[53]  John F. Jarvis.  Visual Inspection Automation , 1980, Computer.

[54]  J. Birk,et al.  Estimating workpiece pose using the feature points method , 1980 .

[55]  Robert C. Bolles,et al.  Locating Partially Visible Objects: The Local Feature Focus Method , 1980, AAAI.

[56]  Robert C. Bolles,et al.  A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data , 1981, IJCAI.

[57]  Robert C. Bolles,et al.  Overview Of Applications Of Image Understanding To Industrial Automation , 1981, Other Conferences.

[58]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[59]  Dana H. Ballard,et al.  Parameter Networks: Towards a Theory of Low-Level Vision , 1981, IJCAI.

[60]  H. Harry Asada,et al.  Noncontact Visual Three-Dimensional Ranging Devices , 1981, Other Conferences.

[61]  R.P. Kruger,et al.  A technical and economic assessment of computer vision for industrial inspection and robotic assembly , 1981, Proceedings of the IEEE.

[62]  Andrew P. Witkin,et al.  Recovering Surface Shape and Orientation from Texture , 1981, Artif. Intell..

[63]  R. Rifkin.  Information content. , 1981, Circulation.

[64]  Martin D. Altschuler,et al.  The Numerical Stereo Camera , 1981, Other Conferences.

[65]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Rodney A. Brooks,et al.  Geometric Modeling In Vision For Manufacturing , 1981, Other Conferences.

[67]  Robert B. Kelley,et al.  An Orienting Robot for Feeding Workpieces Stored in Bins , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[68]  Katsushi Ikeuchi.  Recognition of 3-D Objects Using the Extended Gaussian Image , 1981, IJCAI.

[69]  John Ronald Kender,et al.  Shape from texture , 1981 .

[70]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[71]  H. Barrow,et al.  Computational vision , 1981, Proceedings of the IEEE.

[72]  Thomas S Huang,et al.  IMAGE RECOGNITION BY MATCHING RELATIONAL STRUCTURES. , 1981 .

[73]  G. Zimmermann,et al.  Real-Time Processing of Binary Images for Industrial Applications , 1981, Digital Image Processing Systems.

[74]  T. J. Stonham,et al.  Computer Vision Systems for Industry: Comparisons , 1982 .

[75]  Ryszard Jakubowski,et al.  SYNTACTIC CHARACTERIZATION OF MACHINE PARTS SHAPES , 1982 .

[76]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[77]  Herbert Freeman,et al.  Characteristic Views As A Basis For Three-Dimensional Object Recognition , 1982, Other Conferences.

[78]  George C. Stockman,et al.  Matching Images to Models for Registration and Object Detection via Clustering , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  Thomas C. Henderson.  Efficient Segmentation Method For Range Data , 1982, Other Conferences.

[80]  Michael Brady,et al.  Parts Description And Acquisition Using Vision , 1982, Other Conferences.

[81]  W. Hättich,et al.  Recognition of Overlapping Workpieces by Model-Directed Construction of Object Contours , 1982 .

[82]  A. Pugh,et al.  Visually Interactive Gripping of Engineering Parts from Random Orientation , 1982 .

[83]  Katsushi Ikeuchi,et al.  A Model Based Vision System for Recognition of Machine Parts , 1982, AAAI.

[84]  Charles A. Harlow,et al.  Automated Visual Inspection: A Survey , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[85]  Roland T. Chin,et al.  MACHINE VISION FOR DISCRETE PART HANDLING IN INDUSTRY: A SURVEY. , 1982 .

[86]  Robert B. Kelley,et al.  A Robot System Which Acquires Cylindrical Workpieces from Bins , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[87]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[88]  P. Rives,et al.  Comparison of Five Methods for the Recognition of Industrial Parts , 1982 .

[89]  Thomas S Huang,et al.  RECOGNITION OF CURVILINEAR OBJECTS BY MATCHING RELATIONAL STRUCTURES. , 1982 .

[90]  R. Bolles,et al.  Recognizing and Locating Partially Visible Objects: The Local-Feature-Focus Method , 1982 .

[91]  Bir Bhanu,et al.  THREE-POINT SEED METHOD FOR THE EXTRACTION OF PLANAR FACES FROM RANGE DATA. , 1982 .

[92]  Michael Brady,et al.  Computational Approaches to Image Understanding , 1982, CSUR.

[93]  A. Pugh,et al.  Processing of Binary Images , 1983 .

[94]  Ray A. Jarvis,et al.  A Laser Time-of-Flight Range Scanner for Robotic Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[95]  Robert B. Kelley,et al.  Error Analysis of Surface Normals Determined by Radiometry , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[96]  Jean-Daniel Boissonnat,et al.  Towards a Flexible Vision System , 1983 .

[97]  Lothar Rossol.  Computer Vision in Industry , 1983 .

[98]  Katsushi Ikeuchi,et al.  Picking up an Object from a Pile of Objects. , 1983 .

[99]  Robert B. Kelley.  Binary And Gray Scale Robot Vision , 1983, Optics & Photonics.

[100]  Bir Bhanu,et al.  Recognition of Occluded Objects , 1983, International Joint Conference on Artificial Intelligence.

[101]  R.B. Kelley,et al.  Three vision algorithms for acquiring workpieces from bins , 1983, Proceedings of the IEEE.

[102]  Philippe Villers,et al.  Present Industrial Use of Vision Sensors for Robot Guidance , 1983 .

[103]  Frank J. Pipitone,et al.  A Wide-field Scanning Triangulation Rangefinder for Machine Vision , 1983 .

[104]  Paul Suetens,et al.  A development system for machine vision , 1983 .

[105]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[106]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[107]  Katsushi Ikeuchi.  Determining Attitude of Object From Needle Map Using Extended Gaussian Image , 1983 .

[108]  C. A. Rosen,et al.  Evaluating Vision System Performance , 1983 .

[109]  Gerald J. Agin,et al.  Movable Light-Stripe Sensor For Obtaining Three-Dimensional Coordinate Measurements , 1983, Optics & Photonics.

[110]  Yoshiaki Shirai,et al.  Object Recognition Using Three-Dimensional Information , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[111]  K. S. Fu,et al.  Robot Vision For Machine Part Recognition , 1983, Optics & Photonics.

[112]  Olivier D. Faugeras,et al.  A 3-D Recognition and Positioning Algorithm Using Geometrical Matching Between Primitive Surfaces , 1983, IJCAI.

[113]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[114]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[115]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[116]  T. A. McMahon,et al.  Mechanics of Locomotion , 1984, Muscles, Reflexes, and Locomotion.

[117]  W. Grimson,et al.  Model-Based Recognition and Localization from Sparse Range or Tactile Data , 1984 .

[118]  Berthold K. P. Horn.  Extended Gaussian images , 1984, Proceedings of the IEEE.

[119]  Philip E. Brou.  Using the Gaussian Image to Find the Orientation of Objects , 1984 .

[120]  Jean Ponce,et al.  Object Representation, Identification and Positioning from Range Data , 1984 .

[121]  Bir Bhanu,et al.  Representation and Shape Matching of 3-D Objects , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[122]  David Harwood,et al.  An iterative hough procedure for three-dimensional object recognition , 1984, Pattern Recognit..

[123]  Olivier D. Faugeras,et al.  Shape Matching of Two-Dimensional Objects , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[124]  Richard A. Volz,et al.  Recognizing Partially Occluded Parts , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[125]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[126]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[127]  Yoshiaki Shirai,et al.  Image Feature Extraction , 1987 .

[128]  Chris Goad,et al.  Special purpose automatic programming for 3D model-based vision , 1987 .

[129]  Juan C. Telchi,et al.  An overview of machine vision , 1988 .