Model-Based Object Recognition - A Survey of Recent Research

We survey the main ideas behind recent research in model-based object recognition. The survey covers representations for models and images and the methods used to match them. Perceptual organization, the use of invariants, indexing schemes, and match verification are also reviewed. We conclude that there is still much room for improvement in the scope, robustness, and efficiency of object recognition methods. We identify what we believe are the ways improvements will be achieved.

[1]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[2]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[3]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[4]  Les Kitchen,et al.  Relaxation Applied to Matching Quantitative Relational Structures , 1978 .

[5]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Linda G. Shapiro,et al.  A Structural Model of Shape , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Robert C. Bolles,et al.  Locating Partially Visible Objects: The Local Feature Focus Method , 1980, AAAI.

[8]  Robert M. Haralick,et al.  Structural Descriptions and Inexact Matching , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[10]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[11]  R. Bolles,et al.  Recognizing and Locating Partially Visible Objects: The Local-Feature-Focus Method , 1982 .

[12]  M. Brady Criteria for Representations of Shape , 1983 .

[13]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Olivier D. Faugeras,et al.  Shape Matching of Two-Dimensional Objects , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[16]  Andrew K. C. Wong,et al.  Entropy and Distance of Random Graphs with Application to Structural Pattern Recognition , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[19]  Olivier D. Faugeras,et al.  HYPER: A New Approach for the Recognition and Positioning of Two-Dimensional Objects , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Michael Brady,et al.  Generating and Generalizing Models of Visual Objects , 1987, Artif. Intell..

[21]  Chris Goad,et al.  Special purpose automatic programming for 3D model-based vision , 1987 .

[22]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[23]  James V. Mahoney,et al.  Image Chunking: Defining Spatial Building Blocks for Scene Analysis , 1987 .

[24]  Jezekiel Ben-Arie,et al.  3D objects recognition by optimal matching search of multinary relations graphs , 1987, Comput. Vis. Graph. Image Process..

[25]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Gil J. Ettinger,et al.  Large hierarchical object recognition using libraries of parameterized model sub-parts , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Eric Saund,et al.  The role of knowledge in visual shape representation , 1988 .

[28]  D. Huttenlocher Three-Dimensional Recognition of Solid Objects from a Two- Dimensional Image , 1988 .

[29]  Trevor N. Mudge,et al.  Efficient Recognition of Partially Visible Objects Using a Logarithmic Complexity Matching Technique , 1989, Int. J. Robotics Res..

[30]  D. Lowe Fitting Parameterized 3-D Models to Images , 1989 .

[31]  Thomas C. Henderson,et al.  CAGD-Based Computer Vision , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Jake K. Aggarwal,et al.  Recent progress in object recognition from range data , 1989, Image Vis. Comput..

[33]  S. Ullman Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[34]  Alan K. Mackworth,et al.  Computer-Vision Update , 1989 .

[35]  Avinash C. Kak,et al.  A robot vision system for recognizing 3D objects in low-order polynomial time , 1989, IEEE Trans. Syst. Man Cybern..

[36]  Marc Rioux,et al.  Recognition and Shape Synthesis of 3-D Objects Based on Attributed Hypergraphs , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  D. Jacobs Grouping for Recognition , 1989 .

[38]  Wesley E. Snyder,et al.  Matching oversegmented 3D images to models using association graphs , 1989, Image Vis. Comput..

[39]  Jakub Segen Model learning and recognition of nonrigid objects , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Yehezkel Lamdan,et al.  Affine invariant model-based object recognition , 1990, IEEE Trans. Robotics Autom..

[41]  Eric Saund,et al.  Symbolic Construction of a 2-D Scale-Space Image , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Radu Horaud,et al.  Finding Geometric and Relational Structures in an Image , 1990, ECCV.

[43]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[44]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[45]  W. Eric L. Grimson,et al.  On the Sensitivity of the Hough Transform for Object Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Thomas M. Breuel Indexing for Visual Recognition from a Large Model Base , 1990 .

[47]  Alistair J. Bray Object Recognition Using Local Geometric Constraints: A Robust Alternative To Tree-Search , 1990, ECCV.

[48]  J. McCafferty Human and machine vision: computing perceptual organisation , 1990 .

[49]  T. Fan Describing and Recognizing 3-D Objects Using Surface Properties , 1989, Springer Series in Perception Engineering.

[50]  Jezekiel Ben-Arie The Probabilistic Peaking Effect of Viewed Angles and Distances with Application to 3-D Object Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Thomas M. Strat,et al.  Context-Based Vision: Recognizing Objects Using Information from Both 2D and 3D Imagery , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  L. Stark,et al.  Dissertation Abstract , 1994, Journal of Cognitive Education and Psychology.

[54]  Satoshi Okada,et al.  Robot Vision Using a Feature Search Strategy Generated from a 3D Oobject Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  David W. Jacobs,et al.  Model group indexing for recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Roberto Brunelli,et al.  HyperBF Networks for Real Object Recognition , 1991, IJCAI.

[57]  W. Eric L. Grimson,et al.  On the Verification of Hypothesized Matches in Model-Based Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Peter C. Wayner,et al.  Efficiently using invariant theory for model-based matching , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[60]  Todd A. Cass,et al.  Polynomial-Time Object Recognition in the Presence of Clutter, Occlusion, and Uncertainty , 1992, ECCV.

[61]  Thomas M. Breuel,et al.  Fast recognition using adaptive subdivisions of transformation space , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[62]  David A. Forsyth,et al.  Recognising rotationally symmetric surfaces from their outlines , 1992, ECCV.

[63]  Edward M. Riseman,et al.  Matching complex images to multiple 3D objects using view description networks , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[64]  S. Edelman,et al.  Orientation dependence in the recognition of familiar and novel views of three-dimensional objects , 1992, Vision Research.

[65]  E. K. WONG,et al.  Model matching in robot vision by subgraph isomorphism , 1992, Pattern Recognit..

[66]  Prasanna G. Mulgaonkar,et al.  Automatic vision programming , 1992, CVGIP Image Underst..

[67]  Sven J. Dickinson,et al.  Unified approach to the recognition of expected and unexpected geon-based objects , 1992, Defense, Security, and Sensing.

[68]  R. Nevatia,et al.  Perceptual Organization for Scene Segmentation and Description , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Roberto Brunelli,et al.  Face Recognition through Geometrical Features , 1992, ECCV.

[70]  D. Jacobs Space Efficient 3D Model Indexing , 1992 .

[71]  Azriel Rosenfeld,et al.  3-D Shape Recovery Using Distributed Aspect Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Eric Saund,et al.  Putting Knowledge Into a Visual Shape Representation , 1992, Artif. Intell..

[73]  Gérard G. Medioni,et al.  Structural Indexing: Efficient 3-D Object Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Shimon Ullman,et al.  Limitations of Non Model-Based Recognition Schemes , 1992, ECCV.

[75]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[76]  Robert Bergevin,et al.  Extraction of line drawing features for object recognition , 1992, Pattern Recognit..

[77]  Shimon Edelman,et al.  Bringing the Grandmother back into the Picture: A Memory-Based View of Object Recognition , 1990, Int. J. Pattern Recognit. Artif. Intell..

[78]  Patrick J. Flynn Saliencies and symmetries: toward 3D object recognition from large model databases , 1992, CVPR.

[79]  Geoffrey D. Sullivan,et al.  Using Automatically Constructed View-Independent Relational Model in 3D Object Recognition , 1992, ECCV.

[80]  Takeo Kanade,et al.  Model based recognition of specular objects using sensor models , 1992, CVGIP Image Underst..

[81]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[82]  Robert M. Haralick,et al.  Object Recognition Using Prediction And Probabilistic Match , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[83]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[84]  Kim L. Boyer,et al.  Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Thomas M. Breuel,et al.  Higher-order statistics in object recognition , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[86]  Geoffrey D. Sullivan,et al.  The Automatic Construction of a View-Independent Relational Model for 3-D Object Recognition , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  W. Eric L. Grimson,et al.  Gaussian error models for object recognition , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[88]  Robert A. Hummel,et al.  Distributed Bayesian object recognition , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[89]  Robert Bergevin,et al.  Generic Object Recognition: Building and Matching Coarse Descriptions from Line Drawings , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[90]  Narendra Ahuja,et al.  Learning recognition and segmentation of 3-D objects from 2-D images , 1993, 1993 (4th) International Conference on Computer Vision.

[91]  Kim L. Boyer,et al.  Information theoretic clustering of large structural modelbases , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[92]  A. Pathak,et al.  Bayesian view class determination , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[93]  Ronen Basri,et al.  Recognition by prototypes , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[94]  William Wells,et al.  Statistical object recognition , 1993 .

[95]  Tanveer F. Syeda-Mahmood,et al.  Attentional selection in object recognition , 1993 .

[96]  S. Nayar,et al.  Learning and Recognition of 3-D Objects from Brightness Images * , 1993 .

[97]  J.B. Burns,et al.  View Variation of Point-Set and Line-Segment Features , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[98]  Kevin W. Bowyer,et al.  Computing the Perspective Projection Aspect Graph of Solids of Revolution , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[99]  David G. Lowe,et al.  Learning indexing functions for 3-D model-based object recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[100]  Emanuele Trucco,et al.  Geometric Invariance in Computer Vision , 1995 .