Multi-scale free-form 3D object recognition using 3D models

The recognition of free-form 3D objects using 3D models under different viewing conditions based on the geometric hashing algorithm and global verification is presented. The matching stage of the algorithm uses the hash-table prepared in the off-line stage. Given a scene of feature points, one tries to match the measurements taken at scene points to those memorised in the hash-table. The technique used for feature recovery is the generalisation of the CSS method (IEEE Trans. Pattern Anal. Mach. Intell., 14 (1992) 789–805), which is a powerful shape descriptor expected to be an MPEG-7 standard. Smoothing is used to remove noise and reduce the number of feature points to add to the efficiency and robustness of the system. The local maxima of Gaussian and mean curvatures are selected as feature points. Furthermore, the torsion maxima of the zero-crossing contours of Gaussian and mean curvatures are also selected as feature points. Recognition results are demonstrated for rotated and scaled as well as partially occluded objects. In order to verify match, 3D translation, rotation and scaling parameters are used for verification and results indicate that our technique is invariant to those transformations. Our technique for smoothing and feature extraction is more suitable than level set methods or volumetric diffusion for object recognition applications since it is applicable to incomplete surface data that arise during occlusion. It is also more efficient and allows for accurate estimation of curvature values.

[1]  Robert B. Fisher,et al.  Recognition of Geons by Parametric Deformable Contour Models , 1996, ECCV.

[2]  Larry S. Davis,et al.  Pose Determination of a Three-Dimensional Object Using Triangle Pairs , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[4]  King-Sun Fu,et al.  Handbook of pattern recognition and image processing , 1986 .

[5]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[6]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[7]  Gérard G. Medioni,et al.  Structural Indexing: Efficient 3-D Object Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Nasser Khalili,et al.  Curvature and torsion feature extraction from free-form 3-D meshes at multiple scales , 2000 .

[9]  Andrew J. Stoddart,et al.  Reconstruction of Smooth Surfaces with Arbitrary Topology Adaptive Splines , 1998, ECCV.

[10]  Nasser Khalili,et al.  Multi-scale 3-D Surface Description: Open and Closed Surfaces , 1999 .

[11]  Guido Gerig,et al.  Parametrization of Closed Surfaces for 3-D Shape Description , 1995, Comput. Vis. Image Underst..

[12]  Wolfgang Spohn,et al.  The Representation of , 1986 .

[13]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[14]  Nasser Khalili,et al.  Multi-Scale 3-D Free-Form Surface Smoothing , 1998, BMVC.

[15]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[16]  Wei-Chung Lin,et al.  A Neural Network Approach to CSG-Based 3-D Object Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Adrian Hilton,et al.  Reliable Surface Reconstructiuon from Multiple Range Images , 1996, ECCV.

[18]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[19]  Marc Rioux,et al.  Recognition and Shape Synthesis of 3-D Objects Based on Attributed Hypergraphs , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  A. Pentland Perceptual organization and the representation of natural form , 1987 .

[21]  Alex Pentland,et al.  Perceptual Organization and the Representation of Natural Form , 1986, Artif. Intell..

[22]  Nasser Khalili,et al.  Free-Form Surface Description in Multiple Scales: Extension to Incomplete Surfaces , 1999, CAIP.

[23]  Ramesh Jain,et al.  Range image analysis , 1994 .

[24]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[25]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Nasser Khalili,et al.  Free-Form 3-D Object Recognition at Multiple Scales , 2000, BMVC.

[28]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[29]  Shinji Umeyama Parameterized Point Pattern Matching and Its Application to Recognition of Object Families , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Gabriel Taubin,et al.  Curve and surface smoothing without shrinkage , 1995, Proceedings of IEEE International Conference on Computer Vision.

[31]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[32]  P Yuen,et al.  Recovery of Curvature and Torsion Features from Free-form 3D Meshes at Multiple Scales , 2000 .

[33]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Torsion-Based Shape Representation for Space Curves , 1997, Comput. Vis. Image Underst..

[34]  George C. Stockman,et al.  Object recognition and localization via pose clustering , 1987, Comput. Vis. Graph. Image Process..

[35]  Nasser Khalili,et al.  Curvature Estimation on Smoothed 3-D Meshes , 1999, BMVC.

[36]  Allen M. Waxman,et al.  Adaptive 3-D Object Recognition from Multiple Views , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Gene H. Golub,et al.  Optimal Surface Smoothing as Filter Design , 1996, ECCV.

[38]  Ruzena Bajcsy,et al.  Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Yehezkel Lamdan,et al.  On recognition of 3-D objects from 2-D images , 2011, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[40]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .