Histograms of Gaussian normal distribution for 3D feature matching in cluttered scenes

Abstract3D feature descriptors provide essential information to find given models in captured scenes. In practical applications, these scenes often contain clutter. This imposes severe challenges on the 3D object recognition leading to feature mismatches between scenes and models. As such errors are not fully addressed by the existing methods, 3D feature matching still remains a largely unsolved problem. We therefore propose our Histograms of Gaussian Normal Distribution (HGND) for capturing salient feature information on a local reference frame (LRF) that enables us to solve this problem. We define a LRF on each local surface patch by using the eigenvectors of the scatter matrix. Different from the traditional local LRF-based methods, our HGND descriptor is based on the combination of geometrical and spatial information without calculating the distribution of every point and its geometrical information in a local domain. This makes it both simple and efficient. We encode the HGND descriptors in a histogram by the geometrical projected distribution of the normal vectors. These vectors are based on the spatial distribution of the points. We use three public benchmarks, the Bologna, the UWA and the Ca’ Foscari Venezia dataset, to evaluate the speed, robustness, and descriptiveness of our approach. Our experiments demonstrate that the HGND is fast and obtains a more reliable matching rate than state-of-the-art approaches in cluttered situations.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Rafael Beserra Gomes,et al.  Efficient 3D object recognition using foveated point clouds , 2013, Comput. Graph..

[3]  Mohammed Bennamoun,et al.  A novel local surface feature for 3D object recognition under clutter and occlusion , 2015, Inf. Sci..

[4]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Mohammed Bennamoun,et al.  A novel feature representation for automatic 3D object recognition in cluttered scenes , 2016, Neurocomputing.

[6]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Radu Horaud,et al.  Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds , 2012, International Journal of Computer Vision.

[8]  Manolis I. A. Lourakis,et al.  Correspondence-free pose estimation for 3D objects from noisy depth data , 2016, The Visual Computer.

[9]  Babak Taati,et al.  Local shape descriptor selection for object recognition in range data , 2011, Comput. Vis. Image Underst..

[10]  Kunwoo Lee,et al.  3D object recognition using scale-invariant features , 2017, The Visual Computer.

[11]  Nico Blodow,et al.  CAD-model recognition and 6DOF pose estimation using 3D cues , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  Federico Tombari,et al.  Unique shape context for 3d data description , 2010, 3DOR '10.

[13]  Yosi Keller,et al.  Scale-Invariant Features for 3-D Mesh Models , 2012, IEEE Transactions on Image Processing.

[14]  Radu Horaud,et al.  SHREC '11: Robust Feature Detection and Description Benchmark , 2011, 3DOR@Eurographics.

[15]  Ko Nishino,et al.  3D Geometric Scale Variability in Range Images: Features and Descriptors , 2012, International Journal of Computer Vision.

[16]  Zoltan-Csaba Marton,et al.  Tutorial: Point Cloud Library: Three-Dimensional Object Recognition and 6 DOF Pose Estimation , 2012, IEEE Robotics & Automation Magazine.

[17]  Marina L. Gavrilova,et al.  DTW-based kernel and rank-level fusion for 3D gait recognition using Kinect , 2015, The Visual Computer.

[18]  Luigi di Stefano,et al.  On the repeatability of the local reference frame for partial shape matching , 2011, 2011 International Conference on Computer Vision.

[19]  Norbert Krüger,et al.  Local shape feature fusion for improved matching, pose estimation and 3D object recognition , 2016, SpringerPlus.

[20]  R. Horaud,et al.  Surface feature detection and description with applications to mesh matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Luc Van Gool,et al.  Hough Transform and 3D SURF for Robust Three Dimensional Classification , 2010, ECCV.

[22]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[23]  Anton van den Hengel,et al.  Thrift: Local 3D Structure Recognition , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[24]  Alberto Del Bimbo,et al.  Selecting stable keypoints and local descriptors for person identification using 3D face scans , 2014, The Visual Computer.

[25]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[26]  Mohammed Bennamoun,et al.  On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes , 2009, International Journal of Computer Vision.

[27]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[28]  Afzal Godil,et al.  Evaluation of 3D interest point detection techniques via human-generated ground truth , 2012, The Visual Computer.

[29]  J. Paul Siebert,et al.  Local feature extraction and matching on range images: 2.5D SIFT , 2009, Comput. Vis. Image Underst..

[30]  Zheng Zhang,et al.  Pose-invariant face recognition using facial landmarks and Weber local descriptor , 2015, Knowl. Based Syst..

[31]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[32]  Mohammed Bennamoun,et al.  Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Peng Song,et al.  3D Object Recognition in Cluttered Scenes With Robust Shape Description and Correspondence Selection , 2017, IEEE Access.

[34]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[35]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[36]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[37]  Yujie Liu,et al.  Multiscale shape context and re-ranking for deformable shape retrieval , 2016, Comput. Graph..

[38]  Gérard G. Medioni,et al.  Structural Indexing: Efficient 3-D Object Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Zhiguo Cao,et al.  Rotational contour signatures for both real-valued and binary feature representations of 3D local shape , 2017, Comput. Vis. Image Underst..

[40]  Saturnino Maldonado-Bascón,et al.  SURFing the point clouds: Selective 3D spatial pyramids for category-level object recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Federico Tombari,et al.  A combined texture-shape descriptor for enhanced 3D feature matching , 2011, 2011 18th IEEE International Conference on Image Processing.

[42]  Saturnino Maldonado-Bascón,et al.  Evaluating 3D spatial pyramids for classifying 3D shapes , 2013, Comput. Graph..

[43]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[44]  Yu Guo,et al.  Point-wise saliency detection on 3D point clouds via covariance descriptors , 2017, The Visual Computer.

[45]  Ralph R. Martin,et al.  3D point of interest detection via spectral irregularity diffusion , 2013, The Visual Computer.

[46]  Ko Nishino,et al.  Scale-hierarchical 3D object recognition in cluttered scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Cagatay Basdogan,et al.  A new feature-based method for robust and efficient rigid-body registration of overlapping point clouds , 2008, The Visual Computer.

[48]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[49]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[50]  Günther Greiner,et al.  Interactive partial 3D shape matching with geometric distance optimization , 2014, The Visual Computer.

[51]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[52]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Gang Zhao,et al.  CAD-based 3D objects recognition in monocular images for mobile augmented reality , 2015, Comput. Graph..

[54]  Dongjian He,et al.  A self-adaptive segmentation method for a point cloud , 2018, The Visual Computer.

[55]  Gary R. Bradski,et al.  Fast 3D recognition and pose using the Viewpoint Feature Histogram , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[57]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Andrea Torsello,et al.  A Scale Independent Selection Process for 3D Object Recognition in Cluttered Scenes , 2013, International Journal of Computer Vision.

[59]  Markus Vincze,et al.  Ensemble of shape functions for 3D object classification , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[60]  Yu Zhong,et al.  Intrinsic shape signatures: A shape descriptor for 3D object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.