Evaluating Local Geometric Feature Representations for 3D Rigid Data Matching

Local geometric descriptors act as an essential component for 3D rigid data matching. A rotational invariant local geometric descriptor usually consists of two components: local reference frame (LRF) and feature representation. However, existing evaluation efforts have mainly been paid on the LRF or the overall descriptor and the quantitative comparison of feature representations remains unexplored. This paper fills the gap by comprehensively evaluating nine state-of-the-art local geometric feature representations. In particular, our evaluation assesses feature representations based on ground-truth LRFs such that the ranking of tested methods is more convincing as compared with existing studies. The experiments are deployed on six standard datasets with various application scenarios (shape retrieval, point cloud registration, and object recognition) and data modalities (LiDAR, Kinect, and Space Time) as well as perturbations including Gaussian noise, shot noise, data decimation, clutter, occlusion, and limited overlap. The evaluated terms cover the major concerns for a feature representation, e.g., distinctiveness, robustness, compactness, and efficiency. The outcomes present interesting findings that may shed new light on this community and provide complementary perspectives to existing evaluations on the topic of local geometric feature description. A summary of evaluated methods regarding their peculiarities is finally presented to guide real-world applications and new descriptor crafting.

[1]  Mohammed Bennamoun,et al.  A novel local surface feature for 3D object recognition under clutter and occlusion , 2015, Inf. Sci..

[2]  Zhiguo Cao,et al.  Aligning 2.5D Scene Fragments With Distinctive Local Geometric Features and Voting-Based Correspondences , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Zi Jian Yew,et al.  3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration , 2018, ECCV.

[4]  Matthias Nießner,et al.  3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Zhiguo Cao,et al.  Rotational contour signatures for both real-valued and binary feature representations of 3D local shape , 2017, Comput. Vis. Image Underst..

[6]  Dirk Kraft,et al.  Local Point Pair Feature Histogram for Accurate 3D Matching , 2018, BMVC.

[7]  Zhiguo Cao,et al.  Multi-attribute statistics histograms for accurate and robust pairwise registration of range images , 2017, Neurocomputing.

[8]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[9]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Federico Tombari,et al.  Unique shape context for 3d data description , 2010, 3DOR '10.

[11]  Luciano Silva,et al.  3D reconstruction methods for digital preservation of cultural heritage: A survey , 2014, Pattern Recognit. Lett..

[12]  Federico Tombari,et al.  Object Recognition in 3D Scenes with Occlusions and Clutter by Hough Voting , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[13]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[14]  Johannes Wallner,et al.  Integral invariants for robust geometry processing , 2009, Comput. Aided Geom. Des..

[15]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[16]  Luigi di Stefano,et al.  On the repeatability of the local reference frame for partial shape matching , 2011, 2011 International Conference on Computer Vision.

[17]  Nassir Navab,et al.  When 2.5D is not enough: Simultaneous reconstruction, segmentation and recognition on dense SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Karthik Ramani,et al.  Deep Learning 3D Shapes Using Alt-az Anisotropic 2-Sphere Convolution , 2018, ICLR.

[19]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[20]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[21]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[22]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[23]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[24]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[25]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[26]  Zhiguo Cao,et al.  A fast and robust local descriptor for 3D point cloud registration , 2016, Inf. Sci..

[27]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[28]  Jie Ma,et al.  Local voxelized structure for 3D binary feature representation and robust registration of point clouds from low-cost sensors , 2018, Inf. Sci..

[29]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[30]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Michael G. Strintzis,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Snapshots: A Novel Local Surface , 2022 .

[32]  Radu Horaud,et al.  Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds , 2012, International Journal of Computer Vision.

[33]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Norbert Krüger,et al.  Local shape feature fusion for improved matching, pose estimation and 3D object recognition , 2016, SpringerPlus.

[35]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2012, International Journal of Computer Vision.

[36]  Slobodan Ilic,et al.  PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors , 2018, ECCV.

[37]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Mohammed Bennamoun,et al.  Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Jianwei Guo,et al.  Learning 3D Keypoint Descriptors for Non-rigid Shape Matching , 2018, ECCV.

[40]  Mohammed Bennamoun,et al.  An Accurate and Robust Range Image Registration Algorithm for 3D Object Modeling , 2014, IEEE Transactions on Multimedia.

[41]  Luigi di Stefano,et al.  A Repeatable and Efficient Canonical Reference for Surface Matching , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[42]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[43]  Peng Song,et al.  Signature of Geometric Centroids for 3D Local Shape Description and Partial Shape Matching , 2016, ACCV.

[44]  Zhiguo Cao,et al.  TOLDI: An effective and robust approach for 3D local shape description , 2017, Pattern Recognit..

[45]  Vladlen Koltun,et al.  Learning Compact Geometric Features , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[46]  Adrian Hilton,et al.  Evaluation of 3D Feature Descriptors for Multi-modal Data Registration , 2013, 2013 International Conference on 3D Vision.

[47]  Slobodan Ilic,et al.  PPFNet: Global Context Aware Local Features for Robust 3D Point Matching , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[48]  Jie Ma,et al.  Representing local shape geometry from multi-view silhouette perspective: A distinctive and robust binary 3D feature , 2018, Signal Process. Image Commun..

[49]  Zhiguo Cao,et al.  Toward the Repeatability and Robustness of the Local Reference Frame for 3D Shape Matching: An Evaluation , 2018, IEEE Transactions on Image Processing.

[50]  Mohammed Bennamoun,et al.  A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images , 2005, International Journal of Computer Vision.

[51]  Zhiguo Cao,et al.  The effect of spatial information characterization on 3D local feature descriptors: A quantitative evaluation , 2017, Pattern Recognit..

[52]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[53]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Olaf Hellwich,et al.  Comparison of 3D interest point detectors and descriptors for point cloud fusion , 2014, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[55]  Mohammed Bennamoun,et al.  On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes , 2009, International Journal of Computer Vision.

[56]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .