Multi-attribute statistics histograms for accurate and robust pairwise registration of range images

A distinctive, robust and efficient 3D local shape descriptor called MaSH is proposed.A novel 3D transformation estimation algorithm named 2SAC-GC is proposed.An accurate and robust range image registration method is presented.The proposed registration method copes well with both high and low resolution data. Registration of range images based on local shape features is widely adopted due to its validated effectiveness and robustness, while most existing local shape descriptors struggle to simultaneously achieve a pleasurable and balanced performance in terms of distinctiveness, robustness and time efficiency. This paper proposes a novel representation of 3D local surfaces, called multi-attribute statistics histograms (MaSH), for automatic registration of range images. MaSH comprises both spatial and geometric information characterizations. The characterization of spatial information is achieved via radial partitions in the 3D local support volume around the keypoint based on a local reference axis (LRA), creating a set of subspaces. While the encoding the shape geometry is performed by calculating statistical histograms of multiple faint correlated geometric attributes (i.e., local depth, normal deviation, and surface variation angle) for each subspace, so as to achieve information complementarity. Then, a robust rigid transformation estimation algorithm named 2-point based sample consensus with global constrain (2SAC-GC) is presented to tackle the problem of calculating an optimal transformation from the correspondence set with outliers. Finally, a coarse-to-fine registration method based on MaSH and 2SAC-GC is proposed for aligning range images. Experiments on both high-resolution (Laser Scanner) and low-resolution (Kinect) datasets report that, our method achieves a registration accuracy of 90.36% and 80.39% on the two datasets, respectively. It also exhibits strong robustness against noise and varying mesh resolutions. Furthermore, feature matching experiments show the over-all superiority of the proposed MaSH descriptor against the state-of-the-arts including the spin image, snapshots, THRIFT, FPFH, RoPS, LFSH and RCS descriptors.

[1]  Federico Tombari,et al.  Automatic detection of pole-like structures in 3D urban environments , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..

[4]  Linda G. Shapiro,et al.  A new signature-based method for efficient 3-D object recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Federico Tombari,et al.  Object Recognition in 3D Scenes with Occlusions and Clutter by Hough Voting , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[6]  Akihiro Sugimoto,et al.  Robustly registering range images using local distribution of albedo , 2011, Comput. Vis. Image Underst..

[7]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[8]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[9]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[10]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[11]  Nico Blodow,et al.  Real-time compression of point cloud streams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Nico Blodow,et al.  Persistent Point Feature Histograms for 3D Point Clouds , 2008 .

[13]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Michael G. Strintzis,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Snapshots: A Novel Local Surface , 2022 .

[16]  Mohammed Bennamoun,et al.  An Integrated Framework for 3-D Modeling, Object Detection, and Pose Estimation From Point-Clouds , 2015, IEEE Transactions on Instrumentation and Measurement.

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Anthony Dick,et al.  Special Issue -selected Papers from Dicta 2007 Local 3d Structure Recognition in Range Images , 2022 .

[19]  Anton van den Hengel,et al.  Thrift: Local 3D Structure Recognition , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[20]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[21]  Radu Horaud,et al.  Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds , 2012, International Journal of Computer Vision.

[22]  Mohammed Bennamoun,et al.  A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images , 2005, International Journal of Computer Vision.

[23]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[24]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[25]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[26]  Zhiguo Cao,et al.  A fast and robust local descriptor for 3D point cloud registration , 2016, Inf. Sci..

[27]  Flip Phillips,et al.  Visual and haptic geometry of 3D shape discrimination. , 2015, Journal of vision.

[28]  Mohammed Bennamoun,et al.  3D-Div: A novel local surface descriptor for feature matching and pairwise range image registration , 2013, 2013 IEEE International Conference on Image Processing.

[29]  Darius Burschka,et al.  An Efficient RANSAC for 3D Object Recognition in Noisy and Occluded Scenes , 2010, ACCV.

[30]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[31]  Markus H. Gross,et al.  Multi‐scale Feature Extraction on Point‐Sampled Surfaces , 2003, Comput. Graph. Forum.

[32]  Yuqing He,et al.  An efficient registration algorithm based on spin image for LiDAR 3D point cloud models , 2015, Neurocomputing.

[33]  Mohammed Bennamoun,et al.  Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Luigi di Stefano,et al.  A Repeatable and Efficient Canonical Reference for Surface Matching , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[35]  Shihui Ying,et al.  A Scale Stretch Method Based on ICP for 3D Data Registration , 2009, IEEE Transactions on Automation Science and Engineering.

[36]  Mohammed Bennamoun,et al.  A novel feature representation for automatic 3D object recognition in cluttered scenes , 2016, Neurocomputing.

[37]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[38]  Mohammed Bennamoun,et al.  A novel local surface feature for 3D object recognition under clutter and occlusion , 2015, Inf. Sci..

[39]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Mohammed Bennamoun,et al.  A novel 3D vorticity based approach for automatic registration of low resolution range images , 2015, Pattern Recognit..

[41]  Mohammed Bennamoun,et al.  An Accurate and Robust Range Image Registration Algorithm for 3D Object Modeling , 2014, IEEE Transactions on Multimedia.

[42]  Kostas Daniilidis,et al.  Fully Automatic Registration of 3D Point Clouds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[43]  R. Bro,et al.  Resolving the sign ambiguity in the singular value decomposition , 2008 .

[44]  Henrik Gordon Petersen,et al.  In Search of Inliers: 3D Correspondence by Local and Global Voting , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Mohammed Bennamoun,et al.  On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes , 2009, International Journal of Computer Vision.

[46]  Zhiguo Cao,et al.  Rotational contour signatures for robust local surface description , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[47]  Umberto Castellani,et al.  Sparse points matching by combining 3D mesh saliency with statistical descriptors , 2008, Comput. Graph. Forum.

[48]  Luigi di Stefano,et al.  On the repeatability of the local reference frame for partial shape matching , 2011, 2011 International Conference on Computer Vision.

[49]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Yu Zhong,et al.  Intrinsic shape signatures: A shape descriptor for 3D object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[51]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[52]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[53]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[54]  Ko Nishino,et al.  Scale-Dependent/Invariant Local 3D Shape Descriptors for Fully Automatic Registration of Multiple Sets of Range Images , 2008, ECCV.