CICP: Cluster Iterative Closest Point for sparse-dense point cloud registration

Abstract Point cloud registration is an important and fundamental building block of mobile robotics. It forms an integral part of the processes of mapping, localization, object detection and recognition, loop closure and many other applications. Throughout the years, registration has been addressed in different ways, based on local features, global descriptor or object-based. However, all these techniques give meaningful results only if the input data are of the same type and density (resolution). Recently, with the technological revolution of 3D sensors, accurate ones producing dense clouds have appeared as well as others faster, more compatible with real-time applications, producing sparse clouds. Accuracy and speed are two sought-after concepts in every robotic application including those cited above, which involves the simultaneous use of both types of sensors, resulting in sparse–dense (or dense–sparse) point cloud registration. The difficulty of sparse to dense registration lies in the fact that there is no direct correspondence between each point in the two clouds, but rather a point equivalent to a set of points. In this paper, a novel approach that surpasses the notion of density is proposed. Its main idea consists in matching points representing each local surface of source cloud with the points representing the corresponding local surfaces in the target cloud. Experiments and comparisons with state-of-the-art methods show that our approach gives better performance. It handles registration of point clouds of different densities acquired by the same sensor with varied resolution or taken from different sensors.

[1]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Nico Blodow,et al.  CAD-model recognition and 6DOF pose estimation using 3D cues , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Javier González,et al.  Fast place recognition with plane-based maps , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Vito Renó,et al.  A Modified Iterative Closest Point Algorithm for 3D Point Cloud Registration , 2016, Comput. Aided Civ. Infrastructure Eng..

[7]  Ryan M. Eustice,et al.  Visual localization within LIDAR maps for automated urban driving , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Ivan Petrovic,et al.  Fast planar surface 3D SLAM using LIDAR , 2017, Robotics Auton. Syst..

[9]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[10]  Silvio Savarese,et al.  Visually bootstrapped generalized ICP , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Paul Checchin,et al.  Color-based 3D point cloud reduction , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[12]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[13]  Jeffrey Scott Vitter,et al.  Faster methods for random sampling , 1984, CACM.

[14]  Claus Brenner,et al.  3D feature point extraction from LiDAR data using a neural network , 2016 .

[15]  Olaf Hellwich,et al.  Automatic registration of unordered point clouds acquired by Kinect sensors using an overlap heuristic , 2015 .

[16]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[17]  Edwin Olson,et al.  Fast and robust 3D feature extraction from sparse point clouds , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Yu Zhong,et al.  Intrinsic shape signatures: A shape descriptor for 3D object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[20]  Gary R. Bradski,et al.  Fast 3D recognition and pose using the Viewpoint Feature Histogram , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Daniel Cernea,et al.  Real-Time Scale Invariant 3D Range Point Cloud Registration , 2010, ICIAR.

[22]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[24]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[25]  Paul Newman,et al.  Real-time probabilistic fusion of sparse 3D LIDAR and dense stereo , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  Minglei Li,et al.  Automatic registration of laser-scanned point clouds based on planar features , 2016, ISPRS International Conference on Computer Vision and Remote Sensing.

[27]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[28]  Armando Sousa,et al.  Robust 3/6 DoF self-localization system with selective map update for mobile robot platforms , 2016, Robotics Auton. Syst..

[29]  Martin Buss,et al.  Comparison of surface normal estimation methods for range sensing applications , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Roland Siegwart,et al.  Point Clouds Registration with Probabilistic Data Association , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Anttoni Jaakkola,et al.  Improved Sampling for Terrestrial and Mobile Laser Scanner Point Cloud Data , 2013, Remote. Sens..

[32]  Olaf Hellwich,et al.  Comparison of 3D interest point detectors and descriptors for point cloud fusion , 2014, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[33]  Mohammed Bennamoun,et al.  On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes , 2009, International Journal of Computer Vision.

[34]  François Pomerleau,et al.  Applied registration for robotics: Methodology and tools for ICP-like algorithms , 2013 .

[35]  Maarten Weyn,et al.  A Survey of Rigid 3D Pointcloud Registration Algorithms , 2014 .

[36]  Javier González,et al.  Scene structure registration for localization and mapping , 2016, Robotics Auton. Syst..

[37]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[38]  Wolfram Burgard,et al.  Point feature extraction on 3D range scans taking into account object boundaries , 2011, 2011 IEEE International Conference on Robotics and Automation.

[39]  Joachim Hertzberg,et al.  Data Handling in Large-Scale Surface Reconstruction , 2014, IAS.

[40]  Yoshihiko Nakamura,et al.  Surface Reconstruction with Sparse Point Clouds of Velodyne® Sensor , 2015 .

[41]  R. Fabio From point cloud to surface the modeling and visualization problem , 2003 .

[42]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[43]  Fabio Remondino From point cloud to surface , 2003 .

[44]  Roland Siegwart,et al.  Comparison of nearest-neighbor-search strategies and implementations for efficient shape registration , 2012 .

[45]  Wolfram Burgard,et al.  Monocular camera localization in 3D LiDAR maps , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..

[47]  Bisheng Yang,et al.  Automatic registration of large-scale urban scene point clouds based on semantic feature points , 2016 .

[48]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[49]  Luís A. Alexandre,et al.  A comparative evaluation of 3D keypoint detectors in a RGB-D Object Dataset , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[50]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[51]  Adam Herout,et al.  Collar Line Segments for fast odometry estimation from Velodyne point clouds , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[52]  Sven Behnke,et al.  Evaluation of registration methods for sparse 3D laser scans , 2015, 2015 European Conference on Mobile Robots (ECMR).

[53]  Jiaolong Yang,et al.  Go-ICP: Solving 3D Registration Efficiently and Globally Optimally , 2013, 2013 IEEE International Conference on Computer Vision.

[54]  Ian T. Jolliffe,et al.  Principal Component Analysis for Special Types of Data , 1986 .

[55]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[56]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[57]  J. Navarro-Pedreño Numerical Methods for Least Squares Problems , 1996 .

[58]  Eduardo Mario Nebot,et al.  Scan-SLAM: Combining EKF-SLAM and Scan Correlation , 2005, FSR.

[59]  ThrunSebastian,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006 .

[60]  Giorgio Grisetti,et al.  NICP: Dense normal based point cloud registration , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[61]  P. R. McAree,et al.  How do ICP variants perform when used for scan matching terrain point clouds? , 2017, Robotics Auton. Syst..

[62]  Rolf Lakaemper,et al.  Fast plane extraction in 3D range data based on line segments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[64]  Roland Siegwart,et al.  A Review of Point Cloud Registration Algorithms for Mobile Robotics , 2015, Found. Trends Robotics.

[65]  Laurent Itti,et al.  Finding planes in LiDAR point clouds for real-time registration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[66]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[67]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[68]  John J. Leonard,et al.  Toward Object-based Place Recognition in Dense RGB-D Maps , 2015 .

[69]  Paul H. J. Kelly,et al.  SLAM++: Simultaneous Localisation and Mapping at the Level of Objects , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Li He,et al.  M2DP: A novel 3D point cloud descriptor and its application in loop closure detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[71]  David A. Clausi,et al.  Mapping, Planning, and Sample Detection Strategies for Autonomous Exploration , 2014, J. Field Robotics.

[72]  Nicolas David,et al.  IMPROVING 3D LIDAR POINT CLOUD REGISTRATION USING OPTIMAL NEIGHBORHOOD KNOWLEDGE , 2012 .

[73]  Johan Forsberg,et al.  Mobile robot navigation using the range-weighted Hough transform , 1995, IEEE Robotics Autom. Mag..

[74]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[75]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.