A Tutorial Review on Point Cloud Registrations: Principle, Classification, Comparison, and Technology Challenges

A point cloud as a collection of points is poised to bring about a revolution in acquiring and generating three-dimensional (3D) surface information of an object in 3D reconstruction, industrial inspection, and robotic manipulation. In this revolution, the most challenging but imperative process is point could registration, i.e., obtaining a spatial transformation that aligns and matches two point clouds acquired in two different coordinates. In this survey paper, we present the overview and basic principles, give systematical classification and comparison of various methods, and address existing technical problems in point cloud registration. This review attempts to serve as a tutorial to academic researchers and engineers outside this field and to promote discussion of a unified vision of point cloud registration. The goal is to help readers quickly get into the problems of their interests related to point could registration and to provide them with insights and guidance in finding out appropriate strategies and solutions.

[1]  Wuyong Tao,et al.  Evaluation of the ICP Algorithm in 3D Point Cloud Registration , 2020, IEEE Access.

[2]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Zi Jian Yew,et al.  RPM-Net: Robust Point Matching Using Learned Features , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  L. D. Angelo,et al.  Point , 1977 .

[5]  Elise Lachat,et al.  COMPARISON OF POINT CLOUD REGISTRATION ALGORITHMS FOR BETTER RESULT ASSESSMENT – TOWARDS AN OPEN-SOURCE SOLUTION , 2018 .

[6]  Mohammed Elmogy,et al.  3D Object Recognition Based on Local and Global Features Using Point Cloud Library , 2015 .

[7]  Roland Siegwart,et al.  A Review of Point Cloud Registration Algorithms for Mobile Robotics , 2015, Found. Trends Robotics.

[8]  Chen Feng,et al.  Fast Resampling of Three-Dimensional Point Clouds via Graphs , 2017, IEEE Transactions on Signal Processing.

[9]  Qiang Wu,et al.  A Coarse-to-Fine Algorithm for Matching and Registration in 3D Cross-Source Point Clouds , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Songhwai Oh,et al.  Graph-matching-based correspondence search for nonrigid point cloud registration , 2020, Comput. Vis. Image Underst..

[11]  Philippe Bonnifait,et al.  LiDAR based relative pose and covariance estimation for communicating vehicles exchanging a polygonal model of their shape , 2018 .

[12]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  Martin Mokros,et al.  Processing Chain for Estimation of Tree Diameter from GNSS-IMU-Based Mobile Laser Scanning Data , 2019, Remote. Sens..

[14]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[15]  Beiwen Li,et al.  Structured Light Techniques and Applications , 2016 .

[16]  H. Chui,et al.  A feature registration framework using mixture models , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[17]  Tom Drummond,et al.  Robust egomotion estimation using ICP in inverse depth coordinates , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Howie Choset,et al.  PCRNet: Point Cloud Registration Network using PointNet Encoding , 2019, ArXiv.

[19]  Hyunki Hong,et al.  Key-layered normal distributions transform for point cloud registration , 2015 .

[20]  Wei Jiang,et al.  A comprehensive review of 3D point cloud descriptors , 2018, ArXiv.

[21]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Aiguo Song,et al.  3D-point-cloud registration and real-world dynamic modelling-based virtual environment building method for teleoperation , 2016, Robotica.

[23]  Hubert Cecotti,et al.  Active graph based semi-supervised learning using image matching: Application to handwritten digit recognition , 2016, Pattern Recognit. Lett..

[24]  Ping Tan,et al.  BA-Net: Dense Bundle Adjustment Network , 2018, ICLR 2018.

[25]  Xiaorong Gao,et al.  An accelerated ICP registration algorithm for 3D point cloud data , 2019, International Symposium on Advanced Optical Manufacturing and Testing Technologies (AOMATT).

[26]  Jiayi Ma,et al.  A review of multimodal image matching: Methods and applications , 2021, Inf. Fusion.

[27]  Peter Johannes Neugebauer,et al.  Geometrical cloning of 3D objects via simultaneous registration of multiple range images , 1997, Proceedings of 1997 International Conference on Shape Modeling and Applications.

[28]  Sylvain Prima,et al.  An efficient EM-ICP algorithm for non-linear registration of large 3D point sets , 2020, Comput. Vis. Image Underst..

[29]  Yasuhiro Aoki,et al.  PointNetLK: Robust & Efficient Point Cloud Registration Using PointNet , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[31]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[32]  Pierre Alliez,et al.  State of the Art in Surface Reconstruction from Point Clouds , 2014, Eurographics.

[33]  Yo-Sung Ho,et al.  High-Precision 3D Coarse Registration Using RANSAC and Randomly-Picked Rejections , 2018, MMM.

[34]  Jian Zhao,et al.  Accelerated Coherent Point Drift for Automatic Three-Dimensional Point Cloud Registration , 2016, IEEE Geoscience and Remote Sensing Letters.

[35]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[36]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Heinrich Niemann,et al.  A refined ICP algorithm for robust 3-D correspondence estimation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[38]  Jiaolong Yang,et al.  Go-ICP: Solving 3D Registration Efficiently and Globally Optimally , 2013, 2013 IEEE International Conference on Computer Vision.

[39]  A. Ullrich,et al.  Noisy lidar point clouds: impact on information extraction in high-precision lidar surveying , 2018, Defense + Security.

[40]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[41]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[42]  K. Ikeuchi,et al.  Robust Simultaneous Registration of Multiple Range Images , 2008 .

[43]  Alan L. Yuille,et al.  Non-Rigid Point Set Registration by Preserving Global and Local Structures , 2016, IEEE Transactions on Image Processing.

[44]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[45]  Philippe Giguère,et al.  Mapping forests using an unmanned ground vehicle with 3D LiDAR and graph-SLAM , 2018, Comput. Electron. Agric..

[46]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[47]  Matthias Nießner,et al.  3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Alberto L. Sangiovanni-Vincentelli,et al.  A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving , 2018, ICMR.

[49]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[50]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Jan Kautz,et al.  Fast and Accurate Point Cloud Registration using Trees of Gaussian Mixtures , 2018, ArXiv.

[52]  Guilherme N. DeSouza,et al.  Local-to-Global Signature Descriptor for 3D Object Recognition , 2014, ACCV Workshops.

[53]  Vladlen Koltun,et al.  Open3D: A Modern Library for 3D Data Processing , 2018, ArXiv.

[54]  Michael J. Black,et al.  Dynamic FAUST: Registering Human Bodies in Motion , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Lu Jun,et al.  Point cloud registration algorithm based on NDT with variable size voxel , 2015, 2015 34th Chinese Control Conference (CCC).

[56]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[57]  Alexander M. Bronstein,et al.  Intel® RealSense™ SR300 Coded Light Depth Camera , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Nico Blodow,et al.  Learning informative point classes for the acquisition of object model maps , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[59]  Wei Li,et al.  3D scene reconstruction based on improved ICP algorithm , 2020, Microprocess. Microsystems.

[60]  J. Skaloud,et al.  Accuracy Estimation for Laser Point Cloud Including Scanning Geometry , 2007 .

[61]  Konrad Schindler,et al.  Keypoint-based 4-Points Congruent Sets – Automated marker-less registration of laser scans , 2014 .

[62]  Yue Wang,et al.  PRNet: Self-Supervised Learning for Partial-to-Partial Registration , 2019, NeurIPS.

[63]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Luís A. Alexandre.  3D Descriptors for Object and Category Recognition: a Comparative Evaluation , 2012 .

[65]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[66]  Maarten Weyn,et al.  A Survey of Rigid 3D Pointcloud Registration Algorithms , 2014 .

[67]  Sungshin Kim,et al.  Indoor SLAM application using geometric and ICP matching methods based on line features , 2018, Robotics Auton. Syst..

[68]  Pingkun Yan,et al.  Deep learning in medical image registration: a survey , 2020, Machine Vision and Applications.

[69]  Ronen Basri,et al.  A Survey on Structure from Motion , 2017, ArXiv.

[70]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[71]  Frédéric Precioso,et al.  KPPF: Keypoint-Based Point-Pair-Feature for Scalable Automatic Global Registration of Large RGB-D Scans , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[72]  Quan Z. Sheng,et al.  Nonrigid Point Set Registration With Robust Transformation Learning Under Manifold Regularization , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[73]  Mohamed A. Deriche,et al.  3D registration using a new implementation of the ICP algorithm based on a comprehensive lookup matrix: Application to medical imaging , 2007, Pattern Recognit. Lett..

[74]  Wilfried Philips,et al.  Consistent ICP for the registration of sparse and inhomogeneous point clouds , 2016, 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE).

[75]  Xian-Feng Han,et al.  3D Point Cloud Descriptors in Hand-crafted and Deep Learning Age: State-of-the-Art. , 2018 .