Review on Deep Learning Algorithms and Benchmark Datasets for Pairwise Global Point Cloud Registration

Point cloud registration is the process of aligning point clouds collected at different locations of the same scene, which transforms the data into a common coordinate system and forms an integrated dataset. It is a fundamental task before the application of point cloud data. Recent years have witnessed the rapid development of various deep-learning-based global registration methods to improve performance. Therefore, it is appropriate to carry out a comprehensive review of the more recent developments in this area. As the developments require access to large benchmark point cloud datasets, the most widely used public datasets are also reviewed. The performance of deep-learning-based registration methods on the benchmark datasets are summarized using the reported performance metrics in the literature. This forms part of a critical discussion of the strengths and weaknesses of the various methods considered in this article, which supports presentation of the main challenges currently faced in typical global point cloud registration tasks that use deep learning methods. Recommendations for potential future studies on this topic are provided.

[1]  Fengli Zhang,et al.  Automatic Registration of Homogeneous and Cross-Source TomoSAR Point Clouds in Urban Areas , 2023, Italian National Conference on Sensors.

[2]  S. Du,et al.  STORM: Structure-Based Overlap Matching for Partial Point Cloud Registration , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  D. Boscaini,et al.  Learning General and Distinctive 3D Local Deep Descriptors for Point Cloud Registration , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  L. Fan,et al.  Point cloud registration: a mini-review of current state, challenging issues and future directions , 2023, AIMS Geosciences.

[5]  Yujie Li,et al.  Global-PBNet: A Novel Point Cloud Registration for Autonomous Driving , 2022, IEEE Transactions on Intelligent Transportation Systems.

[6]  Yucheng Wang,et al.  Robust real-world point cloud registration by inlier detection , 2022, Comput. Vis. Image Underst..

[7]  Csaba Benedek,et al.  Point cloud registration and change detection in urban environment using an onboard Lidar sensor and MLS reference data , 2022, Int. J. Appl. Earth Obs. Geoinformation.

[8]  Mingyi He,et al.  VRNet: Learning the Rectified Virtual Corresponding Points for 3D Point Cloud Registration , 2022, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  H. Seo,et al.  Displacement analysis of point cloud removed ground collapse effect in SMW by CANUPO machine learning algorithm , 2022, Journal of Civil Structural Health Monitoring.

[10]  Weiming Shen,et al.  A novel partial point cloud registration method based on graph attention network , 2022, The Visual Computer.

[11]  Mehrdad Dianati,et al.  Fast and Robust Registration of Partially Overlapping Point Clouds , 2021, IEEE Robotics and Automation Letters.

[12]  Zhen Dong,et al.  You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptors , 2021, ACM Multimedia.

[13]  Rong Huang,et al.  Pairwise Point Cloud Registration Using Graph Matching and Rotation-Invariant Features , 2021, IEEE Geoscience and Remote Sensing Letters.

[14]  C.-C. Jay Kuo,et al.  R-PointHop: A Green, Accurate, and Unsupervised Point Cloud Registration Method , 2021, IEEE Transactions on Image Processing.

[15]  Hongyuan Wang,et al.  Multi-features guidance network for partial-to-partial point cloud registration , 2020, Neural Computing and Applications.

[16]  Inwook Shim,et al.  Geometry Guided Network for Point Cloud Registration , 2021, IEEE Robotics and Automation Letters.

[17]  Lei Fan,et al.  An Efficient Approach to Automatic Construction of 3D Watertight Geometry of Buildings Using Point Clouds , 2021, Remote. Sens..

[18]  Guoliang Chen,et al.  DDRNet: Fast point cloud registration network for large-scale scenes , 2021 .

[19]  Edyta Puniach,et al.  Determination of underground mining-induced displacement field using multi-temporal TLS point cloud registration , 2021 .

[20]  M. Fallon,et al.  SKD: Keypoint Detection for Point Clouds Using Saliency Estimation , 2021, IEEE Robotics and Automation Letters.

[21]  Danping Zou,et al.  Learning-based Point Cloud Registration: A Short Review and Evaluation , 2021, AIEE.

[22]  Augusto Luis Ballardini,et al.  A Benchmark for Point Clouds Registration Algorithms , 2020, Robotics Auton. Syst..

[23]  Yuchao Dai,et al.  Deep learning based point cloud registration: an overview , 2020, Virtual Real. Intell. Hardw..

[24]  Yusheng Xu,et al.  Registration of large-scale terrestrial laser scanner point clouds: A review and benchmark , 2020 .

[25]  Robert B. Fisher,et al.  When Deep Learning Meets Data Alignment: A Review on Deep Registration Networks (DRNs) , 2020, Applied Sciences.

[26]  Yanning Zhang,et al.  Evaluating Local Geometric Feature Representations for 3D Rigid Data Matching , 2019, IEEE Transactions on Image Processing.

[27]  Haluk Ozener,et al.  A Case Study of Deformation Measurements of Istanbul Land Walls via Terrestrial Laser Scanning , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Huosheng Hu,et al.  Automatic Generation of Synthetic LiDAR Point Clouds for 3-D Data Analysis , 2019, IEEE Transactions on Instrumentation and Measurement.

[29]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[30]  Ruigang Yang,et al.  Simulating LIDAR Point Cloud for Autonomous Driving using Real-world Scenes and Traffic Flows , 2018, ArXiv.

[31]  N. Coops,et al.  Characterizing understory vegetation in Mediterranean forests using full-waveform airborne laser scanning data , 2018, Remote Sensing of Environment.

[32]  Xiangyun Hu,et al.  Deep fusion of multi-view and multimodal representation of ALS point cloud for 3D terrain scene recognition , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[33]  Hao Xu,et al.  Registration of Laser Scanning Point Clouds: A Review , 2018, Sensors.

[34]  Jie Ma,et al.  Local voxelized structure for 3D binary feature representation and robust registration of point clouds from low-cost sensors , 2018, Inf. Sci..

[35]  Ma,et al.  Automated and Efficient Extraction of Highway Tunnel Lining Cross-sections Using Terrestrial Laser Scanning ( TLS ) , 2018 .

[36]  M. P. McGuire,et al.  Application of Terrestrial Lidar and Photogrammetry to the As-Built Verification and Displacement Monitoring of a Segmental Retaining Wall , 2017 .

[37]  Paul Newman,et al.  1 year, 1000 km: The Oxford RobotCar dataset , 2017, Int. J. Robotics Res..

[38]  Kutalmis Gumus,et al.  A Statistical Evaluation Of Registration Methods Used In Terrestrial Laser Scanning In Cultural Heritage Applications , 2017 .

[39]  Su Yang,et al.  A New Method of Gold Foil Damage Detection in Stone Carving Relics Based on Multi-Temporal 3D LiDAR Point Clouds , 2016, ISPRS Int. J. Geo Inf..

[40]  M. C. Lee,et al.  Finding the displacement of wood structure in heritage building by 3D laser scanner , 2015 .

[41]  Roland Siegwart,et al.  A Review of Point Cloud Registration Algorithms for Mobile Robotics , 2015, Found. Trends Robotics.

[42]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[43]  D. Lague,et al.  Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z) , 2013, 1302.1183.

[44]  Roland Siegwart,et al.  Challenging data sets for point cloud registration algorithms , 2012, Int. J. Robotics Res..

[45]  O. Sass,et al.  Combining airborne and terrestrial laser scanning for quantifying erosion and deposition by a debris flow event , 2012 .

[46]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2011 .

[47]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[48]  M. O'Neal,et al.  The rates and spatial patterns of annual riverbank erosion revealed through terrestrial laser‐scanner surveys of the South River, Virginia , 2011 .

[49]  Enzo Boschi,et al.  Laser scanning the Garisenda and Asinelli towers in Bologna (Italy): Detailed deformation patterns of two ancient leaning buildings , 2011 .

[50]  Federico Tombari,et al.  Unique shape context for 3d data description , 2010, 3DOR '10.

[51]  Murat Yakar,et al.  Comparative Evaluation of Excavation Volume by TLS and Total Topographic Station Based Methods , 2010 .

[52]  Ludo Waltman,et al.  Software survey: VOSviewer, a computer program for bibliometric mapping , 2009, Scientometrics.

[53]  Youssef M A Hashash,et al.  Integration of Construction As-Built Data Via Laser Scanning with Geotechnical Monitoring of Urban Excavation , 2006 .

[54]  Youssef M A Hashash,et al.  3D laser scanning for tracking supported excavation construction , 2005 .

[55]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[56]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .