Robust global registration of point clouds by closed-form solution in the frequency domain

Abstract Point cloud registration is invariably an essential and challenging task in the fields of photogrammetry and computer vision to align multiple point clouds to a united reference frame. In this paper, we propose a novel global registration method using a robust phase correlation method for registration of low-overlapping point clouds, which is less sensitive to noise and outliers than feature-based registration methods. The proposed point cloud registration is achieved by converting the estimation of rotation, scaling, and translation in the spatial domain to a problem of correlating low-frequency components in the frequency domain. Specifically, it consists of three core steps: transformation from the spatial domain to the frequency domain, decoupling of rotation, scaling, and translation, and adapted phase correlation for robust shift estimation. In the first step, unstructured and unordered 3D points are transformed from the spatial domain to the frequency domain via 3D Fourier transformation, following a voxelization and binarization process. In the second step, rotation, scaling, and translation are decoupled by sequential operations, including Fourier transform, resampling strategies, and Fourier-Mellin transform. In the third step, the estimation of transformation parameters is transformed into shift estimation tasks. The shift estimation task is solved by a robust phase correlation method, in which low-frequency components are matched by decomposing the normalized cross-power spectrum and linearly fitting the decomposed signals with a closed-form solution by a l 1-norm-based robust estimator. Experiments were conducted using three different datasets of urban and natural scenarios. Results demonstrate the efficiency of the proposed method, with the majority of rotation and translation errors reaching less than 0.2 degree and 0.5 m, respectively. Additionally, it is also validated by experiments that the proposed method is robust to noise and versatile to datasets with wide ranges of overlaps and various geometric characteristics.

[1]  Uwe Stilla,et al.  Simultaneous Calibration of ALS Systems and Alignment of Multiview LiDAR Scans of Urban Areas , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Nicolas David,et al.  Towards 3D lidar point cloud registration improvement using optimal neighborhood knowledge , 2013 .

[3]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[4]  Xuming Ge,et al.  Surface-based matching of 3D point clouds with variable coordinates in source and target system , 2016 .

[5]  Yusheng Xu,et al.  TUM-MLS-2016: An Annotated Mobile LiDAR Dataset of the TUM City Campus for Semantic Point Cloud Interpretation in Urban Areas , 2020, Remote. Sens..

[6]  Sven Behnke,et al.  Registration with the Point Cloud Library: A Modular Framework for Aligning in 3-D , 2015, IEEE Robotics & Automation Magazine.

[7]  Xuming Ge,et al.  Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets , 2017 .

[8]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Uwe Stilla,et al.  Acquisition and Consecutive Registration of Photogrammetric Point Clouds for Construction Progress Monitoring Using a 4D BIM , 2017, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science.

[10]  Frédéric Bosché,et al.  The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components , 2015 .

[11]  Bisheng Yang,et al.  Automated registration of dense terrestrial laser-scanning point clouds using curves , 2014 .

[12]  Takeo Kanade,et al.  A Correlation-Based Approach to Robust Point Set Registration , 2004, ECCV.

[13]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[14]  Han Hu,et al.  Object-based incremental registration of terrestrial point clouds in an urban environment , 2020 .

[15]  Uwe Stilla,et al.  An Approach to Extract Moving Objects from Mls Data Using a Volumetric Background Representation , 2017 .

[16]  N. Mitra,et al.  4-points congruent sets for robust pairwise surface registration , 2008, SIGGRAPH 2008.

[17]  Rong Huang,et al.  Deep point embedding for urban classification using ALS point clouds: A new perspective from local to global , 2020 .

[18]  Konrad Schindler,et al.  Keypoint-based 4-Points Congruent Sets – Automated marker-less registration of laser scans , 2014 .

[19]  Yusheng Xu,et al.  Pairwise coarse registration of point clouds in urban scenes using voxel-based 4-planes congruent sets , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[20]  Bisheng Yang,et al.  Automatic registration of large-scale urban scene point clouds based on semantic feature points , 2016 .

[21]  R. Berkvens,et al.  A Benchmark Survey of Rigid 3D Point Cloud Registration Algorithms , 2015 .

[22]  Bisheng Yang,et al.  Hierarchical registration of unordered TLS point clouds based on binary shape context descriptor , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[23]  Uwe Stilla,et al.  FAST PAIRWISE COARSE REGISTRATION BETWEEN POINT CLOUDS OF CONSTRUCTION SITES USING 2D PROJECTION BASED PHASE CORRELATION , 2019 .

[24]  Peter Wonka,et al.  PLADE: A Plane-Based Descriptor for Point Cloud Registration With Small Overlap , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Junhao Xiao,et al.  Planar Segment Based Three‐dimensional Point Cloud Registration in Outdoor Environments , 2013, J. Field Robotics.

[26]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[27]  Jiaolong Yang,et al.  Go-ICP: Solving 3D Registration Efficiently and Globally Optimally , 2013, 2013 IEEE International Conference on Computer Vision.

[28]  K. Bang,et al.  A COMPARATIVE ANALYSIS OF TWO APPROACHES FOR MULTIPLE-SURFACE REGISTRATION OF IRREGULAR POINT CLOUDS , 2010 .

[29]  Sébastien Leprince,et al.  Automatic and Precise Orthorectification, Coregistration, and Subpixel Correlation of Satellite Images, Application to Ground Deformation Measurements , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[31]  Rong Huang,et al.  Temporal comparison of construction sites using photogrammetric point cloud sequences and robust phase correlation , 2020 .

[32]  Derek D. Lichti,et al.  A method for automated registration of unorganised point clouds , 2008 .

[33]  Chi Zhou,et al.  V4PCS: Volumetric 4PCS Algorithm for Global Registration , 2017 .

[34]  Uwe Stilla,et al.  AUTOMATED COARSE REGISTRATION OF POINT CLOUDS IN 3D URBAN SCENESUSING VOXEL BASED PLANE CONSTRAINT , 2017 .

[35]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[36]  Bisheng Yang,et al.  Automated Extraction of Building Outlines From Airborne Laser Scanning Point Clouds , 2013, IEEE Geoscience and Remote Sensing Letters.

[37]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Yusheng Xu,et al.  Registration of large-scale terrestrial laser scanner point clouds: A review and benchmark , 2020 .

[39]  Uwe Stilla,et al.  Change detection in urban areas by object-based analysis and on-the-fly comparison of multi-view ALS data , 2013 .

[40]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .