Pairwise coarse registration of point clouds in urban scenes using voxel-based 4-planes congruent sets

Abstract To ensure complete coverage when measuring a large-scale urban area, pairwise registration between point clouds acquired via terrestrial laser scanning or stereo image matching is usually necessary when there is insufficient georeferencing information from additional GNSS and INS sensors. In this paper, we propose a semi-automatic and target-less method for coarse registration of point clouds using geometric constraints of voxel-based 4-plane congruent sets (V4PCS). The planar patches are firstly extracted from voxelized point clouds. Then, the transformation invariant, 4-plane congruent sets are constructed from extracted planar surfaces in each point cloud. Initial transformation parameters between point clouds are estimated via corresponding congruent sets having the highest registration scores in the RANSAC process. Finally, a closed-form solution is performed to achieve optimized transformation parameters by finding all corresponding planar patches using the initial transformation parameters. Experimental results reveal that our proposed method can be effective for registering point clouds acquired from various scenes. A success rate of better than 80% was achieved, with average rotation errors of about 0.5 degrees and average translation errors less than approximately 0.6 m. In addition, our proposed method is more efficient than other baseline methods when using the same hardware and software configuration conditions.

[1]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[2]  Uwe Stilla,et al.  An Approach to Extract Moving Objects from Mls Data Using a Volumetric Background Representation , 2017 .

[3]  Andrea Torsello,et al.  Fast and accurate surface alignment through an isometry-enforcing game , 2015, Pattern Recognit..

[4]  Anath Fischer,et al.  3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Konrad Schindler,et al.  FAST SEMANTIC SEGMENTATION OF 3D POINT CLOUDS WITH STRONGLY VARYING DENSITY , 2016 .

[7]  Ayman Habib,et al.  INTERPOLATION OF LIDAR DATA AND AUTOMATIC BUILDING EXTRACTION , 2002 .

[8]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[9]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[10]  Nadisson Luis Pavan,et al.  A Global Closed-Form Refinement for Consistent TLS Data Registration , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Roland Siegwart,et al.  A Review of Point Cloud Registration Algorithms for Mobile Robotics , 2015, Found. Trends Robotics.

[12]  Bisheng Yang,et al.  Automated registration of dense terrestrial laser-scanning point clouds using curves , 2014 .

[13]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[14]  Hao Xu,et al.  Registration of Laser Scanning Point Clouds: A Review , 2018, Sensors.

[15]  Joseph S. B. Mitchell,et al.  Practical methods for approximate geometric pattern matching under rigid motions: (preliminary version) , 1994, SCG '94.

[16]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Konrad Schindler,et al.  Keypoint-based 4-Points Congruent Sets – Automated marker-less registration of laser scans , 2014 .

[18]  David Belton,et al.  Comparative Study of Automatic Plane Fitting Registration for Mls Sparse Point Clouds with Different Plane Segmentation Methods , 2017 .

[19]  Junhao Xiao,et al.  Planar Segment Based Three‐dimensional Point Cloud Registration in Outdoor Environments , 2013, J. Field Robotics.

[20]  Uwe Stilla,et al.  Learning a constrained conditional random field for enhanced segmentation of fallen trees in ALS point clouds , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[21]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Andreas Nüchter,et al.  Thermal 3D Mapping of Building Façades , 2012, IAS.

[23]  Xuming Ge,et al.  Non-rigid registration of 3D point clouds under isometric deformation , 2016 .

[24]  Quan Li,et al.  Automatic Registration of Terrestrial and Airborne Point Clouds Using Building Outline Features , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Olaf Hellwich,et al.  Automatic registration of unordered point clouds acquired by Kinect sensors using an overlap heuristic , 2015 .

[26]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  Stefan Hinz,et al.  Fast and automatic image-based registration of TLS data , 2011 .

[28]  Bisheng Yang,et al.  Hierarchical registration of unordered TLS point clouds based on binary shape context descriptor , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[29]  Uwe Stilla,et al.  AUTOMATED COARSE REGISTRATION OF POINT CLOUDS IN 3D URBAN SCENESUSING VOXEL BASED PLANE CONSTRAINT , 2017 .

[30]  Junhao Xiao,et al.  3D point cloud registration based on planar surfaces , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[31]  N. Mitra,et al.  4-points congruent sets for robust pairwise surface registration , 2008, SIGGRAPH 2008.

[32]  Ruwen Schnabel,et al.  Efficient point-cloud processing with primitive shapes , 2009 .

[33]  Wolfgang Förstner,et al.  Efficient and Accurate Registration of Point Clouds with Plane to Plane Correspondences , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[34]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[35]  Uwe Stilla,et al.  A FRAMEWORK FOR VOXEL-BASED GLOBAL SCALE MODELING OF URBAN ENVIRONMENTS , 2016 .

[36]  Kourosh Khoshelham,et al.  Automated localization of a laser scanner in indoor environments using planar objects , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[37]  Claus Brenner,et al.  Registration of terrestrial laser scanning data using planar patches and image data , 2006 .

[38]  Sven Behnke,et al.  Registration with the Point Cloud Library: A Modular Framework for Aligning in 3-D , 2015, IEEE Robotics & Automation Magazine.

[39]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[40]  Claus Brenner,et al.  Coarse orientation of terrestrial laser scans in urban environments , 2008 .

[41]  Uwe Stilla,et al.  VOXEL- AND GRAPH-BASED POINT CLOUD SEGMENTATION OF 3D SCENES USING PERCEPTUAL GROUPING LAWS , 2017 .

[42]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[43]  Mohannad Al-Durgham,et al.  A Framework for the Registration and Segmentation of Heterogeneous Lidar Data , 2013 .

[44]  Hongbin Zha,et al.  Automatic registration of range images based on correspondence of complete plane patches , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[45]  Kourosh Khoshelham,et al.  Closed-form solutions for estimating a rigid motion from plane correspondences extracted from point clouds , 2016 .

[46]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[47]  Abdul Nurunnabi,et al.  Robust segmentation for multiple planar surface extraction in laser scanning 3D point cloud data , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[48]  Konrad Schindler,et al.  AUTOMATIC REGISTRATION OF TERRESTRIAL LASER SCANNER POINT CLOUDS USING NATURAL PLANAR SURFACES , 2012 .

[49]  Xuming Ge,et al.  Surface-based matching of 3D point clouds with variable coordinates in source and target system , 2016 .

[50]  Daniele Fontanelli,et al.  A Fast RANSAC-Based Registration Algorithm for Accurate Localization in Unknown Environments using LIDAR Measurements , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[51]  Yi-Ping Hung,et al.  RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Xuming Ge,et al.  Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets , 2017 .

[53]  Bisheng Yang,et al.  Automatic registration of large-scale urban scene point clouds based on semantic feature points , 2016 .

[54]  Mohammed Bennamoun,et al.  An Accurate and Robust Range Image Registration Algorithm for 3D Object Modeling , 2014, IEEE Transactions on Multimedia.

[55]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[56]  Y. Tseng,et al.  Incremental segmentation of lidar point clouds with an octree‐structured voxel space , 2011 .

[57]  J. D. Wegner,et al.  Globally consistent registration of terrestrial laser scans via graph optimization , 2015 .

[58]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[59]  Jonathan Li,et al.  Pairwise registration of TLS point clouds using covariance descriptors and a non-cooperative game , 2017 .

[60]  Arianna Pesci,et al.  A laser scanning-based method for fast estimation of seismic-induced building deformations , 2013 .

[61]  Uwe Stilla,et al.  Voxel Based Segmentation of Large Airborne Topobathymetric LIDAR Data , 2017 .

[62]  Fabio Remondino From point cloud to surface , 2003 .

[63]  M. Menenti,et al.  COARSE POINT CLOUD REGISTRATION BY EGI MATCHING OF VOXEL CLUSTERS , 2016 .

[64]  Michael Hahn,et al.  A DISTANCE-WEIGHTED GRAPH-CUT METHOD FOR THE SEGMENTATION OF LASER POINT CLOUDS , 2014 .

[65]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.