GACM: A Graph Attention Capsule Model for the Registration of TLS Point Clouds in the Urban Scene

Point cloud registration is the foundation and key step for many vital applications, such as digital city, autonomous driving, passive positioning, and navigation. The difference of spatial objects and the structure complexity of object surfaces are the main challenges for the registration problem. In this paper, we propose a graph attention capsule model (named as GACM) for the efficient registration of terrestrial laser scanning (TLS) point cloud in the urban scene, which fuses graph attention convolution and a three-dimensional (3D) capsule network to extract local point cloud features and obtain 3D feature descriptors. These descriptors can take into account the differences of spatial structure and point density in objects and make the spatial features of ground objects more prominent. During the training progress, we used both matched points and non-matched points to train the model. In the test process of the registration, the points in the neighborhood of each keypoint were sent to the trained network, in order to obtain feature descriptors and calculate the rotation and translation matrix after constructing a K-dimensional (KD) tree and random sample consensus (RANSAC) algorithm. Experiments show that the proposed method achieves more efficient registration results and higher robustness than other frontier registration methods in the pairwise registration of point clouds.

[1]  Han Hu,et al.  Object-based incremental registration of terrestrial point clouds in an urban environment , 2020 .

[2]  Zhiguo Cao,et al.  Learning to Fuse Local Geometric Features for 3D Rigid Data Matching , 2019, Inf. Fusion.

[3]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[4]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[5]  M. Nilsson,et al.  A nationwide forest attribute map of Sweden predicted using airborne laser scanning data and field data from the National Forest Inventory , 2017 .

[6]  Roland Siegwart,et al.  Challenging data sets for point cloud registration algorithms , 2012, Int. J. Robotics Res..

[7]  Nicolas David,et al.  Towards 3D lidar point cloud registration improvement using optimal neighborhood knowledge , 2013 .

[8]  Hao Xu,et al.  Registration of Laser Scanning Point Clouds: A Review , 2018, Sensors.

[9]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[10]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[11]  Derek D. Lichti,et al.  A method for automated registration of unorganised point clouds , 2008 .

[12]  E. G. Parmehr,et al.  Automatic registration of optical imagery with 3D LiDAR data using statistical similarity , 2014 .

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Christophe Girot,et al.  Point cloud modeling as a bridge between landscape design and planning , 2020 .

[15]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[16]  N. Mitra,et al.  4-points congruent sets for robust pairwise surface registration , 2008, SIGGRAPH 2008.

[17]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.