D-LC-Nets: Robust Denoising and Loop Closing Networks for LiDAR SLAM in Complicated Circumstances with Noisy Point Clouds

The current LiDAR SLAM (Simultaneous Localization and Mapping) system suffers greatly from low accuracy and limited robustness when faced with complicated circumstances. From our experiments, we find that current LiDAR SLAM systems have limited performance when the noise level in the obtained point clouds is large. Therefore, in this work, we propose a general framework to tackle the problem of denoising and loop closure for LiDAR SLAM in complex environments with many noises and outliers caused by reflective materials. Current approaches for point clouds denoising are mainly designed for small-scale point clouds and can not be extended to large-scale point clouds scenes. In this work, we firstly proposed a lightweight network for large-scale point clouds denoising. Subsequently, we have also designed an efficient loop closure network for place recognition in global optimization to improve the localization accuracy of the whole system. Finally, we have demonstrated by extensive experiments and benchmark studies that our method can have a significant boost on the localization accuracy of the LiDAR SLAM system when faced with noisy point clouds, with a marginal increase in computational cost.

[1]  F. Lin,et al.  FG-Net: A Fast and Accurate Framework for Large-Scale LiDAR Point Cloud Understanding , 2022, IEEE Transactions on Cybernetics.

[2]  Jun Wang,et al.  GeoDualCNN: Geometry-Supporting Dual Convolutional Neural Network for Noisy Point Clouds , 2021, IEEE Transactions on Visualization and Computer Graphics.

[3]  Kangcheng Liu Robust Industrial UAV/UGV-Based Unsupervised Domain Adaptive Crack Recognitions with Depth and Edge Awareness: From System and Database Constructions to Real-Site Inspections , 2022, ACM Multimedia.

[4]  Kangcheng Liu A Robust and Efficient LiDAR-Inertial-Visual Fused Simultaneous Localization and Mapping System with Loop Closure , 2022, 2022 12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).

[5]  Kangcheng Liu Semi-Supervised Confidence-Level-based Contrastive Discrimination for Class-Imbalanced Semantic Segmentation , 2022, 2022 12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).

[6]  Kangcheng Liu,et al.  A Light-Weight LiDAR-Inertial SLAM System with High Efficiency and Loop Closure Detection Capacity , 2022, 2022 International Conference on Advanced Robotics and Mechatronics (ICARM).

[7]  Ben M. Chen,et al.  An Enhanced LiDAR Inertial Localization and Mapping System for Unmanned Ground Vehicles , 2022, 2022 IEEE 17th International Conference on Control & Automation (ICCA).

[8]  Ben M. Chen,et al.  An Integrated Visual System for Unmanned Aerial Vehicles Following Ground Vehicles: Simulations and Experiments , 2022, 2022 IEEE 17th International Conference on Control & Automation (ICCA).

[9]  Z. Gao,et al.  WeakLabel3D-Net: A Complete Framework for Real-Scene LiDAR Point Clouds Weakly Supervised Multi-Tasks Understanding , 2022, 2022 International Conference on Robotics and Automation (ICRA).

[10]  Ayoung Kim,et al.  Scan Context++: Structural Place Recognition Robust to Rotation and Lateral Variations in Urban Environments , 2021, IEEE Transactions on Robotics.

[11]  Renjie Liao,et al.  GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Z. Gao,et al.  Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination , 2022, ECCV.

[13]  Dahua Lin,et al.  Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completion , 2021, ArXiv.

[14]  Shitong Luo,et al.  Score-Based Point Cloud Denoising , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Ben M. Chen,et al.  FG-Conv: Large-Scale LiDAR Point Clouds Understanding Leveraging Feature Correlation Mining and Geometric-Aware Modeling , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Wei Xu,et al.  FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter , 2020, IEEE Robotics and Automation Letters.

[17]  Ben M. Chen,et al.  FG-Net: Fast Large-Scale LiDAR Point CloudsUnderstanding Network Leveraging CorrelatedFeature Mining and Geometric-Aware Modelling , 2020, ArXiv.

[18]  Zhang Yujia,et al.  Legacy Photo Editing with Learned Noise Prior , 2020, 2011.11309.

[19]  Cyrill Stachniss,et al.  OverlapNet: Loop Closing for LiDAR-based SLAM , 2020, Robotics: Science and Systems.

[20]  Wei Wang,et al.  LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Tomasz Malisiewicz,et al.  SuperGlue: Learning Feature Matching With Graph Neural Networks , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jiarong Lin,et al.  Loam livox: A fast, robust, high-precision LiDAR odometry and mapping package for LiDARs of small FoV , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Maks Ovsjanikov,et al.  PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Clouds , 2019, Comput. Graph. Forum.

[24]  Gene Cheung,et al.  3D Point Cloud Denoising Using Graph Laplacian Regularization of a Low Dimensional Manifold Model , 2018, IEEE Transactions on Image Processing.

[25]  Ben M. Chen,et al.  Deep Learning Based Automatic Crack Detection and Segmentation for Unmanned Aerial Vehicle Inspections , 2019, 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[26]  Cyrill Stachniss,et al.  SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[27]  Hesheng Wang,et al.  LPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[28]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Hak-Man Kim,et al.  Avoiding Frequency Second Dip in Power Unreserved Control During Wind Power Rotational Speed Recovery , 2018, IEEE Transactions on Power Systems.

[30]  Matthias Nießner,et al.  ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Armin B. Cremers,et al.  Efficient radius neighbor search in three-dimensional point clouds , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[35]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[37]  Xiaopeng Zhang Curvature Estimation of 3D Point Cloud Surfaces Through the Fitting of Normal Section Curvatures , 2008 .

[38]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.