Large-Scale LiDAR SLAM with Factor Graph Optimization on High-Level Geometric Features

Although visual SLAM (simultaneous localization and mapping) methods obtain very accurate results using optimization of residual errors defined with respect to the matching features, the SLAM systems based on 3-D laser (LiDAR) data commonly employ variants of the iterative closest points algorithm and raw point clouds as the map representation. However, it is possible to extract from point clouds features that are more spatially extended and more meaningful than points: line segments and/or planar patches. In particular, such features provide a natural way to represent human-made environments, such as urban and mixed indoor/outdoor scenes. In this paper, we perform an analysis of the advantages of a LiDAR-based SLAM that employs high-level geometric features in large-scale urban environments. We present a new approach to the LiDAR SLAM that uses planar patches and line segments for map representation and employs factor graph optimization typical to state-of-the-art visual SLAM for the final map and trajectory optimization. The new map structure and matching of features make it possible to implement in our system an efficient loop closure method, which exploits learned descriptors for place recognition and factor graph for optimization. With these improvements, the overall software structure is based on the proven LOAM concept to ensure real-time operation. A series of experiments were performed to compare the proposed solution to the open-source LOAM, considering different approaches to loop closure computation. The results are compared using standard metrics of trajectory accuracy, focusing on the final quality of the estimated trajectory and the consistency of the environment map. With some well-discussed reservations, our results demonstrate the gains due to using the high-level features in the full-optimization approach in the large-scale LiDAR SLAM.

[1]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Adrien Bartoli On the Non-linear Optimization of Projective Motion Using Minimal Parameters , 2002, ECCV.

[4]  Roland Siegwart,et al.  A Review of Point Cloud Registration Algorithms for Mobile Robotics , 2015, Found. Trends Robotics.

[5]  Jinyong Jeong,et al.  MulRan: Multimodal Range Dataset for Urban Place Recognition , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Joachim Hertzberg,et al.  Benchmarking urban six‐degree‐of‐freedom simultaneous localization and mapping , 2008, J. Field Robotics.

[7]  Sven Behnke,et al.  Efficient Continuous-Time SLAM for 3D Lidar-Based Online Mapping , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Younggun Cho,et al.  Unsupervised Geometry-Aware Deep LiDAR Odometry , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Hua Zhu,et al.  Efficient Laser-Based 3D SLAM in Real Time for Coal Mine Rescue Robots , 2018, 2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).

[10]  Lin Zuo,et al.  LLOAM: LiDAR Odometry and Mapping with Loop-closure Detection Based Correction , 2019, 2019 IEEE International Conference on Mechatronics and Automation (ICMA).

[11]  Ji Zhang,et al.  Low-drift and real-time lidar odometry and mapping , 2017, Auton. Robots.

[12]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Aleksandr V. Segal,et al.  Generalized-ICP , 2009, Robotics: Science and Systems.

[14]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[15]  Michal R. Nowicki,et al.  Planar Features for Accurate Laser-Based 3-D SLAM in Urban Environments , 2020, KKA.

[16]  Sridha Sridharan,et al.  Elastic LiDAR Fusion: Dense Map-Centric Continuous-Time SLAM , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Jean-Emmanuel Deschaud,et al.  IMLS-SLAM: Scan-to-Model Matching Based on 3D Data , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[18]  You Li,et al.  Lidar for Autonomous Driving: The Principles, Challenges, and Trends for Automotive Lidar and Perception Systems , 2020, IEEE Signal Processing Magazine.

[19]  Andreas Nüchter,et al.  Automatic Appearance-Based Loop Detection from 3 D Laser Data Using the Normal Distributions Transform , 2009 .

[20]  Andreas Birk,et al.  Fast Registration Based on Noisy Planes With Unknown Correspondences for 3-D Mapping , 2010, IEEE Transactions on Robotics.

[21]  C. Qi Deep Learning on Point Sets for 3 D Classification and Segmentation , 2016 .

[22]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Dietrich Paulus,et al.  MC2SLAM: Real-Time Inertial Lidar Odometry Using Two-Scan Motion Compensation , 2018, GCPR.

[24]  Wei Jiang,et al.  A comprehensive review of 3D point cloud descriptors , 2018, ArXiv.

[25]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[26]  Andreas Birk,et al.  Online three‐dimensional SLAM by registration of large planar surface segments and closed‐form pose‐graph relaxation , 2010, J. Field Robotics.

[27]  Ting Hu,et al.  Deep Learning on Point Clouds and Its Application: A Survey , 2019, Sensors.

[28]  Kurt Konolige,et al.  Sparse Sparse Bundle Adjustment , 2010, BMVC.

[29]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[30]  Stefan Leutenegger,et al.  ElasticFusion: Dense SLAM Without A Pose Graph , 2015, Robotics: Science and Systems.

[31]  Christoph Stiller,et al.  Velodyne SLAM , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[32]  Samuel R. Buss,et al.  Spherical averages and applications to spherical splines and interpolation , 2001, TOGS.

[33]  Laurent Itti,et al.  Efficient Velodyne SLAM with point and plane features , 2018, Autonomous Robots.

[34]  Richard Elvira,et al.  ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM , 2021, IEEE Transactions on Robotics.

[35]  Cyrill Stachniss,et al.  Efficient Surfel-Based SLAM using 3D Laser Range Data in Urban Environments , 2018, Robotics: Science and Systems.

[36]  Roland Siegwart,et al.  3D SLAM using planar segments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Hannes Sommer,et al.  SegMap: Segment-based mapping and localization using data-driven descriptors , 2019, Int. J. Robotics Res..

[38]  Andreas Nüchter,et al.  Non-rigid registration and rectification of 3D laser scans , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Shenhua Hou,et al.  L3-Net: Towards Learning Based LiDAR Localization for Autonomous Driving , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Adam Herout,et al.  CNN for IMU assisted odometry estimation using velodyne LiDAR , 2017, 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[41]  Achim J. Lilienthal,et al.  Fast and accurate scan registration through minimization of the distance between compact 3D NDT representations , 2012, Int. J. Robotics Res..

[42]  UmeyamaShinji Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991 .

[43]  Frank E. Schneider,et al.  Benchmark of 6D SLAM (6D Simultaneous Localisation and Mapping) Algorithms with Robotic Mobile Mapping Systems , 2017 .

[44]  Piotr Skrzypczynski,et al.  Mobile Robot Localization: Where We Are and What Are the Challenges? , 2017, AUTOMATION.

[45]  Sebastien Glaser,et al.  Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving , 2017, IEEE Transactions on Intelligent Vehicles.

[46]  Lei Zhang,et al.  Optimized LOAM Using Ground Plane Constraints and SegMatch-Based Loop Detection , 2019, Sensors.

[47]  Renaud Dubé,et al.  SegMatch: Segment based place recognition in 3D point clouds , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[48]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[49]  Simon Lacroix,et al.  ICP-based pose-graph SLAM , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[50]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.