A decentralized framework for simultaneous calibration, localization and mapping with multiple LiDARs

LiDAR is playing a more and more essential role in autonomous driving vehicles for objection detection, self localization and mapping. A single LiDAR frequently suffers from hardware failure (e.g., temporary loss of connection) due to the harsh vehicle environment (e.g., temperature, vibration, etc.), or performance degradation due to the lack of sufficient geometry features, especially for solid-state LiDARs with small field of view (FoV). To improve the system robustness and performance in self-localization and mapping, we develop a decentralized framework for simultaneous calibration, localization and mapping with multiple LiDARs. Our proposed framework is based on an extended Kalman filter (EKF), but is specially formulated for decentralized implementation. Such an implementation could potentially distribute the intensive computation among smaller computing devices or resources dedicated for each LiDAR and remove the single point of failure problem. Then this decentralized formulation is implemented on an unmanned ground vehicle (UGV) carrying 5 low-cost LiDARs and moving at $1.3m/s$ in urban environments. Experiment results show that the proposed method can successfully and simultaneously estimate the vehicle state (i.e., pose and velocity) and all LiDAR extrinsic parameters. The localization accuracy is up to 0.2% on the two datasets we collected. To share our findings and to make contributions to the community, meanwhile enable the readers to verify our work, we will release all our source codes and hardware design blueprint on our Github.

[1]  Sei Ikeda,et al.  Visual SLAM algorithms: a survey from 2010 to 2016 , 2017, IPSJ Transactions on Computer Vision and Applications.

[2]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Muhammad Sualeh,et al.  Dynamic Multi-LiDAR Based Multiple Object Detection and Tracking , 2019, Sensors.

[4]  Philippe Giguère,et al.  Mapping forests using an unmanned ground vehicle with 3D LiDAR and graph-SLAM , 2018, Comput. Electron. Agric..

[5]  Roland Siegwart,et al.  A robust and modular multi-sensor fusion approach applied to MAV navigation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Michael Bosse,et al.  Zebedee: Design of a Spring-Mounted 3-D Range Sensor with Application to Mobile Mapping , 2012, IEEE Transactions on Robotics.

[7]  S. Moretti,et al.  Permanent Scatterers for landslide investigations: outcomes from the ESA-SLAM project , 2006 .

[8]  Kikuo Fujimura,et al.  An Online Multi-lidar Dynamic Occupancy Mapping Method , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[9]  Fu Zhang,et al.  A fast, complete, point cloud based loop closure for LiDAR odometry and mapping , 2019, ArXiv.

[10]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Petra M. Klein,et al.  Testing and validation of multi‐lidar scanning strategies for wind energy applications , 2016 .

[12]  Shuqing Zeng A Tracking System of Multiple LiDAR Sensors Using Scan Point Matching , 2013, IEEE Transactions on Vehicular Technology.

[13]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[14]  Sebastian Thrun,et al.  Unsupervised Calibration for Multi-beam Lasers , 2010, ISER.

[15]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[16]  Juan I. Nieto,et al.  Motion-Based Calibration of Multimodal Sensor Extrinsics and Timing Offset Estimation , 2016, IEEE Transactions on Robotics.

[17]  Xu Dongliang,et al.  SLAM Algorithm Analysis of Mobile Robot Based on Lidar , 2019, 2019 Chinese Control Conference (CCC).

[18]  Fei Gao,et al.  Flying on point clouds: Online trajectory generation and autonomous navigation for quadrotors in cluttered environments , 2018, J. Field Robotics.

[19]  Roland Siegwart,et al.  Keyframe-Based Visual-Inertial SLAM using Nonlinear Optimization , 2013, Robotics: Science and Systems.

[20]  Michael Harris,et al.  Characterization of Aircraft Wake Vortices by Multiple-Lidar Triangulation , 2003 .

[21]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[22]  Simon Lacroix,et al.  Calibration of a rotating multi-beam lidar , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[24]  Jiarong Lin,et al.  Loam livox: A fast, robust, high-precision LiDAR odometry and mapping package for LiDARs of small FoV , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.