Automatic Calibration of Multiple 3D LiDARs in Urban Environments

Multiple LiDARs have progressively emerged on autonomous vehicles for rendering a rich view and dense measurements. However, the lack of precise calibration negatively affects their potential applications. In this paper, we propose a novel system that enables automatic multi-LiDAR calibration method without any calibration target, prior environment information, and manual initialization. Our approach starts with a hand-eye calibration by aligning the motion of each sensor. The initial results are then refined by an appearance-based method by minimizing a cost function constructed by point-plane distance. Experimental results on simulated and real-world data demonstrate the reliability and accuracy of our calibration approach. The proposed approach can calibrate a multi-LiDAR system with the rotation and translation errors less than 0. 04rad and 0. 1m respectively for a mobile platform.

[1]  Sebastian Thrun,et al.  Automatic Online Calibration of Cameras and Lasers , 2013, Robotics: Science and Systems.

[2]  Marcelo H. Ang,et al.  A General Pipeline for 3D Detection of Vehicles , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Hongbin Zha,et al.  Calibration method for multiple 2D LIDARs system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Shaojie Shen,et al.  VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator , 2017, IEEE Transactions on Robotics.

[6]  Silvio Savarese,et al.  Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information , 2012, AAAI.

[7]  Yuan Wang,et al.  Focal Loss in 3D Object Detection , 2018, IEEE Robotics and Automation Letters.

[8]  Yang Yu,et al.  A Novel Dual-Lidar Calibration Algorithm Using Planar Surfaces , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[9]  Shaojie Shen,et al.  Online Temporal Calibration for Monocular Visual-Inertial Systems , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[11]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[12]  Juan I. Nieto,et al.  Motion-Based Calibration of Multimodal Sensor Extrinsics and Timing Offset Estimation , 2016, IEEE Transactions on Robotics.

[13]  Cyrill Stachniss,et al.  Efficient Surfel-Based SLAM using 3D Laser Range Data in Urban Environments , 2018, Robotics: Science and Systems.

[14]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[15]  W. Kabsch.  A discussion of the solution for the best rotation to relate two sets of vectors , 1978 .

[16]  Juan I. Nieto,et al.  Motion-based calibration of multimodal sensor arrays , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Hongbin Zha,et al.  Pairwise LIDAR calibration using multi-type 3D geometric features in natural scene , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Juan I. Nieto,et al.  A mutual information approach to automatic calibration of camera and lidar in natural environments , 2012 .

[19]  Yang Liu,et al.  Extrinsic Calibration of Lidar and Camera with Polygon , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[20]  Lipu Zhou,et al.  Automatic Extrinsic Calibration of a Camera and a 3D LiDAR Using Line and Plane Correspondences , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Shaojie Shen,et al.  Monocular visual-inertial fusion with online initialization and camera-IMU calibration , 2015, 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[22]  Jun-Sik Kim,et al.  Extrinsic Calibration of 2-D Lidars Using Two Orthogonal Planes , 2016, IEEE Transactions on Robotics.

[23]  Paul Newman,et al.  Lost in translation (and rotation): Rapid extrinsic calibration for 2D and 3D LIDARs , 2012, 2012 IEEE International Conference on Robotics and Automation.

[24]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[26]  John R. Spletzer,et al.  On-line calibration of multiple LIDARs on a mobile vehicle platform , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Marc Pollefeys,et al.  CamOdoCal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  H.H. Chen,et al.  A screw motion approach to uniqueness analysis of head-eye geometry , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Bo Li,et al.  Infrastructure Based Calibration of a Multi-Camera and Multi-LiDAR System Using Apriltags , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).