Extrinsic calibration between a stereoscopic system and a LIDAR with sensor noise models

Visual sensors and depth sensors, such as camera and LIDAR (Light Detection and Ranging) are more and more used together in current perception systems of intelligent vehicles. Fusing information obtained separately from these heterogeneous sensors always requires extrinsic calibration of vision sensors and LIDARs. In this paper, we propose an optimal extrinsic calibration algorithm between a binocular stereo vision system and a 2D LIDAR. The extrinsic calibration problem is solved by 3D reconstruction of a chessboard and geometric constraints between the views from the stereovision system and the LIDAR. The proposed approach takes sensor noise models into account that it provides optimal results under Mahalanobis distance constraints. Experiments based on both computer simulation and real data sets are presented and analyzed to evaluate the performance of the calibration method. A comparison with a popular camera/LIDAR calibration method is also proposed to show the benefits of our method.

[1]  Alexandru Tupan,et al.  Triangulation , 1997, Comput. Vis. Image Underst..

[2]  Cristiano Premebida,et al.  LIDAR and vision‐based pedestrian detection system , 2009, J. Field Robotics.

[3]  Cang Ye,et al.  Characterization of a 2D laser scanner for mobile robot obstacle negotiation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  Vincent Frémont,et al.  Extrinsic calibration between a multi-layer lidar and a camera , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[5]  Seungkeun Park,et al.  Multi-Classifier Based LIDAR and Camera Fusion , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[6]  Yunhui Liu,et al.  An algorithm for extrinsic parameters calibration of a camera and a laser range finder using line features , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Cindy Cappelle,et al.  3D triangulation based extrinsic calibration between a stereo vision system and a LIDAR , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  M. Mahlisch,et al.  Sensorfusion Using Spatio-Temporal Aligned Video and Lidar for Improved Vehicle Detection , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[9]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[10]  Hadi Aliakbarpour,et al.  An efficient algorithm for extrinsic calibration between a 3D laser range finder and a stereo camera for surveillance , 2009, 2009 International Conference on Advanced Robotics.

[11]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Kenichi Kanatani,et al.  Triangulation from Two Views Revisited: Hartley-Sturm vs. Optimal Correction , 2008, BMVC.

[13]  Robert Pless,et al.  Extrinsic Auto-calibration of a Camera and Laser Range Finder , 2003 .

[14]  Lili Huang,et al.  Tightly-coupled LIDAR and computer vision integration for vehicle detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.