3D triangulation based extrinsic calibration between a stereo vision system and a LIDAR

This paper presents a novel extrinsic calibration algorithm between a binocular stereo vision system and a 2D LIDAR (laser range finder). Extrinsic calibration of these heterogeneous sensors is required to fuse information obtained separately by vision sensor and LIDAR in the context of intelligent vehicle. By placing a planar chessboard at different positions and orientations in front of the sensors, the proposed method solves the problem based on 3D reconstruction of the chessboard and geometric constraints between views from the stereovision system and the LIDAR. The three principle steps of the approach are: 3D corner points triangulation, 3D plane least-squares estimation, solving extrinsic parameters by applying a non-linear optimization algorithm based on the geometric constraints. To evaluate the performance of the algorithm, experiments based on computer simulation and real data are performed. The proposed approach is also compared with a popular calibration method to show its advantages.

[1]  Cristiano Premebida,et al.  Performance of laser and radar ranging devices in adverse environmental conditions , 2009 .

[2]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[3]  Lili Huang,et al.  A novel multi-planar LIDAR and computer vision calibration procedure using 2D patterns for automated navigation , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[4]  Luis Mateus Rocha,et al.  Singular value decomposition and principal component analysis , 2003 .

[5]  Yunhui Liu,et al.  An algorithm for extrinsic parameters calibration of a camera and a laser range finder using line features , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  D. Aubert,et al.  Long Range Obstacle Detection Using Laser Scanner and Stereovision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Hadi Aliakbarpour,et al.  An efficient algorithm for extrinsic calibration between a 3D laser range finder and a stereo camera for surveillance , 2009, 2009 International Conference on Advanced Robotics.

[9]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[10]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .

[11]  Alberto Broggi,et al.  A Laserscanner-Vision Fusion System Implemented on the TerraMax Autonomous Vehicle , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[13]  Cristiano Premebida,et al.  LIDAR and vision‐based pedestrian detection system , 2009, J. Field Robotics.

[14]  Vincent Frémont,et al.  Extrinsic calibration between a multi-layer lidar and a camera , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[15]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[16]  Lili Huang,et al.  Tightly-coupled LIDAR and computer vision integration for vehicle detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[17]  ZhangZhengyou.  A Flexible New Technique for Camera Calibration , 2000 .

[18]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[19]  S. Thrun,et al.  Model Based Vehicle Tracking in Urban Environments , 2009 .

[20]  Rui P. Rocha,et al.  Data Fusion Calibration for a 3D Laser Range Finder and a Camera using Inertial Data , 2009, ECMR.