3 D Lidar-Camera Intrinsic and Extrinsic Calibration : Observability Analysis and Analytical Least Squares-based Initialization

This paper addresses the problem of estimating the intrinsic parameters of the 3D Velodyne lidar while at the same time computing its extrinsic calibration with respect to a rigidly connected camera. Existing approaches to solve this nonlinear estimation problem are based on iterative minimization of nonlinear cost functions. In such cases, the accuracy of the resulting solution hinges on the availability of a precise initial estimate, which is often not available. In order to alleviate this issue, we divide the problem into two least-squares sub-problems, and analytically solve each one to determine a precise initial estimate for the unknown parameters. We further increase the accuracy of these initial estimates by iteratively minimizing a batch nonlinear least-squares cost function. In addition, we provide the minimal observability conditions, under which, it is possible to accurately estimate the unknown parameters. Experimental results consisting of photorealistic 3D reconstruction of indoor and outdoor scenes, as well as standard metrics of the calibration errors, are used to assess the validity of our approach.

[1]  Lihong Zhi,et al.  Solving polynomial systems via symbolic-numeric reduction to geometric involutive form , 2009, J. Symb. Comput..

[2]  Stergios I. Roumeliotis,et al.  On the global optimum of planar, range-based robot-to-robot relative pose estimation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Mark de Berg,et al.  Computational geometry: algorithms and applications , 1997 .

[4]  H. Stetter,et al.  An Elimination Algorithm for the Computation of All Zeros of a System of Multivariate Polynomial Equations , 1988 .

[5]  Silvio Savarese,et al.  Extrinsic Calibration of a 3D Laser Scanner and an Omnidirectional Camera , 2010 .

[6]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Malcolm D. Shuster.  Survey of attitude representations , 1993 .

[8]  William H. Press,et al.  Numerical recipes in C , 2002 .

[9]  Homer H. Chen.  Pose Determination from Line-to-Plane Correspondences: Existence Condition and Closed-Form Solutions , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Kostas Daniilidis,et al.  Automatic alignment of a camera with a line scan LIDAR system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[13]  Martin Byröd,et al.  A Column-Pivoting Based Strategy for Monomial Ordering in Numerical Gröbner Basis Calculations , 2008, ECCV.

[14]  Ioannis Stamos,et al.  Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes , 2008, International Journal of Computer Vision.

[15]  Stergios I. Roumeliotis,et al.  3D relative pose estimation from six distances , 2009, Robotics: Science and Systems.

[16]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[17]  Kostas Daniilidis,et al.  Linear Pose Estimation from Points or Lines , 2002, ECCV.

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .