Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information

This paper reports on a mutual information (MI) based algorithm for automatic extrinsic calibration of a 3D laser scanner and optical camera system. By using MI as the registration criterion, our method is able to work in situ without the need for any specific calibration targets, which makes it practical for in-field calibration. The calibration parameters are estimated by maximizing the mutual information obtained between the sensor-measured surface intensities. We calculate the Cramer-Rao-Lower-Bound (CRLB) and show that the sample variance of the estimated parameters empirically approaches the CRLB for a sufficient number of views. Furthermore, we compare the calibration results to independent ground-truth and observe that the mean error also empirically approaches to zero as the number of views are increased. This indicates that the proposed algorithm, in the limiting case, calculates a minimum variance unbiased (MVUB) estimate of the calibration parameters. Experimental results are presented for data collected by a vehicle mounted with a 3D laser scanner and an omnidirectional camera system.

[1]  Patrick Rives,et al.  Calibration between a central catadioptric camera and a laser range finder for robotic applications , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[2]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[3]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Sebastian Thrun,et al.  Unsupervised Calibration for Multi-beam Lasers , 2010, ISER.

[5]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[6]  Anselmo Lastra,et al.  Automatic image alignment for 3D environment modeling , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[7]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[8]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[9]  Korbinian Strimmer,et al.  Entropy Inference and the James-Stein Estimator, with Application to Nonlinear Gene Association Networks , 2008, J. Mach. Learn. Res..

[10]  Mongi A. Abidi,et al.  Registration and integration of multisensor data for photorealistic scene reconstruction , 2000, Applied Imaging Pattern Recognition.

[11]  Gamini Dissanayake,et al.  Mutual Information based Sensor Registration and Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[13]  Robert Pless,et al.  Extrinsic Auto-calibration of a Camera and Laser Range Finder , 2003 .

[14]  Hadi Aliakbarpour,et al.  An efficient algorithm for extrinsic calibration between a 3D laser range finder and a stereo camera for surveillance , 2009, 2009 International Conference on Advanced Robotics.

[15]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[16]  Silvio Savarese,et al.  Extrinsic Calibration of a 3D Laser Scanner and an Omnidirectional Camera , 2010 .

[17]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .