Automatic Calibration of a Range Sensor and Camera System

We propose an automated method to recover the full calibration parameters between a 3D range sensor and a monocular camera system. Our method is not only accurate and fully automated, but also relies on a simple calibration target consisting of a single circle. This allows the algorithm to be suitable for applications requiring in-situ calibration. We demonstrate the effectiveness of the algorithm on a camera-lidar system and show results on 3D mapping tasks.

[1]  Luc Van Gool,et al.  Special issue on 3D representation for object and scene recognition , 2009, Comput. Vis. Image Underst..

[2]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[3]  Jean-Nicolas Ouellet,et al.  Precise ellipse estimation without contour point extraction , 2009, Machine Vision and Applications.

[4]  Sergiu Nedevschi,et al.  Automatic one step extrinsic calibration of a multi layer laser scanner relative to a stereo camera , 2010, Proceedings of the 2010 IEEE 6th International Conference on Intelligent Computer Communication and Processing.

[5]  Andrew Zisserman,et al.  Appendix—projective geometry for machine vision , 1992 .

[6]  Dimitrios G. Kottas,et al.  3D LIDAR–camera intrinsic and extrinsic calibration: Identifiability and analytical least-squares-based initialization , 2012, Int. J. Robotics Res..

[7]  Leejay Wu,et al.  3D Interpretation of Conics and Or-thogonality , 1993 .

[8]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[9]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Dikai Liu,et al.  Surface Type Classification With a Laser Range Finder , 2009, IEEE Sensors Journal.

[11]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[12]  Takeo Kanade,et al.  Extrinsic calibration of a single line scanning lidar and a camera , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[14]  Silvio Savarese,et al.  Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information , 2012, AAAI.

[15]  Sebastian Scherer,et al.  River mapping from a flying robot: state estimation, river detection, and obstacle mapping , 2012, Auton. Robots.

[16]  Oliver Wulf,et al.  FAST 3 D SCANNING METHODS FOR LASER MEASUREMENT SYSTEMS , 2003 .

[17]  KanataniKenichi,et al.  3D interpretation of conics and orthogonality , 1993 .

[18]  Urbano Nunes,et al.  A Minimal Solution for the Extrinsic Calibration of a Camera and a Laser-Rangefinder , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Cang Ye.  Mixed pixels removal of a Laser Rangefinder for mobile robot 3-D terrain mapping , 2008, 2008 International Conference on Information and Automation.

[20]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[21]  Martin Jägersand,et al.  A comparative analysis of geometric and image-based volumetric and intensity data registration algorithms , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Brett Browning,et al.  Evaluating Pose Estimation Methods for Stereo Visual Odometry on Robots , 2010 .

[24]  Hadi Aliakbarpour,et al.  An efficient algorithm for extrinsic calibration between a 3D laser range finder and a stereo camera for surveillance , 2009, 2009 International Conference on Advanced Robotics.

[25]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[26]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[27]  Jan Weingarten,et al.  Feature-based 3D SLAM , 2006 .

[28]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  M. Pollefeys,et al.  A Unified Approach to Calibrate a Network of Camcorders and ToF cameras , 2008 .

[30]  N. Fairfield.  Localization, mapping, and planning in 3D environments , 2009 .