Infrastructure-based calibration of a multi-camera rig

Most existing calibration methods for multi-camera rigs are computationally expensive, use installations of known fiducial markers, and require expert supervision. We propose an alternative approach called infrastructure-based calibration that is efficient, requires no modification of the infrastructure or calibration area, and is completely unsupervised. In infrastructure-based calibration, we use a map of a chosen calibration area and leverage image-based localization to calibrate an arbitrary multi-camera rig in near real-time. Due to the use of a map, before we can apply infrastructure-based calibration, we have to run a survey phase once to generate a map of the calibration area. In this survey phase, we use a survey vehicle equipped with a multi-camera rig and a calibrated odometry system, and self-calibration based on simultaneous localization and mapping to build the map that is based on natural features. The use of the calibrated odometry system ensures that the metric scale of the map is accurate. Our infrastructure-based calibration method does not assume an overlapping field of view between any two cameras, and it does not require an initial guess of any extrinsic parameter. Through extensive field tests on various ground vehicles in a variety of environments, we demonstrate the accuracy and repeatability of the infrastructure-based calibration method for calibration of a multi-camera rig. The code for our infrastructure-based calibration method is publicly available as part of the CamOdoCal library at https://github.com/hengli/camodocal.

[1]  Roland Siegwart,et al.  Using multi-camera systems in robotics: Efficient solutions to the NPnP problem , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Roland Siegwart,et al.  Rolling Shutter Camera Calibration , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Marc Pollefeys,et al.  A multiple-camera system calibration toolbox using a feature descriptor-based calibration pattern , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Gianluca Antonelli,et al.  Simultaneous calibration of odometry and camera for a differential drive mobile robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Andrew J. Davison,et al.  SLAM-based automatic extrinsic calibration of a multi-camera rig , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Sebastian Thrun,et al.  Automatic Online Calibration of Cameras and Lasers , 2013, Robotics: Science and Systems.

[8]  Seth J. Teller,et al.  Extrinsic Calibration from Per-Sensor Egomotion , 2012, Robotics: Science and Systems.

[9]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Giuseppe Oriolo,et al.  Simultaneous Calibration of Odometry and Sensor Parameters for Mobile Robots , 2013, IEEE Transactions on Robotics.

[11]  Torsten Sattler,et al.  Fast image-based localization using direct 2D-to-3D matching , 2011, 2011 International Conference on Computer Vision.

[12]  Marc Pollefeys,et al.  CamOdoCal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Paul Newman,et al.  Lost in translation (and rotation): Rapid extrinsic calibration for 2D and 3D LIDARs , 2012, 2012 IEEE International Conference on Robotics and Automation.

[14]  Michael F. Cohen,et al.  Real-time image-based 6-DOF localization in large-scale environments , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[16]  R. Siegwart,et al.  Self-supervised calibration for robotic systems , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[17]  Stergios I. Roumeliotis,et al.  An analytical least-squares solution to the odometer-camera extrinsic calibration problem , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[19]  Marc Pollefeys,et al.  Minimal Solutions for Pose Estimation of a Multi-Camera System , 2013, ISRR.

[20]  Michel Dhome,et al.  Fast calibration of embedded non-overlapping cameras , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Roland Siegwart,et al.  Infrastructure-based calibration of a multi-camera rig , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Sebastian Thrun,et al.  Unsupervised Calibration for Multi-beam Lasers , 2010, ISER.

[23]  John R. Spletzer,et al.  On-line calibration of multiple LIDARs on a mobile vehicle platform , 2010, 2010 IEEE International Conference on Robotics and Automation.

[24]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[25]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[26]  Frank Dellaert,et al.  A multi-camera 6-DOF pose tracker , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[27]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[28]  Marc Pollefeys,et al.  Robust pose-graph loop-closures with expectation-maximization , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[30]  Roland Siegwart,et al.  Toward automated driving in cities using close-to-market sensors: An overview of the V-Charge Project , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[31]  John L. Crassidis,et al.  Survey of nonlinear attitude estimation methods , 2007 .