Certifiably Globally Optimal Extrinsic Calibration From Per-Sensor Egomotion

We present a certifiably globally optimal algorithm for determining the extrinsic calibration between two sensors that are capable of producing independent egomotion estimates. This problem has been previously solved using a variety of techniques, including local optimization approaches that have no formal global optimality guarantees. We use a quadratic objective function to formulate calibration as a quadratically constrained quadratic program (QCQP). By leveraging recent advances in the optimization of QCQPs, we are able to use existing semidefinite program solvers to obtain a certifiably global optimum via the Lagrangian dual problem. Our problem formulation can be globally optimized by existing general-purpose solvers in less than a second, regardless of the number of measurements available and the noise level. This enables a variety of robotic platforms to rapidly and robustly compute and certify a globally optimal set of calibration parameters without a prior estimate or operator intervention. We compare the performance of our approach with a local solver on extensive simulations and multiple real datasets. Finally, we present necessary observability conditions that connect our approach to recent theoretical results and analytically support the empirical performance of our system.

[1]  Sebastian Thrun,et al.  Unsupervised Calibration for Multi-beam Lasers , 2010, ISER.

[2]  Silvio Savarese,et al.  Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information , 2015, J. Field Robotics.

[3]  Javier González,et al.  Convex Global 3D Registration with Lagrangian Duality , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[5]  John J. Leonard,et al.  SE-Sync: A certifiably correct algorithm for synchronization over the special Euclidean group , 2016, Int. J. Robotics Res..

[6]  Javier González,et al.  Extrinsic calibration of a 2d laser-rangefinder and a camera based on scene corners , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Javier González,et al.  Cartan-Sync: Fast and Global SE(d)-Synchronization , 2017, IEEE Robotics and Automation Letters.

[8]  Jonathan Kelly,et al.  Entropy-based sim(3) calibration of 2D lidars to egomotion sensors , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[9]  Paul Timothy Furgale,et al.  Continuous-time batch estimation using temporal basis functions , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Giuseppe Carlo Calafiore,et al.  Lagrangian duality in 3D SLAM: Verification techniques and optimal solutions , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Rekha R. Thomas,et al.  On the local stability of semidefinite relaxations , 2017, Mathematical Programming.

[12]  Jonathan Kelly,et al.  Self-Calibration of Mobile Manipulator Kinematic and Sensor Extrinsic Parameters Through Contact-Based Interaction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Nicholas Roy,et al.  Extrinsic Calibration from Per-Sensor Egomotion , 2013 .

[14]  Fuzhen Zhang The Schur complement and its applications , 2005 .

[15]  Tomás Pajdla,et al.  Globally optimal hand-eye calibration , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Jan Heller,et al.  Hand-eye and robot-world calibration by global polynomial optimization , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Adrian Burlacu,et al.  Orthogonal dual tensor method for solving the AX = XB sensor calibration problem , 2016 .

[18]  SavareseSilvio,et al.  Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information , 2015 .

[19]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[20]  Henry Wolkowicz,et al.  A note on lack of strong duality for quadratic problems with orthogonal constraints , 2002, Eur. J. Oper. Res..

[21]  Johan Fredriksson,et al.  Simultaneous Multiple Rotation Averaging Using Lagrangian Duality , 2012, ACCV.

[22]  Laurent Kneip,et al.  A Certifiably Globally Optimal Solution to the Non-minimal Relative Pose Problem , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[24]  John J. Leonard,et al.  A Certifiably Correct Algorithm for Synchronization over the Special Euclidean Group , 2016, WAFR.

[25]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[26]  K. N. Srinivasa Rao The Rotation and Lorentz Groups and Their Representations for Physicists , 1989 .

[27]  Anders P. Eriksson,et al.  Solving quadratically constrained geometrical problems using lagrangian duality , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  Michal Havlena,et al.  A branch-and-bound algorithm for globally optimal hand-eye calibration , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Jan Heller,et al.  World-Base Calibration by Global Polynomial Optimization , 2014, 2014 2nd International Conference on 3D Vision.

[30]  Henry Wolkowicz,et al.  On Lagrangian Relaxation of Quadratic Matrix Constraints , 2000, SIAM J. Matrix Anal. Appl..

[31]  Seth J. Teller,et al.  Extrinsic Calibration from Per-Sensor Egomotion , 2012, Robotics: Science and Systems.

[32]  Jonathan P. How,et al.  Efficient Global Point Cloud Alignment Using Bayesian Nonparametric Mixtures , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[34]  Seth J. Teller,et al.  Automatic Calibration of Multiple Coplanar Sensors , 2011, Robotics: Science and Systems.

[35]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[36]  Anders P. Eriksson,et al.  Rotation Averaging and Strong Duality , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.