Globally Optimal Multi-Scale Monocular Hand-Eye Calibration Using Dual Quaternions

In this work, we present an approach for monocular hand-eye calibration from per-sensor ego-motion based on dual quaternions. Due to non-metrically scaled translations of monocular odometry, a scaling factor has to be estimated in addition to the rotation and translation calibration. For this, we derive a quadratically constrained quadratic program that allows a combined estimation of all extrinsic calibration parameters. Using dual quaternions leads to low run-times due to their compact representation. Our problem formulation further allows to estimate multiple scalings simultaneously for different sequences of the same sensor setup. Based on our problem formulation, we derive both, a fast local and a globally optimal solving approach. Finally, our algorithms are evaluated and compared to state-of-the-art approaches on simulated and real-world data, e.g., the EuRoC MAV dataset.

[1]  Shaojie Shen,et al.  Monocular Visual–Inertial State Estimation With Online Initialization and Camera–IMU Extrinsic Calibration , 2017, IEEE Transactions on Automation Science and Engineering.

[2]  Radu Horaud,et al.  Robot Hand-Eye Calibration Using Structure-from-Motion , 2001, Int. J. Robotics Res..

[3]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[4]  Michal Havlena,et al.  Structure-from-motion based hand-eye calibration using L∞ minimization , 2011, CVPR 2011.

[5]  Dragomir Anguelov,et al.  Scalability in Perception for Autonomous Driving: Waymo Open Dataset , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  K. Dietmayer,et al.  MGNet: Monocular Geometric Scene Understanding for Autonomous Driving , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Marc Pollefeys,et al.  CamOdoCal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Tomás Pajdla,et al.  Globally optimal hand-eye calibration , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Seth J. Teller,et al.  Extrinsic Calibration from Per-Sensor Egomotion , 2012, Robotics: Science and Systems.

[10]  Lu Naiguang,et al.  Calibration-Free Robot-Sensor Calibration approach based on Second-Order Cone Programming , 2018 .

[11]  Stephen Boyd,et al.  A Rewriting System for Convex Optimization Problems , 2017, ArXiv.

[12]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Roland Siegwart,et al.  The EuRoC micro aerial vehicle datasets , 2016, Int. J. Robotics Res..

[14]  Shaojie Shen,et al.  VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator , 2017, IEEE Transactions on Robotics.

[15]  Hong Liu,et al.  An Online Initialization and Self-Calibration Method for Stereo Visual-Inertial Odometry , 2020, IEEE Transactions on Robotics.

[16]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[17]  Michael Buchholz,et al.  Online Extrinsic Calibration Based on Per-Sensor Ego-Motion Using Dual Quaternions , 2021, IEEE Robotics and Automation Letters.

[18]  Matthew Giamou,et al.  Certifiably Globally Optimal Extrinsic Calibration From Per-Sensor Egomotion , 2019, IEEE Robotics and Automation Letters.

[19]  J. Michael McCarthy,et al.  Introduction to theoretical kinematics , 1990 .

[20]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[21]  Jonathan Kelly,et al.  Certifiably Optimal Monocular Hand-Eye Calibration , 2020, 2020 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[22]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[23]  Heinrich Niemann,et al.  Calibration-Free Hand-Eye Calibration: A Structure-from-Motion Approach , 2005, DAGM-Symposium.

[24]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.