A high-precision calibration approach for Camera-IMU pose parameters with adaptive constraints of multiple error equations

Abstract In the calibration of the pose parameters of a camera and inertial measurement unit (Camera-IMU), the camera depth information is unreliable due to the uneven spatial distribution of calibration points, because the calibration points have random errors due to the IMU drift and the inadequate robustness of stereovision and because the Camera-IMU pose parameters lack self-adaptation. This paper proposes a high-precision calibration approach for Camera-IMU pose parameters with adaptive constraints of multiple error equations (adaptive constraint calibration approach, ACCA). The approach calibrates pose parameters of the Camera-IMU jointly via error equations, such as lens distortion correction, camera parallax correction and error compensation of the inertial sensor. The experimental results show that the calibration approach for Camera-IMU pose parameters with adaptive constraints of multiple error equations improves the measurement accuracy by 84.0% and can effectively suppress IMU drift with good robustness.

[1]  Armando J. Sinisterra Stereo vision-based target tracking system for USV operations , 2017 .

[2]  Reinhard Koch,et al.  Video-based realtime IMU-camera calibration for robot navigation , 2012, Real-Time Image and Video Processing.

[3]  BoFeng Li,et al.  The seamless model for three-dimensional datum transformation , 2012, Science China Earth Sciences.

[4]  Rüdiger Lehmann,et al.  Transformation model selection by multiple hypotheses testing , 2014, Journal of Geodesy.

[5]  Wenjun Xu,et al.  Adaptive Support-Weight Stereo-Matching Approach with Two Disparity Refinement Steps , 2019 .

[6]  Kuk-Jin Yoon,et al.  Calibration and Noise Identification of a Rolling Shutter Camera and a Low-Cost Inertial Measurement Unit , 2018, Sensors.

[7]  Ignacio Santamaría,et al.  Properness and Widely Linear Processing of Quaternion Random Vectors , 2010, IEEE Transactions on Information Theory.

[8]  Tomislav Bašić,et al.  Empirical comparison of the Geodetic Coordinate Transformation Models: a case study of Croatia , 2017 .

[9]  Abdellatif Bey-Temsamani,et al.  2-Level error (drift) compensation for low-cost MEMS-based inertial measurement unit (IMU) , 2016 .

[10]  O. Akyilmaz,et al.  Solution of the weighted symmetric similarity transformations based on quaternions , 2017, Journal of Geodesy.

[11]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[12]  Shi Qiang Liu,et al.  System Error Compensation Methodology Based on a Neural Network for a Micromachined Inertial Measurement Unit , 2016, Sensors.

[13]  G. Pan,et al.  Linear observation based total least squares , 2015 .

[14]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[15]  Bin Wang,et al.  Data snooping algorithm for universal 3D similarity transformation based on generalized EIV model , 2018 .

[16]  Tokunbo Ogunfunmi Adaptive Filtering Using Complex Data and Quaternions , 2015, Complex Adaptive Systems.

[17]  Li Wang,et al.  Camera self-calibration with lens distortion , 2016 .

[18]  Shaojie Shen,et al.  Monocular Visual–Inertial State Estimation With Online Initialization and Camera–IMU Extrinsic Calibration , 2017, IEEE Transactions on Automation Science and Engineering.

[19]  Stergios I. Roumeliotis,et al.  A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation , 2008, IEEE Transactions on Robotics.

[20]  Tianhe Xu,et al.  Analytical solution to and error analysis of the quaternion based similarity transformation considering measurement errors in both frames , 2017 .

[21]  Hong Liu,et al.  Inertial measurement unit-camera calibration based on incomplete inertial sensor information , 2014, Journal of Zhejiang University SCIENCE C.

[22]  J. Kalmár,et al.  A comparison of different solutions of the Bursa–Wolf model and of the 3D, 7-parameter datum transformation , 2016, Acta Geodaetica et Geophysica.

[23]  Danilo P. Mandic,et al.  Quaternion-Valued Echo State Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Liyan Zhang,et al.  A flexible approach to light pen calibration for a monocular-vision-based coordinate measuring system , 2014 .

[25]  Jianli Zhao,et al.  Special least squares solutions of the quaternion matrix equation AX=B with applications , 2015, Appl. Math. Comput..

[26]  Danilo P. Mandic,et al.  Augmented second-order statistics of quaternion random signals , 2011, Signal Process..

[27]  Danilo P. Mandic,et al.  A Quaternion Widely Linear Adaptive Filter , 2010, IEEE Transactions on Signal Processing.

[28]  Qinglin Yi,et al.  Quaternion-Based Iterative Solution of Three-Dimensional Coordinate Transformation Problem , 2011, J. Comput..

[29]  Qingwen Wang,et al.  A real quaternion matrix equation with applications , 2013 .