Effect of camera-IMU displacement calibration error on tracking performance

Due to their complementary properties, inertial measurement units (IMU) and cameras are used in ego-motion tracking applications. For this, the relative rotation and displacement between the camera and IMU reference frames has to be known. There are established methods for the accurate estimation of the relative orientation, however, accurate estimation of the displacement is still a challenging problem. When this is not possible, one might resort to the alternative approach of fusing camera and gyroscope data only, as this does not require the displacement information. To be able to asses such alternatives, this paper presents a systematic methodology based on realistic simulations to analyze the effect of the camera - IMU displacement calibration error on tracking performance, and discusses in detailed simulations the dependency of tracker performance metrics on the camera - IMU displacement's magnitude and calibration error.

[1]  Thomas B. Schön,et al.  Modeling and Calibration of Inertial and Vision Sensors , 2010, Int. J. Robotics Res..

[2]  Gaurav S. Sukhatme,et al.  Fast Relative Pose Calibration for Visual and Inertial Sensors , 2008, ISER.

[3]  Yuanxin Wu,et al.  On 'A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation' , 2013, ArXiv.

[4]  Peter Corke,et al.  An Introduction to Inertial and Visual Sensing , 2007, Int. J. Robotics Res..

[5]  Jorge Lobo,et al.  Camera-Inertial Sensor modelling and alignment for Visual Navigation , 2003 .

[6]  Dennis M. Akos,et al.  Monocular Camera/IMU/GNSS Integration for Ground Vehicle Navigation in Challenging GNSS Environments , 2012, Sensors.

[7]  Thomas B. Schön,et al.  Robust real-time tracking by fusing measurements from inertial and vision sensors , 2007, Journal of Real-Time Image Processing.

[8]  A. Tanju Erdem,et al.  Fusing Inertial Sensor Data in an Extended Kalman Filter for 3D Camera Tracking , 2015, IEEE Transactions on Image Processing.

[9]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[10]  Sameer Singh,et al.  Approaches to Multisensor Data Fusion in Target Tracking: A Survey , 2006, IEEE Transactions on Knowledge and Data Engineering.

[11]  Sudeep Sarkar,et al.  Calibration of inertial and vision systems as a prelude to multi-sensor fusion , 2008 .

[12]  Darius Burschka,et al.  Optimization based IMU camera calibration , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Jeroen D. Hol,et al.  Pose Estimation and Calibration Algorithms for Vision and Inertial Sensors , 2008 .

[14]  A. Tanju Erdem,et al.  Internal calibration of a camera and an inertial measurement unit , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[15]  A. Pinz,et al.  Calibration of Hybrid Vision / Inertial Tracking Systems * , 2005 .

[16]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.