INS-camera calibration without ground control points

In this paper we present an approach for performing system calibration of a sensor suite consisting of a fixed mounted camera and an inertial navigation system without the usage of a photogrammetric calibration site. The aim of the presented work is to obtain accurate direct georeferencing of camera images collected with manned or unmanned aerial systems for search and rescue tasks. These time-critical missions require a straightforward calibration which can be performed without additional equipment. This induces an in-flight calibration of the intrinsic camera parameters in addition to the mounting offsets between the camera and the inertial navigation system. The optimization of these values can be done by introducing them as parameters into a bundle adjustment process. We show how to solve this by exploiting a graph optimization framework. The evaluation of the proposed approach with data from flight experiments leads to an improvement of roughly factor six compared to a terrestrial calibration.

[1]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[2]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[3]  Roland Siegwart,et al.  Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[5]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[6]  Karsten Jacobsen ASPECTS OF HANDLING IMAGE ORIENTATION BY DIRECT SENSOR ORIENTATION , 2001 .

[7]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[8]  Daniel Cremers,et al.  A GRAPH BASED BUNDLE ADJUSTMENT FOR INS-CAMERA CALIBRATION , 2013 .

[9]  Ana Paula Kersting,et al.  Mounting Parameters Calibration of GPS/INS-Assisted Photogrammetric Systems , 2011, 2011 International Workshop on Multi-Platform/Multi-Sensor Remote Sensing and Mapping.

[10]  Livio Pinto,et al.  A SINGLE STEP CALIBRATION PROCEDURE FOR IMU/GPS IN AERIAL PHOTOGRAMMETRY , 2002 .

[11]  Yuanxin Wu,et al.  On 'A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation' , 2013, ArXiv.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Daniel Cremers,et al.  Multitarget, multisensor localization and tracking using passive antennas and optical sensors on UAVs , 2010, Security + Defence.

[14]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[15]  N. Haala,et al.  DIRECT GEOREFERENCING USING GPS/INERTIAL EXTERIOR ORIENTATIONS FOR PHOTOGRAMMETRIC APPLICATIONS , 2000 .

[16]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[17]  Wolfgang Koch,et al.  Airborne emitter tracking by fusing heterogeneous bearing data , 2014, 17th International Conference on Information Fusion (FUSION).

[18]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Jennifer A. Scott,et al.  Algorithm 891: A Fortran virtual memory system , 2009, TOMS.