Bundle adjustment with raw inertial observations in UAV applications

Abstract It is well known that accurate aerial position and attitude control is beneficial for image orientation in airborne photogrammetry. The aerial control is traditionally obtained by Kalman filtering/smoothing inertial and GNSS observations prior to the bundle-adjustment. However, in Micro Aerial Vehicles this process may result in poor attitude determination due to the limited quality of the inertial sensors, large alignment uncertainty and residual correlations between sensor biases and initial attitude. We propose to include the raw inertial observations directly into the bundle-adjustment instead of as position and attitude weighted observations from a separate inertial/GNSS fusion step. The necessary observation models are derived in detail within the context of the so called “Dynamic Networks”. We examine different real world cases and we show that the proposed approach is superior to the established processing pipeline in challenging scenarios such as mapping in corridors and in areas where the reception of GNSS signals is denied.

[1]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[2]  I. Colomina,et al.  Relative INS/GNSS aerial control in integrated sensor orientation: Models and performance , 2012 .

[3]  K. Schwarz,et al.  Differentiation for High-Precision GPS Velocity and Acceleration Determination , 1999, GPS Solutions.

[4]  Jan Skaloud,et al.  A general approach to time-varying parameters in pose-graph optimization , 2017, 2017 European Navigation Conference (ENC).

[5]  Jan Skaloud,et al.  Rigorous Integration of Inertial Navigation with Optical Sensors by Dynamic Networks , 2011 .

[6]  Christian Eling,et al.  Direct Georeferencing of Micro Aerial Vehicles - System Design, System Calibration and First Evaluation Tests , 2014 .

[7]  J. Lutes,et al.  DIRECT GEOREFERENCING ON SMALL UNMANNED AERIAL PLATFORMS FOR IMPROVED RELIABILITY AND ACCURACY OF MAPPING WITHOUT THE NEED FOR GROUND CONTROL POINTS , 2015 .

[8]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[9]  Erik Wolfart,et al.  Pose interpolation SLAM for large maps using moving 3D sensors , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Jan Skaloud,et al.  FIXED-WING MICRO AERIAL VEHICLE FOR ACCURATE CORRIDOR MAPPING , 2015 .

[11]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Salah Sukkarieh,et al.  Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions , 2012, IEEE Transactions on Robotics.

[13]  I. Colomina,et al.  Fast AT: A simple procedure for quasi direct orientation , 2012 .

[14]  Timothy A. Davis,et al.  Direct methods for sparse linear systems , 2006, Fundamentals of algorithms.

[15]  Matteo Matteucci,et al.  On the Development of a Generic Multi-Sensor Fusion Framework for Robust Odometry Estimation , 2014 .

[16]  M. Cannon,et al.  An integrated INS/GPS approach to the georeferencing of remotely sensed data , 1993 .

[17]  J. Skaloud,et al.  Towards A More Rigorous Boresight Calibration 1 , 2003 .

[18]  Matteo Matteucci,et al.  Position tracking and sensors self-calibration in autonomous mobile robots by Gauss-Newton optimization , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[20]  Ismael Colomina,et al.  Network Approach versus State-space Approach for Strapdown Inertial Kinematic Gravimetry , 2005 .

[21]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[23]  Frank Dellaert,et al.  Information fusion in navigation systems via factor graph based incremental smoothing , 2013, Robotics Auton. Syst..

[24]  Jan Skaloud,et al.  APPLICABILITY OF NEW APPROACHES OF SENSOR ORIENTATION TO MICRO AERIAL VEHICLES , 2016 .

[25]  Hauke Strasdat,et al.  Local accuracy and global consistency for efficient SLAM , 2012 .

[26]  P. Gill,et al.  Algorithms for the Solution of the Nonlinear Least-Squares Problem , 1978 .

[27]  Jan Skaloud,et al.  A Micro Aerial Vehicle with Precise Position and Attitude Sensors , 2014 .

[28]  Jan Skaloud,et al.  Progress in airborne gravimetry by combining strapdown inertial and new satellite observations via dynamic networks , 2015 .

[29]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .