Monocular Visual-Inertial SLAM for Fixed-Wing UAVs Using Sliding Window Based Nonlinear Optimization

Precise real-time information about the position and orientation of robotic platforms as well as locally consistent point-clouds are essential for control, navigation, and obstacle avoidance. For years, GPS has been the central source of navigational information in airborne applications, yet as we aim for robotic operations close to the terrain and urban environments, alternatives to GPS need to be found. Fusing data from cameras and inertial measurement units in a nonlinear recursive estimator has shown to allow precise estimation of 6-Degree-of-Freedom (DoF) motion without relying on GPS signals. While related methods have shown to work in lab conditions since several years, only recently real-world robotic applications using visual-inertial state estimation found wider adoption. Due to the computational constraints, and the required robustness and reliability, it remains a challenge to employ a visual-inertial navigation system in the field. This paper presents our tightly integrated system involving hardware and software efforts to provide an accurate visual-inertial navigation system for low-altitude fixed-wing unmanned aerial vehicles (UAVs) without relying on GPS or visual beacons. In particular, we present a sliding window based visual-inertial Simultaneous Localization and Mapping (SLAM) algorithm which provides real-time 6-DoF estimates for control. We demonstrate the performance on a small unmanned aerial vehicle and compare the estimated trajectory to a GPS based reference solution.

[1]  Stergios I. Roumeliotis,et al.  C-KLAM: Constrained keyframe-based localization and mapping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Dimitrios G. Kottas,et al.  Camera-IMU-based localization: Observability analysis and consistency improvement , 2014, Int. J. Robotics Res..

[3]  Stergios I. Roumeliotis,et al.  An observability-constrained sliding window filter for SLAM , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Nicholas Roy,et al.  Optimization-Based Estimator Design for Vision-Aided Inertial Navigation , 2013 .

[5]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[6]  P. Furgale Extensions to the Visual Odometry Pipeline for the Exploration of Planetary Surfaces , 2011 .

[7]  Roland Siegwart,et al.  A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM , 2014, ICRA 2014.

[8]  Stergios I. Roumeliotis,et al.  A dual-layer estimator architecture for long-term localization , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Supun Samarasekera,et al.  Robust vision-aided navigation using Sliding-Window Factor graphs , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[12]  Roland Siegwart,et al.  Keyframe-Based Visual-Inertial SLAM using Nonlinear Optimization , 2013, Robotics: Science and Systems.

[13]  Stefan Leutenegger,et al.  Unmanned Solar Airplanes: Design and Algorithms for Efficient and Robust Autonomous Operation , 2014 .

[14]  Timothy A. Davis,et al.  A column approximate minimum degree ordering algorithm , 2000, TOMS.

[15]  Gabe Sibley,et al.  Sliding window filter with application to planetary landing , 2010 .

[16]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[17]  Agostino Martinelli,et al.  Visual-inertial structure from motion: Observability vs minimum number of sensors , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Roland Siegwart,et al.  Long-Endurance Sensing and Mapping Using a Hand-Launchable Solar-Powered UAV , 2015, FSR.

[19]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  Frank Dellaert,et al.  Eliminating conditionally independent sets in factor graphs: A unifying perspective based on smart factors , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Anastasios I. Mourikis,et al.  Real-time motion tracking on a cellphone using inertial sensing and a rolling-shutter camera , 2013, 2013 IEEE International Conference on Robotics and Automation.

[22]  Frank Dellaert,et al.  IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation , 2015, Robotics: Science and Systems.

[23]  F. Dellaert Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .