Optical aircraft navigation with multi-sensor SLAM and infinite depth features

In the context of optical-aided navigation and visual Simultaneous Localization And Mapping (SLAM) for satellite-denied aircraft navigation, this paper extends the monocular SLAM approach by the use of multiple sensors with different viewing directions. Downward optical sensors see other movements than forward-looking cameras, hence it is straightforward to combine the benefits of both. This combination helps to estimate all the six motion components with increased robustness, yielding a more stable and accurate state estimation for optical-aided navigation solutions. The method is evaluated with aerial data from manned and unmanned flights. In the data analysis, a satellite navigation dropout is simulated, and the flight trajectory is then reconstructed just by the optical data. The method is tested in small-scale scenarios as well as in longer flights with several kilometers of flight range. The results show some increased performance of an additional forward camera in comparison to a setup with only downward sensors. It is proposed to use such multi-sensor configurations wherever motion estimation ambiguities with a single camera are probable, especially when larger distances have to be flown with optical navigation.

[1]  Jan Albert Mulder,et al.  Optic Flow Based State Estimation for an Indoor Micro Air Vehicle , 2010 .

[2]  Dieter Schmalstieg,et al.  Handling pure camera rotation in keyframe-based SLAM , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[3]  Franz Andert,et al.  Radar-aided optical navigation for long and large-scale flights over unknown and non-flat terrain , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[4]  Vijay Kumar,et al.  Multi-sensor fusion for robust autonomous flight in indoor and outdoor environments with a rotorcraft MAV , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[6]  Michael Suppa,et al.  Stereo vision based indoor/outdoor navigation for flying robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Sven Lorenz,et al.  Optical-Aided Aircraft Navigation using Decoupled Visual SLAM with Range Sensor Augmentation , 2017, J. Intell. Robotic Syst..

[9]  Johann C. Dauer,et al.  Detection of Forward Flight Limitations of Unmanned Helicopters , 2016 .

[10]  Gerd Hirzinger,et al.  More accurate pinhole camera calibration with imperfect planar target , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[11]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[13]  Ben Upcroft,et al.  High Altitude Stereo Visual Odometry , 2013, Robotics: Science and Systems.

[14]  Roland Siegwart,et al.  Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments , 2014, IEEE Robotics & Automation Magazine.

[15]  Rodney A. Walker,et al.  Airborne systems laboratory for automation research , 2010 .

[16]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[17]  Salah Sukkarieh,et al.  Inertial Sensor-Based Simultaneous Localization and Mapping for UAVs , 2015 .

[18]  Roland Siegwart,et al.  Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium , 2013, J. Field Robotics.

[19]  Franz Andert,et al.  Improving monocular SLAM with altimeter hints for fixed-wing aircraft navigation and emergency landing , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).