Cooperative Monocular-Based SLAM for Multi-UAV Systems in GPS-Denied Environments †

This work presents a cooperative monocular-based SLAM approach for multi-UAV systems that can operate in GPS-denied environments. The main contribution of the work is to show that, using visual information obtained from monocular cameras mounted onboard aerial vehicles flying in formation, the observability properties of the whole system are improved. This fact is especially notorious when compared with other related visual SLAM configurations. In order to improve the observability properties, some measurements of the relative distance between the UAVs are included in the system. These relative distances are also obtained from visual information. The proposed approach is theoretically validated by means of a nonlinear observability analysis. Furthermore, an extensive set of computer simulations is presented in order to validate the proposed approach. The numerical simulation results show that the proposed system is able to provide a good position and orientation estimation of the aerial vehicles flying in formation.

[1]  Zhen Zhu,et al.  Architecture for asymmetric collaborative navigation , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[2]  Antoni Grau,et al.  Vision-based SLAM system for MAVs in GPS-denied environments , 2017 .

[3]  Salah Sukkarieh,et al.  Active airborne localisation and exploration in unknown environments using inertial SLAM , 2006, 2006 IEEE Aerospace Conference.

[4]  Danping Zou,et al.  StructSLAM: Visual SLAM With Building Structure Lines , 2015, IEEE Transactions on Vehicular Technology.

[5]  John J. Leonard,et al.  Cooperative concurrent mapping and localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[6]  Vijay Kumar,et al.  Leader-to-formation stability , 2004, IEEE Transactions on Robotics and Automation.

[7]  Franz Andert,et al.  Improving monocular SLAM with altimeter hints for fixed-wing aircraft navigation and emergency landing , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[8]  Salah Sukkarieh,et al.  Improving the real-time efficiency of inertial SLAM and understanding its observability , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[11]  Miguel A. Olivares-Méndez,et al.  Visual 3-D SLAM from UAVs , 2009, J. Intell. Robotic Syst..

[12]  Giancarmine Fasano,et al.  Cooperative navigation in GPS-challenging environments exploiting position broadcast and vision-based tracking , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[13]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[14]  Teodiano Freire Bastos Filho,et al.  Navegación Autónoma Asistida Basada en SLAM para una Silla de Ruedas Robotizada en Entornos Restringidos , 2011 .

[15]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[17]  Tianmiao Wang,et al.  Bearing-only Visual SLAM for Small Unmanned Aerial Vehicles in GPS-denied Environments , 2013, Int. J. Autom. Comput..

[18]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[19]  Eduardo Mario Nebot,et al.  Consistency of the EKF-SLAM Algorithm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Stergios I. Roumeliotis,et al.  Generalized Analysis and Improvement of the Consistency of EKF-based SLAM , 2008 .

[21]  Dezhen Song,et al.  Visual Navigation Using Heterogeneous Landmarks and Unsupervised Geometric Constraints , 2015, IEEE Transactions on Robotics.

[22]  Girish Chowdhary,et al.  GPS‐denied Indoor and Outdoor Monocular Vision Aided Navigation and Control of Unmanned Aircraft , 2013, J. Field Robotics.

[23]  Stergios I. Roumeliotis,et al.  Performance Bounds for Cooperative Simultaneous Localization and Mapping (C-SLAM) , 2005, Robotics: Science and Systems.

[24]  Roberto Opromolla,et al.  Autonomous Flight in GPS-Challenging Environments Exploiting Multi-UAV Cooperation and Vision-aided Navigation , 2017 .

[25]  Stergios I. Roumeliotis,et al.  On the consistency of multi-robot cooperative localization , 2009, Robotics: Science and Systems.

[26]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[27]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  Bo He,et al.  Stereo visual SLAM system in underwater environment , 2014, OCEANS 2014 - TAIPEI.

[29]  Antoni Grau,et al.  A Practical Method for Implementing an Attitude and Heading Reference System , 2014 .

[30]  Neil M Barbour,et al.  Inertial Navigation Sensors , 2010 .

[31]  Antonio Bandera,et al.  Curvature-Based Environment Description for Robot Navigation Using Laser Range Sensors , 2009, Sensors.

[32]  Andrew I. Comport,et al.  On unifying key-frame and voxel-based dense visual SLAM at large scales , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Joel A. Hesch,et al.  Cooperative vision-aided inertial navigation using overlapping views , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  Nicholas Roy,et al.  RANGE–Robust autonomous navigation in GPS‐denied environments , 2011, J. Field Robotics.

[35]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Antidio Viguria,et al.  An architecture for robust UAV navigation in GPS‐denied areas , 2018, J. Field Robotics.

[37]  Mark Euston,et al.  A complementary filter for attitude estimation of a fixed-wing UAV , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Franz Andert,et al.  Radar-aided optical navigation for long and large-scale flights over unknown and non-flat terrain , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[39]  Franz Andert,et al.  Using Combined IMU / Stereo Vision / Cooperative GNSS System for Positioning of UxV Swarms within Catastrophic Urban Scenarios , 2013 .

[40]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[41]  Adam Schmidt.  The EKF-Based Visual SLAM System with Relative Map Orientation Measurements , 2014, ICCVG.