Monocular Visual SLAM Based on a Cooperative UAV–Target System

To obtain autonomy in applications that involve Unmanned Aerial Vehicles (UAVs), the capacity of self-location and perception of the operational environment is a fundamental requirement. To this effect, GPS represents the typical solution for determining the position of a UAV operating in outdoor and open environments. On the other hand, GPS cannot be a reliable solution for a different kind of environments like cluttered and indoor ones. In this scenario, a good alternative is represented by the monocular SLAM (Simultaneous Localization and Mapping) methods. A monocular SLAM system allows a UAV to operate in a priori unknown environment using an onboard camera to simultaneously build a map of its surroundings while at the same time locates itself respect to this map. So, given the problem of an aerial robot that must follow a free-moving cooperative target in a GPS denied environment, this work presents a monocular-based SLAM approach for cooperative UAV–Target systems that addresses the state estimation problem of (i) the UAV position and velocity, (ii) the target position and velocity, (iii) the landmarks positions (map). The proposed monocular SLAM system incorporates altitude measurements obtained from an altimeter. In this case, an observability analysis is carried out to show that the observability properties of the system are improved by incorporating altitude measurements. Furthermore, a novel technique to estimate the approximate depth of the new visual landmarks is proposed, which takes advantage of the cooperative target. Additionally, a control system is proposed for maintaining a stable flight formation of the UAV with respect to the target. In this case, the stability of control laws is proved using the Lyapunov theory. The experimental results obtained from real data as well as the results obtained from computer simulations show that the proposed scheme can provide good performance.

[1]  Mark Euston,et al.  A complementary filter for attitude estimation of a fixed-wing UAV , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  S Lanzisera,et al.  Radio Frequency Time-of-Flight Distance Measurement for Low-Cost Wireless Sensor Localization , 2011, IEEE Sensors Journal.

[3]  Tao Li,et al.  Planar Homography based Monocular SLAM Initialization Method , 2019, ICSRT 2019.

[4]  Yungang Liu,et al.  Visual SLAM with RGB-D Cameras , 2019, 2019 Chinese Control Conference (CCC).

[5]  Giancarmine Fasano,et al.  Cooperative navigation in GPS-challenging environments exploiting position broadcast and vision-based tracking , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[6]  Jun Ota,et al.  Human-tracking system using quadrotors and multiple environmental cameras for face-tracking application , 2017 .

[7]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Hélène Laurent,et al.  Vision-Based System for Human Detection and Tracking in Indoor Environment , 2010, Int. J. Soc. Robotics.

[9]  Girish Chowdhary,et al.  GPS‐denied Indoor and Outdoor Monocular Vision Aided Navigation and Control of Unmanned Aircraft , 2013, J. Field Robotics.

[10]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[11]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[12]  Rodrigo Munguía,et al.  Visual-Based SLAM Configurations for Cooperative Multi-UAV Systems with a Lead Agent: An Observability-Based Approach , 2018, Sensors.

[13]  Konrad Reif,et al.  Stochastic Stability of the Extended Kalman Filter With Intermittent Observations , 2010, IEEE Transactions on Automatic Control.

[14]  Antoni Grau,et al.  Minimalistic approach for monocular SLAM system applied to micro aerial vehicles in GPS-denied environments , 2018 .

[15]  Kaveh Pahlavan,et al.  Modeling of the TOA-based distance measurement error using UWB indoor radio measurements , 2006, IEEE Communications Letters.

[16]  Miguel A. Olivares-Méndez,et al.  Visual 3-D SLAM from UAVs , 2009, J. Intell. Robotic Syst..

[17]  Christoph Bodensteiner,et al.  Unique 4-DOF Relative Pose Estimation with Six Distances for UWB/V-SLAM-Based Devices , 2019, Sensors.

[18]  Konrad Reif,et al.  Stochastic stability of the discrete-time extended Kalman filter , 1999, IEEE Trans. Autom. Control..

[19]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[20]  Yang Li,et al.  SLAM and moving target tracking based on constrained local submap filter , 2015, 2015 IEEE International Conference on Information and Automation.

[21]  Roberto Opromolla,et al.  Autonomous Flight in GPS-Challenging Environments Exploiting Multi-UAV Cooperation and Vision-aided Navigation , 2017 .

[22]  Jason J. Ford,et al.  Vision-based detection and tracking of aerial targets for UAV collision avoidance , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Roland Siegwart,et al.  Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAM , 2011, J. Intell. Robotic Syst..

[24]  Enhai Liu,et al.  Scale Estimation and Correction of the Monocular Simultaneous Localization and Mapping (SLAM) Based on Fusion of 1D Laser Range Finder and Vision Data , 2018, Sensors.

[25]  Yuanxin Wu,et al.  On 'A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation' , 2013, ArXiv.

[26]  Luis F. Luque-Vega,et al.  Robust block second order sliding mode control for a quadrotor , 2012, J. Frankl. Inst..

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Antoni Grau-Saldes,et al.  Concurrent Initialization for Bearing-Only SLAM , 2010, Sensors.

[29]  Bara J. Emran,et al.  ROBUST NONLINEAR COMPOSITE ADAPTIVE CONTROL OF QUADROTOR , 2014 .

[30]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[31]  Vadim I. Utkin,et al.  Sliding mode control design principles and applications to electric drives , 1993, IEEE Trans. Ind. Electron..

[32]  Stergios I. Roumeliotis,et al.  Performance Bounds for Cooperative Simultaneous Localization and Mapping (C-SLAM) , 2005, Robotics: Science and Systems.

[33]  Uwe Stilla,et al.  METRIC SCALE CALCULATION FOR VISUAL MAPPING ALGORITHMS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[34]  John J. Leonard,et al.  Cooperative concurrent mapping and localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[35]  Christoph Briese,et al.  Vision-based detection of non-cooperative UAVs using frame differencing and temporal filter , 2018, 2018 International Conference on Unmanned Aircraft Systems (ICUAS).

[36]  RoyNicholas,et al.  RANGE–Robust autonomous navigation in GPS-denied environments , 2011 .

[37]  Rong Li,et al.  A Novel Cooperative Localization Method Based on IMU and UWB , 2020, Sensors.

[38]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[39]  Nicholas Roy,et al.  RANGE - robust autonomous navigation in GPS-denied environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[40]  Jun-ichi Meguro,et al.  GPS Multipath Mitigation for Urban Area Using Omnidirectional Infrared Camera , 2009, IEEE Transactions on Intelligent Transportation Systems.

[41]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[42]  Hui Hu,et al.  A study of GPS jamming and anti-jamming , 2009, 2009 2nd International Conference on Power Electronics and Intelligent Transportation System (PEITS).

[43]  Arun K. Somani,et al.  Monocular vision SLAM for indoor aerial vehicles , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Miguel A. Olivares-Méndez,et al.  Towards an Autonomous Vision-Based Unmanned Aerial System against Wildlife Poachers , 2015, Sensors.

[45]  Rodrigo Munguía,et al.  Monocular SLAM for Autonomous Robots with Enhanced Features Initialization , 2014, Sensors.

[46]  Antoni Grau,et al.  A Practical Method for Implementing an Attitude and Heading Reference System , 2014 .

[47]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[48]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[49]  Wolfram Burgard,et al.  Cooperative robot localization and target tracking based on least squares minimization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[50]  Tianmiao Wang,et al.  Bearing-only Visual SLAM for Small Unmanned Aerial Vehicles in GPS-denied Environments , 2013, Int. J. Autom. Comput..