Cooperative Visual-SLAM System for UAV-Based Target Tracking in GPS-Denied Environments: A Target-Centric Approach

Autonomous tracking of dynamic targets by the use of Unmanned Aerial Vehicles (UAVs) is a challenging problem that has practical applications in many scenarios. In this context, a fundamental aspect that must be addressed has to do with the position estimation of aerial robots and a target to control the flight formation. For non-cooperative targets, their position must be estimated using the on-board sensors. Moreover, for estimating the position of UAVs, global position information may not always be available (GPS-denied environments). This work presents a cooperative visual-based SLAM (Simultaneous Localization and Mapping) system that allows a team of aerial robots to autonomously follow a non-cooperative target moving freely in a GPS-denied environment. One of the contributions of this work is to propose and investigate the use of a target-centric SLAM configuration to solve the estimation problem that differs from the well-known World-centric and Robot-centric SLAM configurations. In this sense, the proposed approach is supported by theoretical results obtained from an extensive nonlinear observability analysis. Additionally, a control system is proposed for maintaining a stable UAV flight formation with respect to the target as well. In this case, the stability of control laws is proved using the Lyapunov theory. Employing an extensive set of computer simulations, the proposed system demonstrated potentially to outperform other related approaches.

[1]  Jun-ichi Meguro,et al.  GPS Multipath Mitigation for Urban Area Using Omnidirectional Infrared Camera , 2009, IEEE Transactions on Intelligent Transportation Systems.

[2]  Toon Goedemé,et al.  Exploring RGB+Depth Fusion for Real-Time Object Detection , 2019, Sensors.

[3]  P. Abbeel,et al.  Cooperative Occlusion-Aware Multi-Robot Target Tracking using Optimization , 2015 .

[4]  YangQuan Chen,et al.  Formation control: a review and a new consideration , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  RoyNicholas,et al.  RANGE–Robust autonomous navigation in GPS-denied environments , 2011 .

[6]  Yang Li,et al.  SLAM and moving target tracking based on constrained local submap filter , 2015, 2015 IEEE International Conference on Information and Automation.

[7]  Jerzy Z. Sasiadek,et al.  Guidance and Control of a Robot Capturing an Uncooperative Space Target , 2018, J. Intell. Robotic Syst..

[8]  Miguel A. Olivares-Méndez,et al.  Towards an Autonomous Vision-Based Unmanned Aerial System against Wildlife Poachers , 2015, Sensors.

[9]  Pini Gurfil,et al.  Tracking a Non-Cooperative Target Using Real-Time Stereovision-Based Control: An Experimental Study , 2017, Sensors.

[10]  Jung Min Pak Gaussian Sum FIR Filtering for 2D Target Tracking , 2020 .

[11]  Isaac Kaminer,et al.  Vision-Based Tracking and Motion Estimation for Moving Targets Using Unmanned Air Vehicles , 2008 .

[12]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[13]  Wolfram Burgard,et al.  Cooperative robot localization and target tracking based on least squares minimization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Andrzej Stateczny Neural Manoeuvre Detection of the Tracked Target in ARPA Systems , 2001 .

[15]  Hélène Laurent,et al.  Vision-Based System for Human Detection and Tracking in Indoor Environment , 2010, Int. J. Soc. Robotics.

[16]  P. Nikitin,et al.  Antenna design for UHF RFID tags: a review and a practical application , 2005, IEEE Transactions on Antennas and Propagation.

[17]  Ian Postlethwaite,et al.  Cooperative Target-capturing with Incomplete Target Information , 2010, Proceedings of the 2010 American Control Conference.

[18]  S Lanzisera,et al.  Radio Frequency Time-of-Flight Distance Measurement for Low-Cost Wireless Sensor Localization , 2011, IEEE Sensors Journal.

[19]  Christoph Briese,et al.  Vision-based detection of non-cooperative UAVs using frame differencing and temporal filter , 2018, 2018 International Conference on Unmanned Aircraft Systems (ICUAS).

[20]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[21]  Bin Zhang,et al.  Development of UAV-Based Target Tracking and Recognition Systems , 2020, IEEE Transactions on Intelligent Transportation Systems.

[22]  Camille Alain Rabbath,et al.  Encirclement of multiple targets using model predictive control , 2013, 2013 American Control Conference.

[23]  Hadi Seyedarabi,et al.  Cooperative Machine-Vision-Based Tracking using Multiple Unmanned Aerial Vehicles , 2014 .

[24]  Mingfeng Zhang,et al.  Vision-based tracking and estimation of ground moving target using unmanned aerial vehicle , 2010, Proceedings of the 2010 American Control Conference.

[25]  Luis F. Luque-Vega,et al.  Robust block second order sliding mode control for a quadrotor , 2012, J. Frankl. Inst..

[26]  Vijay Kumar,et al.  Leader-to-formation stability , 2004, IEEE Transactions on Robotics and Automation.

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Jerel Nielsen,et al.  Relative Moving Target Tracking and Circumnavigation , 2019, 2019 American Control Conference (ACC).

[29]  Tomonari Furukawa,et al.  Multi-vehicle Bayesian Search for Multiple Lost Targets , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[30]  Gerard S. Schkolnik,et al.  Autonomous Formation Flight , 2004 .

[31]  Fabio Morbidi,et al.  Hierarchical control of a team of quadrotors for cooperative active target tracking , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[33]  Hui Hu,et al.  A study of GPS jamming and anti-jamming , 2009, 2009 2nd International Conference on Power Electronics and Intelligent Transportation System (PEITS).

[34]  Roberto Opromolla,et al.  Hardware in the Loop Performance Assessment of LIDAR-Based Spacecraft Pose Determination , 2017, Sensors.

[35]  Rodrigo Munguía,et al.  A Cooperative Aerial Robotic Approach for Tracking and Estimating the 3D Position of a Moving Object by Using Pseudo-Stereo Vision , 2019, Journal of Intelligent & Robotic Systems.

[36]  Antonio Bandera,et al.  Curvature-Based Environment Description for Robot Navigation Using Laser Range Sensors , 2009, Sensors.

[37]  Isaac Kaminer,et al.  Vision-Based Tracking and Motion Estimation for Moving Targets Using Small UAVs , 2006 .

[38]  Houria Siguerdidjane,et al.  ROBUST CONTROL AND VISUAL SERVOING OF AN UAV , 2008 .

[39]  Jason J. Ford,et al.  Vision-based detection and tracking of aerial targets for UAV collision avoidance , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Kevin D. Jones,et al.  Vision-based tracking and motion estimation for moving targets using small UAVs , 2006, 2006 American Control Conference.

[41]  Xinping Guan,et al.  Distributed Formation Target Tracking in Local Coordinate Systems , 2019, 2019 IEEE 15th International Conference on Control and Automation (ICCA).

[42]  André Dias,et al.  Decentralized target tracking based on multi-robot cooperative triangulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Zhen Zhu,et al.  Architecture for asymmetric collaborative navigation , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[44]  Jesús Alberto Meda Campaña,et al.  Experimental vision regulation of a quadrotor , 2015, IEEE Latin America Transactions.

[45]  Liang Sun,et al.  A cooperative formation control strategy maintaining connectivity of a multi-agent system , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Fabio Morbidi,et al.  On active target tracking and cooperative localization for multiple aerial vehicles , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Antoni Grau,et al.  A Practical Method for Implementing an Attitude and Heading Reference System , 2014 .

[48]  Konrad Reif,et al.  Stochastic Stability of the Extended Kalman Filter With Intermittent Observations , 2010, IEEE Transactions on Automatic Control.

[49]  Daibing Zhang,et al.  Vision-Based Detection and Tracking of a Mobile Ground Target Using a Fixed-Wing UAV , 2014 .

[50]  Hans-Dieter Burkhard,et al.  Multi Robot Object Tracking and Self Localization Using Visual Percept Relations , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Camille Alain Rabbath,et al.  Model Predictive Control for the dynamic encirclement of a target , 2012, 2012 American Control Conference (ACC).

[52]  Konrad Reif,et al.  Stochastic stability of the discrete-time extended Kalman filter , 1999, IEEE Trans. Autom. Control..

[53]  Franz Andert,et al.  Radar-aided optical navigation for long and large-scale flights over unknown and non-flat terrain , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[54]  Giuseppe Oriolo,et al.  An Adaptive Scheme for Image-Based Visual servoing of an underactuated UAV , 2014, Int. J. Robotics Autom..

[55]  Arie Levant,et al.  Higher-order sliding modes, differentiation and output-feedback control , 2003 .

[56]  Randal W. Beard,et al.  A decentralized scheme for spacecraft formation flying via the virtual structure approach , 2003, Proceedings of the 2003 American Control Conference, 2003..

[57]  Anusna Chakraborty,et al.  Target-Centric Formation Control in GPS-denied Environments , 2018 .

[58]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[59]  Karl A. Stol,et al.  On-board object tracking control of a quadcopter with monocular vision , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[60]  Kamesh Subbarao,et al.  Target Tracking in 3-D Using Estimation Based Nonlinear Control Laws for UAVs , 2016 .

[61]  T. Hamel,et al.  Visual Tracking Control of Aerial Robotic Systems with Adaptive Depth Estimation , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[62]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[63]  Nicholas Roy,et al.  RANGE - robust autonomous navigation in GPS-denied environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[64]  Bara J. Emran,et al.  ROBUST NONLINEAR COMPOSITE ADAPTIVE CONTROL OF QUADROTOR , 2014 .

[65]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[66]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[67]  Teodiano Freire Bastos Filho,et al.  Navegación Autónoma Asistida Basada en SLAM para una Silla de Ruedas Robotizada en Entornos Restringidos , 2011 .

[68]  Mark Euston,et al.  A complementary filter for attitude estimation of a fixed-wing UAV , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[69]  Jun Ota,et al.  Human-tracking system using quadrotors and multiple environmental cameras for face-tracking application , 2017 .