Fuzzy logic controller for predictive vision-based target tracking with an unmanned aerial vehicle

Abstract We present in this paper a Fuzzy Logic Controller (FLC) combined with a predictive algorithm to track an Unmanned Ground Vehicle (UGV), using an Unmanned Aerial Vehicle (UAV). The UAV is equipped with a down facing camera. The video flow is sent continuously to a ground station to be processed in order to extract the location of the UGV and send the commands back to the UAV to follow autonomously the UGV. To emulate an experienced UAVs pilot, we propose a fuzzy-logic set of rules. Double Exponential Smoothing algorithm is used to filter the measurements and give the predictive value of the errors in the image plan. The FLC inputs are the filtered errors (UGV position) in the image plan and the derivative of its predicted value. The outputs are pitch and roll commands to be sent to the UAV. We show the efficiency of the proposed controller experimentally, and discuss the improvement of the tracking results compared to our previous work. Graphical Abstract

[1]  Roland Siegwart,et al.  Full control of a quadrotor , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Davide Scaramuzza,et al.  Air-ground localization and map augmentation using monocular dense reconstruction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[4]  Hao Ying,et al.  Fuzzy Control and Modeling: Analytical Foundations and Applications , 2000 .

[5]  Davide Scaramuzza,et al.  A monocular pose estimation system based on infrared LEDs , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[7]  Drago Matko,et al.  Quadrocopter Hovering Using Position-estimation Information from Inertial Sensors and a High-delay Video System , 2012, J. Intell. Robotic Syst..

[8]  Mark Fiala.  Vision guided control of multiple robots , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[9]  François Guerin,et al.  Double Exponential Smoothing for predictive vision based target tracking of a wheeled mobile robot , 2013, 52nd IEEE Conference on Decision and Control.

[10]  Vijay Kumar,et al.  Experiments in multirobot air-ground coordination , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[11]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[12]  Emanuele Frontoni,et al.  Unmanned Ground and Aerial Vehicles in extended range indoor and outdoor missions , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[13]  Jae-Young Choi,et al.  Collaborative Tracking Control of UAV-UGV , 2012 .

[14]  René Vidal,et al.  A hierarchical approach to probabilistic pursuit-evasion games with unmanned ground and aerial vehicles , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[15]  Daewon Lee,et al.  Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  Cheng Hui,et al.  Autonomous takeoff, tracking and landing of a UAV on a moving UGV using onboard monocular vision , 2013, Proceedings of the 32nd Chinese Control Conference.

[17]  John H. Lilly,et al.  Fuzzy Control and Identification , 2010 .

[18]  Martial Hebert,et al.  Experimental Results in Using Aerial LADAR Data for Mobile Robot Navigation , 2003, FSR.

[19]  Libor Preucil,et al.  A Practical Multirobot Localization System , 2014, J. Intell. Robotic Syst..

[20]  Pascual Campoy,et al.  Aerial object following using visual fuzzy servoing , 2011 .

[21]  Joseph J. LaViola,et al.  An experiment comparing double exponential smoothing and Kalman filter-based predictive tracking algorithms , 2003, IEEE Virtual Reality, 2003. Proceedings..

[22]  Jean-François Brethé,et al.  A decentralized interactive architecture for aerial and ground mobile robots cooperation , 2015, 2015 International Conference on Control, Automation and Robotics.

[23]  El Houssein Chouaib Harik,et al.  UAV-UGV cooperation for objects transportation in an industrial area , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[24]  Joseph J. LaViola,et al.  Double exponential smoothing: an alternative to Kalman filter-based predictive tracking , 2003, IPT/EGVE.

[25]  Gianluca Antonelli,et al.  A Fuzzy-Logic-Based Approach for Mobile Robot Path Tracking , 2007, IEEE Transactions on Fuzzy Systems.

[26]  Emanuele Frontoni,et al.  A Vision-Based Guidance System for UAV Navigation and Safe Landing using Natural Landmarks , 2010, J. Intell. Robotic Syst..

[27]  T. Krajnik,et al.  Cooperative μUAV-UGV autonomous indoor surveillance , 2012, International Multi-Conference on Systems, Sygnals & Devices.

[28]  Alonzo Kelly,et al.  Integrated Air/Ground Vehicle System for Semi-Autonomous Off-Road Navigation , 2002 .

[29]  Huosheng Hu,et al.  Collaborative control of UAV/UGV , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[30]  Jeffrey Tweedale,et al.  Fuzzy control loop in an autonomous landing system for Unmanned Air Vehicles , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[31]  Patrick Benavidez,et al.  Mobile robot navigation and target tracking system , 2011, 2011 6th International Conference on System of Systems Engineering.

[32]  Jean-François Brethé,et al.  Vision based target tracking using an unmanned aerial vehicle , 2015, 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO).