Cooperative and Geometric Learning Algorithm (CGLA) for path planning of UAVs with limited information

In this paper, we propose a new learning algorithm, named as the Cooperative and Geometric Learning Algorithm (CGLA), to solve problems of maneuverability, collision avoidance and information sharing in path planning for Unmanned Aerial Vehicles (UAVs). The contributions of CGLA are three folds: (1) CGLA is designed for path planning based on cooperation of multiple UAVs. Technically, CGLA exploits a new defined individual cost matrix, which leads to an efficient path planning algorithm for multiple UAVs. (2) The convergence of the proposed algorithm for calculating the cost matrix is proven theoretically, and the optimal path in terms of path length and risk measure from a starting point to a target point can be calculated in polynomial time. (3) In CGLA, the proposed individual weight matrix can be efficiently calculated and adaptively updated based on the geometric distance and risk information shared among UAVs. Finally, risk evaluation is introduced first time in this paper for UAV navigation and extensive computer simulation results validate the effectiveness and feasibility of CGLA for safe navigation of multiple UAVs.

[1]  Wanquan Liu,et al.  Cooperative and Geometric Learning for path planning of UAVs , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[2]  E. Fernandez-Gaucherand,et al.  Cooperative control for multiple autonomous UAV's searching for targets , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[3]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[4]  Antonios Tsourdos,et al.  Collision avoidance and path planning of multiple UAVs using flyable paths in 3D , 2010, 2010 15th International Conference on Methods and Models in Automation and Robotics.

[5]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[6]  Meir Pachter,et al.  Stochastic Dynamic rogramming for Uncertainty Handling in UAV Operations , 2007, 2007 American Control Conference.

[7]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[8]  Wanquan Liu,et al.  Geometric Reinforcement Learning for Path Planning of UAVs , 2015, J. Intell. Robotic Syst..

[9]  Matthew Flint,et al.  APPROXIMATE DYNAMIC PROGRAMMING METHODS FOR COOPERATIVE UAV SEARCH , 2005 .

[10]  Randy Beard,et al.  Information consensus in distributed multiple vehicle coordinated control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[11]  Kai-Yuan Cai,et al.  Fuzzy Reasoning as a Control Problem , 2008, IEEE Transactions on Fuzzy Systems.

[12]  Fuchun Sun,et al.  Evolutionary route planner for unmanned air vehicles , 2005, IEEE Transactions on Robotics.

[13]  R. Pesenti,et al.  Multiple UAV cooperative path planning via neuro-dynamic programming , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[14]  M. Pachter,et al.  Complexity in UAV cooperative control , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[15]  Ian Postlethwaite,et al.  Real-time path planning with limited information for autonomous unmanned air vehicles , 2008, Autom..

[16]  Yishay Mansour,et al.  Learning Rates for Q-learning , 2004, J. Mach. Learn. Res..

[17]  Wright-Patterson Afb,et al.  UAV Cooperative Path Planning , 2000 .

[18]  Cai Kaiyuan.  Real-time path planning for unmanned aerial vehicles using behavior coordination and virtual goal , 2011 .

[19]  Scott A. Bortoff,et al.  Path planning for UAVs , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[20]  Wei Liu,et al.  A feedback based CRI approach to fuzzy reasoning , 2011, Appl. Soft Comput..

[21]  Naim Dahnoun,et al.  Studies in Computational Intelligence , 2013 .

[22]  Ioannis K. Nikolos,et al.  UAV Path Planning Using Evolutionary Algorithms , 2007, Innovations in Intelligent Machines.

[23]  Atilla Dogan.  Probabilistic approach in path planning for UAVs , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.

[24]  Kai-Yuan Cai,et al.  Real-time path planning for multi-UAVs with share of threats information , 2011, 2011 6th IEEE Conference on Industrial Electronics and Applications.