Game Theory-Based Optimal Cooperative Path Planning for Multiple UAVs

This paper presents new cooperative path planning algorithms for multiple unmanned aerial vehicles (UAVs) using Game theory-based particle swarm optimization (GPSO). First, the formation path planning is formulated into the minimization of a cost function that incorporates multiple objectives and constraints for each UAV. A framework based on game theory is then developed to cast the minimization into the problem of finding a Stackelberg-Nash equilibrium. Next, hierarchical particle swarm optimization algorithms are developed to obtain the global optimal solution. Simulation results show that the GPSO algorithm can generate efficient and feasible flight paths for multiple UAVs, outperforming other path planning methods in terms of convergence rate and flexibility. The formation can adjust its geometrical shape to accommodate a working environment. Experimental tests on a group of three UAVs confirm the advantages of the proposed approach for a practical application.

[1]  M. D. Phung,et al.  Stag hunt game-based approach for cooperative UAVs , 2022, Proceedings of the International Symposium on Automation and Robotics in Construction (IAARC).

[2]  Yuanqing Xia,et al.  An Improved Artificial Potential Field Method for Path Planning and Formation Control of the Multi-UAV Systems , 2022, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  Shengchao Zhen,et al.  Control Design With Optimization for Fuzzy Steering-by-Wire System Based on Nash Game Theory , 2021, IEEE Transactions on Cybernetics.

[4]  C. Ji,et al.  Cooperative Spectrum Sensing Algorithm Based on Evolutionary Game Theory , 2022, IEEE Access.

[5]  Hak-Man Kim,et al.  Adopting the Game Theory Approach in the Blockchain-Driven Pricing Optimization of Standalone Distributed Energy Generations , 2022, IEEE Access.

[6]  Wooyeol Choi,et al.  Artificial Intelligence Approaches for UAV Navigation: Recent Advances and Future Challenges , 2022, IEEE Access.

[7]  X. Xue,et al.  Game theory–based bilevel model for multiplayer pavement maintenance management , 2021 .

[8]  Manh Duong Phung,et al.  Safety-enhanced UAV Path Planning with Spherical Vector-based Particle Swarm Optimization , 2021, Appl. Soft Comput..

[9]  Donghui Guo,et al.  Particle Swarm Optimization Algorithm With Self-Organizing Mapping for Nash Equilibrium Strategy in Application of Multiobjective Optimization , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Habib Ullah Khan,et al.  Identity and Aggregate Signature-Based Authentication Protocol for IoD Deployment Military Drone , 2021, IEEE Access.

[11]  Xiang Zhong,et al.  Autonomous Parking Trajectory Planning With Tiny Passages: A Combination of Multistage Hybrid A-Star Algorithm and Numerical Optimal Control , 2021, IEEE Access.

[12]  Lihua Xie,et al.  Ultra-Wideband and Odometry-Based Cooperative Relative Localization With Application to Multi-UAV Formation Control , 2020, IEEE Transactions on Cybernetics.

[13]  Ahmed M. Abdel Aziz,et al.  Stackelberg Game Theory-Based Optimization Model for Design of Payment Mechanism in Performance-Based PPPs , 2020 .

[14]  Tran Hiep Dinh,et al.  System Architecture for Real-Time Surface Inspection Using Multiple UAVs , 2019, IEEE Systems Journal.

[15]  Yubing Zhai,et al.  An equilibrium in group decision and its association with the Nash equilibrium in game theory , 2020, Comput. Ind. Eng..

[16]  Jinming Du,et al.  An Evolutionary Game Coordinated Control Approach to Division of Labor in Multi-Agent Systems , 2019, IEEE Access.

[17]  Shu Liang,et al.  Generalized Nash equilibrium seeking strategy for distributed nonsmooth multi-cluster game , 2019, Autom..

[18]  Anis Koubaa,et al.  LSAR: Multi-UAV Collaboration for Search and Rescue Missions , 2019, IEEE Access.

[19]  Abolfazl Razi,et al.  Wildfire Monitoring in Remote Areas using Autonomous Unmanned Aerial Vehicles , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[20]  David Hutchison,et al.  Game Theory for Multi-Access Edge Computing: Survey, Use Cases, and Future Trends , 2017, IEEE Communications Surveys & Tutorials.

[21]  Hyoungkwan Kim,et al.  Game Theory–Based Analysis of Decision Making for Coastal Adaptation under Multilateral Participation , 2018, Journal of Management in Engineering.

[22]  Isabelle Fantoni,et al.  Interactive Leader–Follower Consensus of Multiple Quadrotors Based on Composite Nonlinear Feedback Control , 2018, IEEE Transactions on Control Systems Technology.

[23]  Tongwen Chen,et al.  False Data Injection Attacks on Networked Control Systems: A Stackelberg Game Analysis , 2018, IEEE Transactions on Automatic Control.

[24]  Yuanchang Liu,et al.  Path planning algorithm for unmanned surface vehicle formations in a practical maritime environment , 2015 .

[25]  Jianqiao Yu,et al.  Path Planning for Multi-UAV Formation , 2015, J. Intell. Robotic Syst..

[26]  Hong Qu,et al.  An improved genetic algorithm with co-evolutionary strategy for global path planning of multiple mobile robots , 2013, Neurocomputing.

[27]  George W. Irwin,et al.  A review on improving the autonomy of unmanned surface vehicles through intelligent collision avoidance manoeuvres , 2012, Annu. Rev. Control..

[28]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[29]  Y. Volkan Pehlivanoglu,et al.  A new vibrational genetic algorithm enhanced with a Voronoi diagram for path planning of autonomous UAV , 2012 .

[30]  Alberto Bemporad,et al.  Decentralized linear time-varying model predictive control of a formation of unmanned aerial vehicles , 2011, IEEE Conference on Decision and Control and European Control Conference.

[31]  Dongbing Gu,et al.  A Differential Game Approach to Formation Control , 2008, IEEE Transactions on Control Systems Technology.

[32]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.