An Improved Potential Game Theory Based Method for Multi-UAV Cooperative Search

Unmanned Aerial Vehicle (UAV) has been widely used in a variety of application, and the target search is one of the hot issues in the UAV research fields. Compared with the single UAV, the multi-UAV system can be competent for more complex tasks, with higher execution efficiency and stronger robustness. However, there exist some new challenges in the multi-UAV cooperative search, such as collaborative control and search area covering problems. To complete these tasks efficiently, the cooperative search problem is modeled as a potential game, and a modified binary log linear learning (BLLL) algorithm is proposed in this paper, to solve the covering problem using multiple UAVs. Furthermore, to improve the cooperative control performance based on potential game theory, a novel action selection strategy for UAVs is proposed. This strategy can avoid a UAV wandering around at the zero utility area by exchanging the information with neighbors. Finally, various simulations are carried out. The experimental results show that the proposed method can effectively complete cooperative search tasks and has better performance than the original BLLL algorithm.

[1]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[2]  Yu-Jun Zheng,et al.  Collaborative Human-UAV Search and Rescue for Missing Tourists in Nature Reserves , 2019, Interfaces.

[3]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[5]  Lav Gupta,et al.  Survey of Important Issues in UAV Communication Networks , 2016, IEEE Communications Surveys & Tutorials.

[6]  Evsen Yanmaz,et al.  Survey on Unmanned Aerial Vehicle Networks for Civil Applications: A Communications Viewpoint , 2016, IEEE Communications Surveys & Tutorials.

[7]  Yu-Jun Zheng,et al.  Evolutionary Planning of Multi-UAV Search for Missing Tourists , 2019, IEEE Access.

[8]  Lihua Xie,et al.  Decentralized Multi-UAV Flight Autonomy for Moving Convoys Search and Track , 2017, IEEE Transactions on Control Systems Technology.

[9]  Shengyong Chen,et al.  Evolutionary Collaborative Human-UAV Search for Escaped Criminals , 2020, IEEE Transactions on Evolutionary Computation.

[10]  Ying Tan,et al.  A two-stage imitation learning framework for the multi-target search problem in swarm robotics , 2019, Neurocomputing.

[11]  Yi Yang,et al.  Multi-UAV Reconnaissance Task Assignment for Heterogeneous Targets Based on Modified Symbiotic Organisms Search Algorithm , 2019, Sensors.

[12]  Andrea Caiti,et al.  A distributed passivity approach to AUV teams control in cooperating potential games , 2018, Ocean Engineering.

[13]  João Pedro Hespanha,et al.  Cooperative Search by UAV Teams: A Model Predictive Approach using Dynamic Graphs , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Walid Saad,et al.  Mobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things Communications , 2017, IEEE Transactions on Wireless Communications.

[15]  Minsu Kim,et al.  Early Fault Diagnosis and Classification of Ball Bearing Using Enhanced Kurtogram and Gaussian Mixture Model , 2019, IEEE Transactions on Instrumentation and Measurement.

[16]  Xing Zhang,et al.  A memetic algorithm for path planning of curvature-constrained UAVs performing surveillance of multiple ground targets , 2014 .

[17]  Pengfei Shi,et al.  An Improved DSA-Based Approach for Multi-AUV Cooperative Search , 2018, Comput. Intell. Neurosci..

[18]  Nathan Michael,et al.  Variable Resolution Occupancy Mapping Using Gaussian Mixture Models , 2019, IEEE Robotics and Automation Letters.

[19]  Simon X. Yang,et al.  Bioinspired Intelligent Algorithm and Its Applications for Mobile Robot Control: A Survey , 2015, Comput. Intell. Neurosci..

[20]  L. Shapley,et al.  Potential Games , 1994 .

[21]  Simon Lacroix,et al.  Classification of Outdoor 3D Lidar Data Based on Unsupervised Gaussian Mixture Models , 2017, IEEE Transactions on Automation Science and Engineering.

[22]  Gonzalo Pajares,et al.  Multi-UAV target search using decentralized gradient-based negotiation with expected observation , 2014, Inf. Sci..

[23]  Connections between cooperative control and potential games illustrated on the consensus problem , 2007, 2007 European Control Conference (ECC).

[24]  Beno Benhabib,et al.  Multi-UAV based Autonomous Wilderness Search and Rescue using Target Iso-Probability Curves , 2019, 2019 International Conference on Unmanned Aircraft Systems (ICUAS).

[25]  Eiji Oki,et al.  Utility Based Scheduling for Multi-UAV Search Systems in Disaster-Hit Areas , 2019, IEEE Access.

[26]  Wei Yue,et al.  A New Searching Approach Using Improved Multi-Ant Colony Scheme for Multi-UAVs in Unknown Environments , 2019, IEEE Access.

[27]  Randal W. Beard,et al.  Multiple UAV Coalitions for a Search and Prosecute Mission , 2011, J. Intell. Robotic Syst..

[28]  Yang Yang,et al.  Energy-efficient multi-UAV coverage deployment in UAV networks: A game-theoretic framework , 2018, China Communications.

[29]  Wei Ren,et al.  Game theory control solution for sensor coverage problem in unknown environment , 2014, 53rd IEEE Conference on Decision and Control.

[30]  Bernhard Rinner,et al.  Cooperative Robots to Observe Moving Targets: Review , 2018, IEEE Transactions on Cybernetics.

[31]  Liu Yang,et al.  An Improved Spinal Neural System-Based Approach for Heterogeneous AUVs Cooperative Hunting , 2018, Int. J. Fuzzy Syst..

[32]  Bharadwaj Rao,et al.  The societal impact of commercial drones , 2016 .

[33]  Leandro Buss Becker,et al.  Coordinated UAV Search and Rescue Application with JaCaMo , 2018, PAAMS.

[34]  Kai-Yew Lum,et al.  Multiagent Information Fusion and Cooperative Control in Target Search , 2013, IEEE Transactions on Control Systems Technology.

[35]  Pei Li,et al.  A potential game approach to multiple UAV cooperative search and surveillance , 2017 .

[36]  Zhong Liu,et al.  A Cooperative Search and Coverage Algorithm with Controllable Revisit and Connectivity Maintenance for Multiple Unmanned Aerial Vehicles , 2018, Sensors.

[37]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).