Artificial intelligence and game theory controlled autonomous UAV swarms

Autonomous unmanned aerial vehicles (uavs) operating as a swarm can be deployed in austere environments, where cyber electromagnetic activities often require speedy and dynamic adjustments to swarm operations. Use of central controllers, uav synchronization mechanisms or pre-planned set of actions to control a swarm in such deployments would hinder its ability to deliver expected services. We introduce artificial intelligence and game theory based flight control algorithms to be run by each autonomous uav to determine its actions in near real-time, while relying only on local spatial, temporal and electromagnetic (em) information. Each uav using our flight control algorithms positions itself such that the swarm maintains mobile ad-hoc network (manet) connectivity and uniform asset distribution over an area of interest. Typical tasks for swarms using our algorithms include detection, localization and tracking of mobile em transmitters. We present a formal analysis showing that our algorithms can guide a swarm to maintain a connected manet, promote a uniform network spreading, while avoiding overcrowding with other swarm members. We also prove that they maintain manet connectivity and, at the same time, they can lead a swarm of autonomous uavs to follow or avoid an em transmitter. Simulation experiments in opnet modeler verify the results of formal analysis that our algorithms are capable of providing an adequate area coverage over a mobile em source and maintain manet connectivity. These algorithms are good candidates for civilian and military applications that require agile responses to the changes in dynamic environments for tasks such as detection, localization and tracking mobile em transmitters.

[1]  Mohamed Elhoseny,et al.  Balancing Energy Consumption in Heterogeneous Wireless Sensor Networks Using Genetic Algorithm , 2015, IEEE Communications Letters.

[2]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[3]  Stephen Gundry,et al.  Analysis of Emergent Behavior for GA-based Topology Control Mechanism for Self-Spreading Nodes in MANETs , 2012 .

[4]  Stephen Gundry,et al.  Game Theoretic and Bio-inspired Optimization Approach for Autonomous Movement of MANET Nodes , 2013, Handbook of Optimization.

[5]  Walid Saad,et al.  Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs , 2015, IEEE Transactions on Wireless Communications.

[6]  Ciprian Dobre,et al.  A Survey on the Application of Evolutionary Algorithms for Mobile Multihop Ad Hoc Network Optimization Problems , 2016, Int. J. Distributed Sens. Networks.

[7]  Issa M. Khalil,et al.  On the continuous coverage problem for a swarm of UAVs , 2016, 2016 IEEE 37th Sarnoff Symposium.

[8]  Tristan Sherman,et al.  UAV Swarm Mapping Using a Fully Distributed Control Approach , 2019 .

[9]  Antonio Barrientos,et al.  A Game of Drones: Game Theoretic Approaches for Multi-robot Task Allocation in Security Missions , 2017, ROBOT.

[10]  Rakesh Nagi,et al.  Multiagent UAV Routing: A Game Theory Analysis With Tight Price of Anarchy Bounds , 2020, IEEE Transactions on Automation Science and Engineering.

[11]  Jonathan M. Aitken,et al.  Distributed selection of flight formation in UAV missions , 2016 .

[12]  Martin Molina,et al.  A flexible and dynamic mission planning architecture for UAV swarm coordination , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[13]  Qiang Du,et al.  Centroidal Voronoi Tessellations: Applications and Algorithms , 1999, SIAM Rev..

[14]  Fatemeh Afghah,et al.  Use of a quantum genetic algorithm for coalition formation in large-scale UAV networks , 2019, Ad Hoc Networks.

[15]  Santosh Kumar Das,et al.  Adaptive and intelligent energy efficient routing for transparent heterogeneous ad-hoc network by fusion of game theory and linear programming , 2017, Applied Intelligence.

[16]  Jie Liu,et al.  Modeling and simulation of dynamic ant colony’s labor division for task allocation of UAV swarm , 2018 .

[17]  Michael R. Clement,et al.  Consensus-based data sharing for large-scale aerial swarm coordination in lossy communications environments , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Stephen Gundry,et al.  Differential evolution-based autonomous and disruption tolerant vehicular self-organization in MANETs , 2015, Ad Hoc Networks.

[19]  Claudio Fabiano Motta Toledo,et al.  Heuristic and Genetic Algorithm Approaches for UAV Path Planning under Critical Situation , 2017, Int. J. Artif. Intell. Tools.

[20]  Radha Poovendran,et al.  A Game-Theoretic Approach to IP Address Randomization in Decoy-Based Cyber Defense , 2015, GameSec.

[21]  Stephen Gundry,et al.  Performance metrics for self-positioning autonomous MANET nodes , 2013, J. Cyber Secur. Mobil..

[22]  N. Rengarajan,et al.  An Intelligent Technique to Detect Jamming Attack in Wireless Sensor Networks (WSNs) , 2015, Int. J. Fuzzy Syst..

[23]  K. J. Ray Liu,et al.  Multi-Stage Pricing Game for Collusion-Resistant Dynamic Spectrum Allocation , 2008, IEEE Journal on Selected Areas in Communications.

[24]  Guray Yilmaz,et al.  Real-time Autonomous UAV Formation Flight with Collision and Obstacle Avoidance in Unknown Environment , 2016, J. Intell. Robotic Syst..

[25]  Stephen Gundry,et al.  Markov Chain Analysis of Self-organizing Mobile Nodes , 2012, J. Intell. Robotic Syst..

[26]  Janusz Kusyk,et al.  AI and Game Theory based Autonomous UAV Swarm for Cybersecurity , 2019, MILCOM 2019 - 2019 IEEE Military Communications Conference (MILCOM).

[27]  Nirwan Ansari,et al.  Intrusion Detection and Ejection Framework Against Lethal Attacks in UAV-Aided Networks: A Bayesian Game-Theoretic Methodology , 2017, IEEE Transactions on Intelligent Transportation Systems.

[28]  Walid Saad,et al.  Drones in Distress: A Game-Theoretic Countermeasure for Protecting UAVs Against GPS Spoofing , 2019, IEEE Internet of Things Journal.

[29]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[30]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Ismail Güvenç,et al.  UAV assisted heterogeneous networks for public safety communications , 2015, 2015 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[32]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[33]  Alex Pentland,et al.  Swarms and Network Intelligence in Search , 2017, Studies in Computational Intelligence.

[34]  Tinku Mohamed Rasheed,et al.  Rapidly Deployable Network for Tactical Applications: Aerial Base Station with Opportunistic Links for Unattended and Temporary Events ABSOLUTE Example , 2013, MILCOM 2013 - 2013 IEEE Military Communications Conference.

[35]  Stephen Gundry,et al.  3D genetic algorithms for underwater sensor networks , 2013, Int. J. Ad Hoc Ubiquitous Comput..

[36]  Janusz Kusyk,et al.  Game Theory and Genetic Algorithm Based Approach for Self Positioning of Autonomous Nodes , 2012, Ad Hoc Sens. Wirel. Networks.

[37]  Roxanna Pakkar,et al.  Adaptable UAV Swarm Autonomy and Formation Platform , 2019, 2019 IEEE Aerospace Conference.

[38]  Selcuk Okdem,et al.  Cluster based wireless sensor network routing using artificial bee colony algorithm , 2012, Wirel. Networks.

[39]  Hanning Chen,et al.  Unmanned vehicle path planning using a novel ant colony algorithm , 2019, EURASIP Journal on Wireless Communications and Networking.

[40]  Suresh Sundaram,et al.  A decentralized game theoretic approach for team formation and task assignment by autonomous unmanned aerial vehicles , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[41]  Dimitri N. Mavris,et al.  Modeling and Simulation of UAV Swarm Formation Control in Response to Wind Gusts , 2019 .

[42]  Heinrich von Stackelberg Market Structure and Equilibrium , 2010 .

[43]  Halim Yanikomeroglu,et al.  3-D Placement of an Unmanned Aerial Vehicle Base Station (UAV-BS) for Energy-Efficient Maximal Coverage , 2017, IEEE Wireless Communications Letters.

[44]  Alexandre Bessa dos Santos,et al.  Autonomous UAV Outdoor Flight Controlled by an Embedded System Using Odroid and ROS , 2017 .

[45]  Janusz Kusyk,et al.  Survey on evolutionary computation methods for cybersecurity of mobile ad hoc networks , 2018, Evolutionary Intelligence.

[46]  Jun-Woo Cho,et al.  Performance Comparison of Heuristic Algorithms for UAV Deployment with Low Power Consumption , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[47]  Janusz Kusyk,et al.  Game Theory and Biology Inspired Flight Control for Autonomous UAVs Operating in Contested Environments , 2019, 2019 IEEE 40th Sarnoff Symposium.