Trajectory Prediction of UAV Swarm based on Neural Relational Inference Model without Physical Control Law

Many Unmanned Aerial Vehicle(UAV) swarm can be treated as an interacting system because they have common behavior and dynamics. Extensive applications of UAV swarm in the local war recently have been successfully implemented into the air combat. Therefore, how to counter UAV swarm effectively has become an important approach to beat the enemy in the battles. The key to tackle the counter UAV swarm’ issue is to detect their precise position. And predicting the trajectory of UAV swarm effectively can help to improve the performance of position detection. In this paper, we apply the Neural Relational Inference(NRI) model in our framework. Furthermore, by the method of analyzing the dynamical equations that directly affect the trajectory of different interacting systems, we propose a Mapping Table to build the relationship between the spring / charged particles model and the UAV swarm. Based on the Mapping Table and NRI model, we propose a novel framework to predict the trajectory of UAV swarm. The experimental results show that our framework can effectively predict the trajectory of UAV swarm.

[1]  Simon Portegies Zwart,et al.  Newton vs the machine: solving the chaotic three-body problem using deep neural networks , 2019, ArXiv.

[2]  Thomas W. Lucas,et al.  Fitting Lanchester equations to the battles of Kursk and Ardennes , 2004 .

[3]  Silvio Savarese,et al.  Structural-RNN: Deep Learning on Spatio-Temporal Graphs , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Thomas Müller,et al.  Robust drone detection for day/night counter-UAV with static VIS and SWIR cameras , 2017, Defense + Security.

[5]  Israel A. Wagner,et al.  Efficient cooperative search of smart targets using UAV Swarms1 , 2008, Robotica.

[6]  Kathryn Fraughnaugh,et al.  Introduction to graph theory , 1973, Mathematical Gazette.

[7]  Razvan Pascanu,et al.  Visual Interaction Networks: Learning a Physics Simulator from Video , 2017, NIPS.

[8]  Aleksandr Mylläri,et al.  The Three-body Problem from Pythagoras to Hawking , 2016 .

[9]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[10]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[11]  J. Bokor,et al.  Practical approach to real-time trajectory tracking of UAV formations , 2005, Proceedings of the 2005, American Control Conference, 2005..

[12]  Svetlana Lazebnik,et al.  Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering , 2018, NeurIPS.

[13]  Martin Simonovsky,et al.  Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Simon Portegies Zwart,et al.  Collisional N-body Dynamics Coupled to Self-gravitating Magnetohydrodynamics Reveals Dynamical Binary Formation , 2019, The Astrophysical Journal.

[15]  K.L.B. Cook,et al.  The Silent Force Multiplier: The History and Role of UAVs in Warfare , 2007, 2007 IEEE Aerospace Conference.

[16]  Brian Burridge,et al.  UAVs and the dawn of post‐modern warfare: A perspective on recent operations , 2003 .

[17]  R. Zemel,et al.  Neural Relational Inference for Interacting Systems , 2018, ICML.

[18]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[19]  Xinlei Chen,et al.  Iterative Visual Reasoning Beyond Convolutions , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Tristan Sherman,et al.  UAV Swarm Mapping Using a Fully Distributed Control Approach , 2019 .

[21]  Robert G. Belleman,et al.  High Performance Direct Gravitational N-body Simulations on Graphics Processing Units , 2007, ArXiv.

[22]  K. Sadananda Upadhya,et al.  A Simulation Model for Availability Under Battlefield Situations , 2000, Simul..

[23]  Weiran Yao,et al.  Online Trajectory Generation with Rendezvous for UAVs Using Multistage Path Prediction , 2017 .