Data Transfer via UAV Swarm Behaviours

This paper presents an adaptive robotic swarm of Unmanned Aerial Vehicles (UAVs) enabling communications between separated non-swarm devices. The swarm nodes utilise machine learning and hyper-heuristic rule evolution to enable each swarm member to act appropriately for the given environment. The contribution of the machine learning is verified with an exploration of swarms with and without this module. The exploration finds that in challenging environments the learning greatly improves the swarm’s ability to complete the task. The swarm evolution process of this study is found to successfully create different data transfer methods depending on the separation of non-swarm devices and the communication range of the swarm members. This paper also explores the resilience of the swarm to agent loss, and the scalability of the swarm in a range of environment sizes. In regard to resilience, the swarm is capable of recovering from agent loss and is found to have improved evolution. In regard to scalability, the swarm is observed to have no upper limit to the number of agents deployed in an environment. However, the size of the environment is seen to be a limit for optimal swarm performance.

[1]  Han-Lim Choi,et al.  The role of information assumptions in decentralized task allocation: A tutorial , 2016, IEEE Control Systems.

[2]  Riccardo Poli,et al.  There Is a Free Lunch for Hyper-Heuristics, Genetic Programming and Computer Scientists , 2009, EuroGP.

[3]  Anna Helena Reali Costa,et al.  Experience generalization for concurrent reinforcement learners: the minimax-QS algorithm , 2002, AAMAS '02.

[4]  Mostafa H. Ammar,et al.  Message ferrying: proactive routing in highly-partitioned wireless ad hoc networks , 2003, The Ninth IEEE Workshop on Future Trends of Distributed Computing Systems, 2003. FTDCS 2003. Proceedings..

[5]  Riccardo Poli,et al.  Evolving timetabling heuristics using a grammar-based genetic programming hyper-heuristic framework , 2009, Memetic Comput..

[6]  Patrick De Causmaecker,et al.  Hyper-heuristics with a dynamic heuristic set for the home care scheduling problem , 2010, IEEE Congress on Evolutionary Computation.

[7]  Chee Peng Lim,et al.  A Q-learning-based multi-agent system for data classification , 2017, Appl. Soft Comput..

[8]  Jaime Lloret Mauri,et al.  Improved Geographical Routing in Vehicular Ad Hoc Networks , 2015, Wirel. Pers. Commun..

[9]  Eric W. Frew,et al.  Cooperative Electronic Chaining Using Small Unmanned Aircraft , 2007 .

[10]  Riccardo Poli,et al.  Cost-Benefit Investigation of a Genetic-Programming Hyperheuristic , 2007, Artificial Evolution.

[11]  Jaime Llorca,et al.  Mobility Control for Joint Coverage-Connectivity Optimization in Directional Wireless Backbone Networks , 2007, MILCOM 2007 - IEEE Military Communications Conference.

[12]  Michèle Sebag,et al.  The grand challenge of computer Go , 2012, Commun. ACM.

[13]  Flávio Neves,et al.  A cooperative architecture for swarm robotic based on dynamic fuzzy cognitive maps , 2017, Eng. Appl. Artif. Intell..

[14]  Daniel B. Faria.  Modeling Signal Attenuation in IEEE 802.11 Wireless LANs-Vol. 1 , 2022 .

[15]  Eliseo Ferrante,et al.  Swarm robotics: a review from the swarm engineering perspective , 2013, Swarm Intelligence.

[16]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[17]  Yutaka Uchimura,et al.  Deployment control of wireless multihop-relay mobile robots based on voronoi partition , 2013 .

[18]  Ellen W. Zegura,et al.  A message ferrying approach for data delivery in sparse mobile ad hoc networks , 2004, MobiHoc '04.

[19]  Daniele Nardi,et al.  Multi-robot search for a moving target: Integrating world modeling, task assignment and context , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Graham Kendall,et al.  A Monte Carlo Hyper-Heuristic To Optimise Component Placement Sequencing For Multi Head Placement Machine , 2003 .

[21]  Eliseo Ferrante,et al.  Collective Decision with 100 Kilobots Speed vs Accuracy in Binary Discrimination Problems , 2015 .

[22]  Nikolaus Correll,et al.  Modeling multi-robot task allocation with limited information as global game , 2016, Swarm Intelligence.

[23]  Ying Zhang,et al.  Optimal Backbone Generation for Robotic Relay Networks , 2011, 2011 Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN).

[24]  Csaba Szepesvári,et al.  Algorithms for Reinforcement Learning , 2010, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[25]  Graham Kendall,et al.  Grammatical Evolution of Local Search Heuristics , 2012, IEEE Transactions on Evolutionary Computation.

[26]  Phillip Smith,et al.  Data Transfer via UAV Swarm Behaviours Rule Generation, Evolution and Learning , 2018 .

[27]  Sándor P. Fekete,et al.  Structured triangulation in multi-robot systems: Coverage, patrolling, Voronoi partitions, and geodesic centers , 2016, Int. J. Robotics Res..

[28]  Erol Sahin,et al.  Swarm Robotics: From Sources of Inspiration to Domains of Application , 2004, Swarm Robotics.

[29]  Jan Carlo Barca,et al.  Adaptive data transfer methods via policy evolution for UAV swarms , 2017, 2017 27th International Telecommunication Networks and Applications Conference (ITNAC).

[30]  Mark Johnston,et al.  Deception, blindness and disorientation in particle swarm optimization applied to noisy problems , 2014, Swarm Intelligence.

[31]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[32]  Timothy X. Brown,et al.  Delay-tolerant communication using mobile robotic helper nodes , 2008, 2008 6th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks and Workshops.

[33]  Jonathan Timmis,et al.  An immune-inspired swarm aggregation algorithm for self-healing swarm robotic systems , 2016, Biosyst..

[34]  Robert Hunjet,et al.  Data ferrying in tactical networks using swarm intelligence and stigmergic coordination , 2016, 2016 26th International Telecommunication Networks and Applications Conference (ITNAC).

[35]  Abdolhossein Sarrafzadeh,et al.  Swarm Intelligent Compressive Routing in Wireless Sensor Networks , 2015, Comput. Intell..

[36]  I-Chen Wu,et al.  Incentive Learning in Monte Carlo Tree Search , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[37]  Arne Løkketangen,et al.  Generating meta-heuristic optimization code using ADATE , 2010, J. Heuristics.

[38]  Gaurav S. Sukhatme,et al.  An autonomous Wireless Networked Robotics System for backbone deployment in highly-obstructed environments , 2013, Ad Hoc Networks.