Co-evolutionary search path planning under constrained information-sharing for a cooperative unmanned aerial vehicle team

Mobile cooperative sensor networks are increasingly used for surveillance and reconnaissance tasks to support domain picture compilation. However, efficient distributed information gathering such as target search by a team of autonomous unmanned aerial vehicles (UAVs) remains very challenging in constrained environment. In this paper, we propose a new approach to learn resource-bounded multi-agent coordination for a multi-UAV target search problem subject to stringent communication bandwidth constraints in a dynamic uncertain environment. It relies on a new information-theoretic co-evolutionary algorithm to solve cooperative search path planning over receding horizons, providing agents with mutually adaptive and self-organizing behavior. The anytime coordination algorithm is coupled to a divergence-based information-sharing policy to exchange high-value world-state information under limited communication bandwidth. Computational results show the value of the proposed approach in comparison to a well-known reported technique.

[1]  Marios M. Polycarpou,et al.  Multi-UAV Cooperative Search Using an Opportunistic Learning Method , 2007 .

[2]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[3]  Yanli Yang,et al.  Decentralized cooperative search by networked UAVs in an uncertain environment , 2004, Proceedings of the 2004 American Control Conference.

[4]  Alexei Makarenko,et al.  Parametric POMDPs for planning in continuous state spaces , 2006, Robotics Auton. Syst..

[5]  Deborah Estrin,et al.  Directed diffusion for wireless sensor networking , 2003, TNET.

[6]  Haye Lau,et al.  Optimal Search in Structured Environments , 2007 .

[7]  J. R. Weisinger,et al.  A survey of the search theory literature , 1991 .

[8]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[9]  A. Finn,et al.  Design Challenges for an Autonomous Cooperative of UAVs , 2007, 2007 Information, Decision and Control.

[10]  Lawrence D. Stone OR Forum - What's Happened in Search Theory Since the 1975 Lanchester Prize? , 1989, Oper. Res..

[11]  Marios M. Polycarpou,et al.  Balancing search and target response in cooperative unmanned aerial vehicle (UAV) teams , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  Yanli Yang,et al.  Evidential map-building approaches for multi-UAV cooperative search , 2005, Proceedings of the 2005, American Control Conference, 2005..

[14]  Victor R. Lesser,et al.  Communication decisions in multi-agent cooperation: model and experiments , 2001, AGENTS '01.

[15]  M. Flint,et al.  Efficient Bayesian methods for updating and storing uncertain search information for UAVs , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[16]  Noa Agmon,et al.  The giving tree: constructing trees for efficient offline and online multi-robot coverage , 2008, Annals of Mathematics and Artificial Intelligence.

[17]  Samy Bengio,et al.  The Vehicle Routing Problem with Time Windows Part II: Genetic Search , 1996, INFORMS J. Comput..

[18]  Hugh F. Durrant-Whyte,et al.  Scalable Decentralised Control for Multi-Platform Reconnaissance and Information Gathering Tasks , 2006, 2006 9th International Conference on Information Fusion.

[19]  Jonathan P. How,et al.  Increasing autonomy of UAVs , 2009, IEEE Robotics & Automation Magazine.

[20]  Paul Scerri,et al.  An analysis and design methodology for belief sharing in large groups , 2007, 2007 10th International Conference on Information Fusion.

[21]  Yan Jin,et al.  Information Sharing in Cooperative Unmanned Aerial Vehicle Teams , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.