UAV/UGV Search and Capture of Goal-Oriented Uncertain Targets*This research was supported in part by ISF grant #1337/15 and part by a grant from MOST, Israel and the JST Japan

This paper considers a new, complex problem of UAV/UGV collaborative efforts to search and capture attackers under uncertainty. The goal of the defenders (UAV/UGV team) is to stop all attackers as quickly as possible, before they arrive at their selected goal. The uncertainty considered is twofold: the defenders do not know the attackers' location and destination, and there is also uncertainty in the defenders' sensing. We suggest a real-time algorithmic framework for the defenders, combining entropy and stochastic-temporal belief, that aims at optimizing the probability of a quick and successful capture of all of the attackers. We have empirically evaluated the algorithmic framework, and have shown its efficiency and significant performance improvement compared to other solutions.

[1]  David Silver,et al.  Smooth UCT Search in Computer Poker , 2015, IJCAI.

[2]  H.H.T. Liu,et al.  A cooperative UAV/UGV platform for wildfire detection and fighting , 2008, 2008 Asia Simulation Conference - 7th International Conference on System Simulation and Scientific Computing.

[3]  José Antonio López Orozco,et al.  A multi-UAV minimum time search planner based on ACOR , 2017, GECCO.

[4]  Sebastian Sardiña,et al.  Deceptive Path-Planning , 2017, IJCAI.

[5]  Taeyoung Lee,et al.  Autonomous exploration by expected information gain from probabilistic occupancy grid mapping , 2016, 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[6]  José Antonio López Orozco,et al.  Ant colony optimization for multi-UAV minimum time search in uncertain domains , 2018, Appl. Soft Comput..

[7]  K E Trummel,et al.  Technical Note - The Complexity of the Optimal Searcher Path Problem , 1986, Oper. Res..

[8]  Jonathan Schaeffer,et al.  Approximating Game-Theoretic Optimal Strategies for Full-scale Poker , 2003, IJCAI.

[9]  Claire J. Tomlin,et al.  A differential game approach to planning in adversarial scenarios: A case study on capture-the-flag , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Riccardo Muradore,et al.  Using Petri Net Plans for Modeling UAV-UGV Cooperative Landing , 2016, ECAI.

[11]  Juan Andrade-Cetto,et al.  Active pose SLAM with RRT* , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  András Frank,et al.  Submodular functions in graph theory , 1993, Discret. Math..

[13]  Swarat Chaudhuri,et al.  Controller synthesis with inductive proofs for piecewise linear systems: An SMT-based algorithm , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[14]  Javier González,et al.  An Entropy-Based Measurement of Certainty in Rao-Blackwellized Particle Filter Mapping , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Michael H. Bowling,et al.  Online Monte Carlo Counterfactual Regret Minimization for Search in Imperfect Information Games , 2015, AAMAS.

[16]  Uriel Feige,et al.  Approximation algorithms for allocation problems: Improving the factor of 1 - 1/e , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[17]  Mokshay Madiman,et al.  On the entropy of sums , 2008, 2008 IEEE Information Theory Workshop.

[18]  José Antonio López Orozco,et al.  A Real World Multi-UAV Evolutionary Planner for Minimum Time Target Detection , 2016, GECCO.

[19]  Gonzalo Pajares,et al.  Minimum time search for lost targets using cross entropy optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Rémi Coulom,et al.  Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search , 2006, Computers and Games.

[21]  Mo Chen,et al.  A path defense approach to the multiplayer reach-avoid game , 2014, 53rd IEEE Conference on Decision and Control.

[22]  Peter I. Cowling,et al.  Information Set Monte Carlo Tree Search , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[23]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.

[24]  Volker Willert,et al.  Motion control for UAV-UGV cooperation with visibility constraint , 2015, 2015 IEEE Conference on Control Applications (CCA).

[25]  Steven L. Waslander.  Unmanned Aerial and Ground Vehicle Teams: Recent Work and Open Problems , 2013 .

[26]  Gonzalo Pajares,et al.  Multi-UAV target search using decentralized gradient-based negotiation with expected observation , 2014, Inf. Sci..

[27]  Mo Chen,et al.  Multiplayer reach-avoid games via low dimensional solutions and maximum matching , 2014, 2014 American Control Conference.

[28]  Mo Chen,et al.  Multiplayer Reach-Avoid Games via Pairwise Outcomes , 2016, IEEE Transactions on Automatic Control.

[29]  Chang-jian Ru,et al.  Distributed Cooperative Search Control Method of Multiple UAVs for Moving Target , 2015 .

[30]  G. Monahan.  State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[31]  Geir E. Dullerud,et al.  Controller synthesis for linear dynamical systems with adversaries , 2016, HotSoS.

[32]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[33]  Marios M. Polycarpou,et al.  Decentralized Cooperative Search in UAV's Using Opportunistic Learning , 2002 .

[34]  Zhengyuan Zhou,et al.  A general, open-loop formulation for reach-avoid games , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[35]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[36]  Salah Sukkarieh,et al.  Multi-UAV target search using explicit decentralized gradient-based negotiation , 2011, 2011 IEEE International Conference on Robotics and Automation.