Strategy Synthesis for Surveillance-Evasion Games with Learning-Enabled Visibility Optimization

This paper studies a two-player game with a quantitative surveillance requirement on an adversarial target moving in a discrete state space and a secondary objective to maximize short-term visibility of the environment. We impose the surveillance requirement as a temporal logic constraint. We then use a greedy approach to determine vantage points that optimize a notion of information gain, namely, the number of newly-seen states. By using a convolutional neural network trained on a class of environments, we can efficiently approximate the information gain at each potential vantage point. Subsequent vantage points are chosen such that moving to that location will not jeopardize the surveillance requirement, regardless of any future action chosen by the target. Our method combines guarantees of correctness from formal methods with the scalability of machine learning to provide an efficient approach for surveillance-constrained visibility optimization.

[1]  Yanina Landa,et al.  Visibility of point clouds and exploratory path planning in unknown environments , 2008 .

[2]  David Janin Automata, logics, and infinite games: A guide to current research, edited by Erich Grädel, Wolfgang Thomas, and Thomas Wilke, Lecture Notes in Computer Science, vol. 2500 (Tutorial). Springer-Verlag, Berlin Heidelberg, 2002, viii + 385 pp. , 2004, Bulletin of Symbolic Logic.

[3]  Hai Lin,et al.  Distributed communication-aware motion planning for multi-agent systems from STL and SpaTeL specifications , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[4]  Richard Tsai,et al.  Discovery of point sources in the Helmholtz equation posed in unknown domains with obstacles , 2011 .

[5]  Geoffrey A. Hollinger,et al.  Search and pursuit-evasion in mobile robotics , 2011, Auton. Robots.

[6]  Martin Burger,et al.  Discovering a Point Source in Unknown Environments , 2008, WAFR.

[7]  Ufuk Topcu,et al.  Synthesis of Surveillance Strategies via Belief Abstraction , 2017, 2018 IEEE Conference on Decision and Control (CDC).

[8]  脇元 修一,et al.  IEEE International Conference on Robotics and Automation (ICRA) におけるフルードパワー技術の研究動向 , 2011 .

[9]  Konstantinos Kanistras,et al.  A survey of unmanned aerial vehicles (UAVs) for traffic monitoring , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[10]  Ufuk Topcu,et al.  Distributed Synthesis of Surveillance Strategies for Mobile Sensors , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[11]  Sandip Ray Scalable Techniques for Formal Verification , 2010 .

[12]  Zhengyuan Zhou,et al.  An Efficient Algorithm for a Visibility-Based Surveillance-Evasion Game , 2014 .

[13]  Joachim Hertzberg,et al.  An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments , 2003, Robotics Auton. Syst..

[14]  Pierre Alliez,et al.  Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[15]  Roland Siegwart,et al.  Receding Horizon "Next-Best-View" Planner for 3D Exploration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Christel Baier,et al.  Principles of model checking , 2008 .

[17]  Vasumathi Raman,et al.  Slugs: Extensible GR(1) Synthesis , 2016, CAV.

[18]  Jorge Urrutia,et al.  Art Gallery and Illumination Problems , 2000, Handbook of Computational Geometry.

[19]  Stefano Soatto,et al.  Information-Seeking Control Under Visibility-Based Uncertainty , 2013, Journal of Mathematical Imaging and Vision.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Huosheng Hu,et al.  Towards Autonomous Patrol Behaviours for UAVs , 2008 .

[22]  Nicola Basilico,et al.  Patrolling security games: Definition and algorithms for solving large instances with single patroller and single intruder , 2012, Artif. Intell..

[23]  Yen-Hsi Richard Tsai,et al.  Autonomous Exploration, Reconstruction, and Surveillance of 3D Environments Aided by Deep Learning , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[24]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[25]  Héctor H. González-Baños,et al.  Navigation Strategies for Exploring Indoor Environments , 2002, Int. J. Robotics Res..

[26]  Roland Siegwart,et al.  Receding horizon path planning for 3D exploration and surface inspection , 2018, Auton. Robots.

[27]  Lav Gupta,et al.  Survey of Important Issues in UAV Communication Networks , 2016, IEEE Communications Surveys & Tutorials.

[28]  Stefano Soatto,et al.  Information gathering control via exploratory path planning , 2012, 2012 46th Annual Conference on Information Sciences and Systems (CISS).

[29]  Alkis Gotovos,et al.  Efficient visual exploration and coverage with a micro aerial vehicle in unknown environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Joel W. Burdick,et al.  Online Algorithms with Discrete Visibility - Exploring Unknown Polygonal Environments , 2008, IEEE Robotics & Automation Magazine.

[31]  Li-Tien Cheng,et al.  Visibility of Point Clouds and Mapping of Unknown Environments , 2006, ACIVS.

[32]  Hai Lin,et al.  Communication-aware motion planning for multi-agent systems from signal temporal logic specifications , 2017, 2017 American Control Conference (ACC).

[33]  Olivier Morel,et al.  Autonomous patrol and surveillance system using unmanned aerial vehicles , 2015, 2015 IEEE 15th International Conference on Environment and Electrical Engineering (EEEIC).

[34]  Ufuk Topcu,et al.  Shield synthesis , 2017, Formal Methods Syst. Des..

[35]  Michal Pechoucek,et al.  Autonomous UAV Surveillance in Complex Urban Environments , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[36]  René Mazala,et al.  Infinite Games , 2001, Automata, Logics, and Infinite Games.