Probabilistic Swarm Guidance Subject to Graph Temporal Logic Specifications

As the number of agents comprising a swarm increases, individual-agent-based control techniques for collective task completion become computationally intractable. We study a setting in which the agents move along the nodes of a graph, and the high-level task specifications for the swarm are expressed in a recently proposed language called graph temporal logic (GTL). By constraining the distribution of the swarm over the nodes of the graph, GTL specifies a wide range of properties, including safety, progress, and response. In contrast to the individual-agent-based control techniques, we develop an algorithm to control, in a decentralized and probabilistic manner, a collective property of the swarm: its density distribution. The algorithm, agnostic to the number of agents in the swarm, synthesizes a time-varying Markov chain modeling the time evolution of the density distribution of a swarm subject to GTL. We first formulate the synthesis of such a Markov chain as a mixed-integer nonlinear program (MINLP). Then, to address the intractability of MINLPs, we present an iterative scheme alternating between two relaxations of the MINLP: a linear program and a mixed-integer linear program. We evaluate the algorithm in several scenarios, including a rescue mission in a high-fidelity ROS-Gazebo simulation1.

[1]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[2]  Jie Chen,et al.  Towards Energy Optimization: Emergent Task Allocation in a Swarm of Foraging Robots , 2007, Adapt. Behav..

[3]  Ufuk Topcu,et al.  Controller Synthesis for Multi-Agent Systems With Intermittent Communication. A Metric Temporal Logic Approach , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Calin Belta,et al.  Multi-robot deployment from LTL specifications with reduced communication , 2011, IEEE Conference on Decision and Control and European Control Conference.

[5]  Radhika Nagpal,et al.  Programmable self-assembly in a thousand-robot swarm , 2014, Science.

[6]  Petter Nilsson,et al.  Provably-Correct Coordination of Large Collections of Agents with Counting Temporal Logic Constraints , 2017, 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS).

[7]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[8]  Ufuk Topcu,et al.  Receding Horizon Temporal Logic Planning , 2012, IEEE Transactions on Automatic Control.

[9]  Nikhil Nigam,et al.  Control of Multiple UAVs for Persistent Surveillance: Algorithm and Flight Test Results , 2012, IEEE Transactions on Control Systems Technology.

[10]  Calin Belta,et al.  A Fully Automated Framework for Control of Linear Systems from Temporal Logic Specifications , 2008, IEEE Transactions on Automatic Control.

[11]  Vijay Kumar,et al.  Swarm Distribution and Deployment for Cooperative Surveillance by Micro-Aerial Vehicles , 2016, J. Intell. Robotic Syst..

[12]  Calin Belta,et al.  SpaTeL: a novel spatial-temporal logic and its applications to networked systems , 2015, HSCC.

[13]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[14]  Dinesh Manocha,et al.  Reciprocal n-Body Collision Avoidance , 2011, ISRR.

[15]  Spring Berman,et al.  Optimized Stochastic Policies for Task Allocation in Swarms of Robots , 2009, IEEE Transactions on Robotics.

[16]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[17]  A. Agung Julius,et al.  Census Signal Temporal Logic Inference for Multiagent Group Behavior Analysis , 2016, IEEE Transactions on Automation Science and Engineering.

[18]  Aldo Jaimes,et al.  An approach to surveillance an area using swarm of fixed wing and quad-rotor unmanned aerial vehicles UAV(s) , 2008, 2008 IEEE International Conference on System of Systems Engineering.

[19]  Behçet Açikmese,et al.  A Markov chain approach to probabilistic swarm guidance , 2012, 2012 American Control Conference (ACC).

[20]  Nikolaos V. Sahinidis,et al.  Convexification and Global Optimization in Continuous and Mixed-Integer Nonlinear Programming , 2002 .

[21]  Petter Nilsson,et al.  Synchronous and asynchronous multi-agent coordination with cLTL+ constraints , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[22]  Asok Ray,et al.  Supervised Self-Organization of Homogeneous Swarms Using Ergodic Projections of Markov Chains , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Ufuk Topcu,et al.  Correct, Reactive, High-Level Robot Control , 2011, IEEE Robotics & Automation Magazine.

[24]  Vijay Kumar,et al.  Towards a swarm of agile micro quadrotors , 2012, Robotics: Science and Systems.

[25]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[26]  Zhe Xu,et al.  Swarm Signal Temporal Logic Inference for Swarm Behavior Analysis , 2019, IEEE Robotics and Automation Letters.

[27]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[28]  Ignacio E. Grossmann,et al.  A review and comparison of solvers for convex MINLP , 2018, Optimization and Engineering.

[29]  Benjamin Müller,et al.  The SCIP Optimization Suite 3.2 , 2016 .

[30]  Hadas Kress-Gazit,et al.  Automated synthesis of decentralized controllers for robot swarms from high-level temporal logic specifications , 2020, Auton. Robots.

[31]  Eric R. Zieyel Operations research : applications and algorithms , 1988 .

[32]  Behçet Açikmese,et al.  Decentralized probabilistic density control of autonomous swarms with safety constraints , 2015, Auton. Robots.

[33]  Saptarshi Bandyopadhyay,et al.  Probabilistic Swarm Guidance using Inhomogeneous Markov Chains , 2014 .

[34]  Joost-Pieter Katoen,et al.  Parametric LTL on Markov Chains , 2014, IFIP TCS.

[35]  Elwood S. Buffa,et al.  Graph Theory with Applications , 1977 .

[36]  Calin Belta,et al.  Robotic swarm control from spatio-temporal specifications , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[37]  Ufuk Topcu,et al.  Graph Temporal Logic Inference for Classification and Identification , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).