Decentralized State-Dependent Markov Chain Synthesis for Swarm Guidance

This paper introduces a decentralized state-dependent Markov chain synthesis method for probabilistic swarm guidance of a large number of autonomous agents to a desired steady-state distribution. The probabilistic swarm guidance approach is based on using a Markov chain that determines the transition probabilities of agents to transition from one state to another while satisfying prescribed transition constraints and converging to a desired steady-state distribution. Our main contribution is to develop a decentralized approach to the Markov chain synthesis that updates the underlying column stochastic Markov matrix as a function of the state, i.e., the current swarm probability distribution. Having a decentralized synthesis method eliminates the need to have complex communication architecture. Furthermore, the proposed method aims to cause a minimal number of state transitions to minimize resource usage while guaranteeing convergence to the desired distribution. It is also shown that the convergence rate is faster when compared with previously proposed methodologies.

[1]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[2]  Spring Berman,et al.  Coverage and field estimation on bounded domains by diffusive swarms , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[3]  Martin Corless,et al.  Linear systems and control : an operator perspective , 2003 .

[4]  Emilio Frazzoli,et al.  Distributed Control of Spacecraft Formations via Cyclic Pursuit: Theory and Experiments , 2010 .

[5]  Vladimir J. Lumelsky,et al.  Decentralized Motion Planning for Multiple Mobile Robots: The Cocktail Party Model , 1997, Auton. Robots.

[6]  Behçet Açikmese,et al.  A Markov chain approach to probabilistic swarm guidance , 2012, 2012 American Control Conference (ACC).

[7]  Jonathan P. How,et al.  Co‐ordination and control of distributed spacecraft systems using convex optimization techniques , 2002 .

[8]  S. Ploen,et al.  A survey of spacecraft formation flying guidance and control (part 1): guidance , 2003, Proceedings of the 2003 American Control Conference, 2003..

[9]  Antonios Tsourdos,et al.  Local information-based control for probabilistic swarm distribution guidance , 2017, Swarm Intelligence.

[10]  Behcet Acikmese,et al.  Density Control for Decentralized Autonomous Agents with Conflict Avoidance , 2014, IFAC Proceedings Volumes.

[11]  Behcet Acikmese,et al.  Spectrum of Laplacians for Graphs with Self-Loops , 2015, 1505.08133.

[12]  Jonathan P. How,et al.  Spacecraft trajectory planning with avoidance constraints using mixed-integer linear programming , 2002 .

[13]  Saptarshi Bandyopadhyay,et al.  Probabilistic swarm guidance using optimal transport , 2014, 2014 IEEE Conference on Control Applications (CCA).

[14]  Behcet Acikmese,et al.  Velocity Field Generation for Density Control of Swarms using Heat Equation and Smoothing Kernels , 2017, 1710.00299.

[15]  Behçet Açikmese,et al.  Decentralized probabilistic density control of autonomous swarms with safety constraints , 2015, Auton. Robots.

[16]  Saptarshi Bandyopadhyay,et al.  Probabilistic Swarm Guidance using Inhomogeneous Markov Chains , 2014 .

[17]  Mehran Mesbahi,et al.  Multiple-Spacecraft Reconfiguration Through Collision Avoidance, Bouncing, and Stalemate , 2004 .

[18]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[19]  David S. Bayard,et al.  Markov Chain Approach to Probabilistic Guidance for Swarms of Autonomous Agents , 2015 .

[20]  Subramanian Ramakrishnan,et al.  Density-based control of multiple robots , 2011, Proceedings of the 2011 American Control Conference.