Distributed two-time-scale methods over clustered networks

In this paper, we consider consensus problems over a network of nodes, where the network is divided into a number of clusters. We are interested in the case where the communication topology within each cluster is dense as compared to the sparse communication across the clusters. Moreover, each cluster has one leader which can communicate with other leaders in different clusters. The goal of the nodes is to agree at some common value under the presence of communication delays across the clusters. Our main contribution is to propose a novel distributed two-time-scale consensus algorithm, which pertains to the separation in network topology of clustered networks. In particular, one scale is to model the dynamic of the agents in each cluster, which is much faster (due to the dense communication) than the scale describing the slowly aggregated evolution between the clusters (due to the sparse communication). We prove the convergence of the proposed method in the presence of uniform, but possibly arbitrarily large, communication delays between the leaders. In addition, we provided an explicit formula for the convergence rate of such algorithm, which characterizes the impact of delays and the network topology. Our results shows that after a transient time characterized by the topology of each cluster, the convergence of the two-time-scale consensus method only depends on the connectivity of the leaders. Finally, we validate our theoretical results by a number of numerical simulations on different clustered networks.

[1]  Kexue Zhang,et al.  Consensus seeking in multi-agent systems via hybrid protocols with impulse delays , 2017 .

[2]  R. Srikant,et al.  Finite-Time Performance Bounds and Adaptive Learning Rate Selection for Two Time-Scale Reinforcement Learning , 2019, NeurIPS.

[3]  Hoi-To Wai,et al.  Finite Time Analysis of Linear Two-timescale Stochastic Approximation with Markovian Noise , 2020, COLT.

[4]  F. Roosen‐Runge,et al.  Two time scales for self and collective diffusion near the critical point in a simple patchy model for proteins with floating bonds. , 2018, Soft matter.

[5]  Randolph J. Leiser,et al.  Emergence of localized patterns in globally coupled networks of relaxation oscillators with heterogeneous connectivity , 2017, bioRxiv.

[6]  Noureddine Manamanni,et al.  Impulsive Observer-Based Control in Clustered Networks of Linear Multi-Agent Systems , 2020, IEEE Transactions on Network Science and Engineering.

[7]  Dragan Nesic,et al.  Time scale modeling for consensus in sparse directed networks with time-varying topologies , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[8]  J. Tsitsiklis,et al.  Convergence rate of linear two-time-scale stochastic approximation , 2004, math/0405287.

[9]  Milad Siami,et al.  Fundamental Limits and Tradeoffs on Disturbance Propagation in Linear Dynamical Networks , 2014, IEEE Transactions on Automatic Control.

[10]  Mehran Mesbahi,et al.  Time-Scale Separation in Networks: State-Dependent Graphs and Consensus Tracking , 2019, IEEE Transactions on Control of Network Systems.

[11]  Duncan J. Watts,et al.  The Structure and Dynamics of Networks: (Princeton Studies in Complexity) , 2006 .

[12]  Aranya Chakrabortty,et al.  Block-Decentralized Model-Free Reinforcement Learning Control of Two Time-Scale Networks , 2019, 2019 American Control Conference (ACC).

[13]  Jacquelien M. A. Scherpen,et al.  Clustering approach to model order reduction of power networks with distributed controllers , 2018, Advances in Computational Mathematics.

[14]  A. Mokkadem,et al.  Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algorithms , 2006, math/0610329.

[15]  Anirban Das,et al.  Critical Neuronal Models with Relaxed Timescale Separation , 2018, Physical Review X.

[16]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[17]  Antoine Girard,et al.  Coordination in Networks of Linear Impulsive Agents , 2016, IEEE Transactions on Automatic Control.

[18]  R. Srikant,et al.  Convergence Rate of Distributed Subgradient Methods under Communication Delays , 2018, 2018 Annual American Control Conference (ACC).

[19]  Shie Mannor,et al.  Finite Sample Analysis of Two-Timescale Stochastic Approximation with Applications to Reinforcement Learning , 2017, COLT.

[20]  Thinh T. Doan,et al.  Distributed Stochastic Approximation for Solving Network Optimization Problems Under Random Quantization , 2018, 1810.11568.

[21]  Florian Dörfler,et al.  Novel results on slow coherency in consensus and power networks , 2013, 2013 European Control Conference (ECC).

[22]  Thinh T. Doan,et al.  Finite-Time Performance of Distributed Two-Time-Scale Stochastic Approximation , 2019, L4DC.

[23]  Noureddine Manamanni,et al.  Robust formation control under state constraints of multi-agent systems in clustered networks , 2020, Syst. Control. Lett..

[24]  Thinh T. Doan,et al.  Finite-Time Analysis and Restarting Scheme for Linear Two-Time-Scale Stochastic Approximation , 2019, SIAM J. Control. Optim..

[25]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[26]  Jamal Daafouz,et al.  Event triggering strategies for consensus in clustered networks , 2015, 2015 European Control Conference (ECC).

[27]  Roberto Tempo,et al.  A Tutorial on Modeling and Analysis of Dynamic Social Networks. Part II , 2018, Annu. Rev. Control..

[28]  Nader Motee,et al.  Measurable Observations for Network Observability , 2019, 2019 American Control Conference (ACC).

[29]  Amir G. Aghdam,et al.  Structural controllability of multi-agent networks: Robustness against simultaneous failures , 2013, Autom..

[30]  Magnus Egerstedt,et al.  Coordination of Robot Teams Over Long Distances: From Georgia Tech to Tokyo Tech and Back-An 11,000-km Multirobot Experiment , 2020, IEEE Control Systems.

[31]  Thinh T. Doan,et al.  Linear Two-Time-Scale Stochastic Approximation A Finite-Time Analysis , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[32]  Joe H. Chow,et al.  Time scale modeling of sparse dynamic networks , 1985 .

[33]  R. Srikant,et al.  On the Convergence Rate of Distributed Gradient Methods for Finite-Sum Optimization under Communication Delays , 2017, Proc. ACM Meas. Anal. Comput. Syst..

[34]  Florian Dörfler,et al.  Attack Detection and Identification in Cyber-Physical Systems -- Part II: Centralized and Distributed Monitor Design , 2012, ArXiv.

[35]  Chengzhi Yuan,et al.  Aggregate control of clustered networks with inter-cluster time delays , 2016, 2016 American Control Conference (ACC).

[36]  Emrah Biyik,et al.  Area Aggregation and Time Scale Modeling for Sparse Nonlinear Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[37]  Srijan Sengupta,et al.  Toward epidemic thresholds on temporal networks: a review and open questions , 2019, Applied Network Science.