On Ergodicity, Infinite Flow, and Consensus in Random Models

We consider the ergodicity and consensus problem for a discrete-time linear dynamic model driven by random stochastic matrices, which is equivalent to studying these concepts for the product of such matrices. Our focus is on the model where the random matrices have independent but time-variant distribution. We introduce a new phenomenon, the infinite flow, and we study its fundamental properties and relations with the ergodicity and consensus. The central result is the infinite flow theorem establishing the equivalence between the infinite flow and the ergodicity for a class of independent random models, where the matrices in the model have a common steady state in expectation and a feedback property. For such models, this result demonstrates that the expected infinite flow is both necessary and sufficient for the ergodicity. The result is providing a deterministic characterization of the ergodicity, which can be used for studying the consensus and average consensus over random graphs.

[1]  R. Durrett.  Probability: Theory and Examples , 1993 .

[2]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[3]  M. Mesbahi,et al.  Agreement in presence of noise: pseudogradients on random geometric networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[4]  Behrouz Touri,et al.  Distributed consensus over network with noisy links , 2009, 2009 12th International Conference on Information Fusion.

[5]  Sandro Zampieri,et al.  Randomized consensus algorithms over large scale networks , 2007, 2007 Information Theory and Applications Workshop.

[6]  Alireza Tahbaz-Salehi,et al.  Consensus Over Ergodic Stationary Graph Processes , 2010, IEEE Transactions on Automatic Control.

[7]  Angelia Nedic,et al.  On the rate of convergence of distributed subgradient methods for multi-agent optimization , 2007, 2007 46th IEEE Conference on Decision and Control.

[8]  M. Dahleh.  Laboratory for Information and Decision Systems , 2005 .

[9]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[10]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[11]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[12]  Alexandros G. Dimakis,et al.  Geographic Gossip: Efficient Averaging for Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[13]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[14]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[15]  Ruggero Carli,et al.  Gossip consensus algorithms via quantized communication , 2009, Autom..

[16]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[17]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[18]  Michael Athans,et al.  Convergence and asymptotic agreement in distributed decision problems , 1982, 1982 21st IEEE Conference on Decision and Control.

[19]  R. Carli,et al.  Average consensus on networks with transmission noise or quantization , 2007, 2007 European Control Conference (ECC).

[20]  Jonathan H. Manton,et al.  Stochastic approximation for consensus seeking: Mean square and almost sure convergence , 2007, 2007 46th IEEE Conference on Decision and Control.

[21]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[22]  Jonathan H. Manton,et al.  Coordination and Consensus of Networked Agents with Noisy Measurements: Stochastic Algorithms and Asymptotic Behavior , 2009, SIAM J. Control. Optim..

[23]  Ruggero Carli,et al.  Communication constraints in the average consensus problem , 2008, Autom..

[24]  E. Seneta,et al.  Towards consensus: some convergence theorems on repeated averaging , 1977, Journal of Applied Probability.

[25]  Kurt Nawrotzki,et al.  Discrete Open Systems or Markov Chains in a Random Environment II , 1982, Journal of Information Processing and Cybernetics.

[26]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[27]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[28]  J. Norris.  Appendix: probability and measure , 1997 .

[29]  Asuman E. Ozdaglar,et al.  Rate of Convergence for Consensus with Delays , 2008, 2008 47th IEEE Conference on Decision and Control.

[30]  Amr El Abbadi,et al.  Distributed average consensus with stochastic communication failures , 2007, 2007 46th IEEE Conference on Decision and Control.

[31]  R. Srikant,et al.  Quantized Consensus , 2006, 2006 IEEE International Symposium on Information Theory.

[32]  Tamer Basar,et al.  Asymptotic agreement and convergence of asynchronous stochastic algorithms , 1986, 1986 25th IEEE Conference on Decision and Control.

[33]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[34]  M Rosenblatt,et al.  Products of independent identically distributed stochastic matrices , 1965 .

[35]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks: Link Failures and Channel Noise , 2007, ArXiv.

[36]  A. Ozdaglar,et al.  LIDS Report 1 Distributed Subgradient Methods over Random Networks , 2008 .

[37]  Stephen P. Boyd,et al.  Gossip algorithms: design, analysis and applications , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[38]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.