Tight Bounds on the Convergence Rate of Generalized Ratio Consensus Algorithms

The problems discussed in this paper are motivated by the ratio consensus problem formulated and solved in the context of the push-sum algorithm proposed in Kempe et al. (2003), and extended in Benezit et al. (2010) under the name weighted gossip algorithm. We consider a strictly stationary, ergodic, sequentially primitive sequence of $p \times p$ random matrices with non-negative entries $(A_n), ~n \ge 1.$ Let $x, w \in \mathbb R^p$ denote a pair of initial vectors, such that $w \ge 0, w \neq 0$. Our objective is to study the asymptotic properties of the ratios \begin{equation} e_i^\top A_n A_{n-1} \cdots A_1 x/ e_i^\top A_n A_{n-1} \cdots A_1 w, \qquad i=1,...,p, \end{equation} where $e_i$ is the unit vector with a single $1$ in its $i$-th coordinate. The main results of the paper provide upper bounds for the almost sure exponential convergence rate in terms of the spectral gap associated with $(A_n).$ It will be shown that these upper bounds are sharp. In the final section of the paper we present a variety of connections between the spectral gap of $(A_n)$ and the Birkhoff contraction coefficient of the product $A_n \cdots A_1.$ Our results complement previous results of Picci and Taylor (2013), and Tahbaz-Salehi and Jadbabaie (2010).

[1]  A. Dimakis,et al.  Geographic gossip: efficient aggregation for sensor networks , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[2]  J. Hammersley,et al.  First-Passage Percolation, Subadditive Processes, Stochastic Networks, and Generalized Renewal Theory , 1965 .

[3]  Christoforos N. Hadjicostis,et al.  Asynchronous coordination of distributed energy resources for the provisioning of ancillary services , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  J. Steele Probability theory and combinatorial optimization , 1987 .

[5]  John N. Tsitsiklis,et al.  Weighted Gossip: Distributed Averaging using non-doubly stochastic matrices , 2010, 2010 IEEE International Symposium on Information Theory.

[6]  Harry Kesten,et al.  First-Passage Percolation , 2003 .

[7]  V. I. Oseledec A multiplicative ergodic theorem: Lyapunov characteristic num-bers for dynamical systems , 1968 .

[8]  Christoforos N. Hadjicostis,et al.  Average Consensus in the Presence of Delays in Directed Graph Topologies , 2014, IEEE Transactions on Automatic Control.

[9]  John N. Tsitsiklis,et al.  The Lyapunov exponent and joint spectral radius of pairs of matrices are hard—when not impossible—to compute and to approximate , 1997, Math. Control. Signals Syst..

[10]  Carlos Silvestre,et al.  Broadcast and Gossip Stochastic Average Consensus Algorithms in Directed Topologies , 2019, IEEE Transactions on Control of Network Systems.

[11]  David Kempe,et al.  A decentralized algorithm for spectral analysis , 2004, STOC '04.

[12]  R. Bellman Limit theorems for non-commutative operations. I. , 1954 .

[13]  M. Raghunathan A proof of Oseledec’s multiplicative ergodic theorem , 1979 .

[14]  Y. Peres Domains of analytic continuation for the top Lyapunov exponent , 1992 .

[15]  John N. Tsitsiklis,et al.  A survey of computational complexity results in systems and control , 2000, Autom..

[16]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[17]  B. Lautrup,et al.  Products of random matrices. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  R. Jungers The Joint Spectral Radius: Theory and Applications , 2009 .

[19]  Paul Louis Hennequin,et al.  Ecole d'Eté de Probabilités de Saint-Flour V-1975 , 1976 .

[20]  J. Kingman,et al.  The Ergodic Theory of Subadditive Stochastic Processes , 1968 .

[21]  E. Seneta Non-negative Matrices and Markov Chains , 2008 .

[22]  Alexandros G. Dimakis,et al.  Order-Optimal Consensus Through Randomized Path Averaging , 2010, IEEE Transactions on Information Theory.

[23]  V. Protasov,et al.  Sets of nonnegative matrices without positive products , 2012 .

[24]  Walid Hachem,et al.  Analysis of Sum-Weight-Like Algorithms for Averaging in Wireless Sensor Networks , 2012, IEEE Transactions on Signal Processing.

[25]  Giorgio Picci,et al.  Almost sure exponential convergence to consensus of random gossip algorithms , 2013 .

[26]  Michael G. Rabbat,et al.  Push-Sum Distributed Dual Averaging for convex optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[27]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[28]  Long Wang,et al.  Recent Advances in Consensus of Multi-Agent Systems: A Brief Survey , 2017, IEEE Transactions on Industrial Electronics.

[29]  Julien M. Hendrickx,et al.  Push-Sum With Transmission Failures , 2015, IEEE Transactions on Automatic Control.

[30]  H. Flanders Differential Forms with Applications to the Physical Sciences , 1964 .

[31]  Alireza Tahbaz-Salehi,et al.  Consensus Over Ergodic Stationary Graph Processes , 2010, IEEE Transactions on Automatic Control.

[32]  H. Crichton-Miller Adaptation , 1926 .

[33]  C. SIAMJ. LYAPUNOV EXPONENTS FOR FINITE STATE NONLINEAR FILTERING , 1997 .

[34]  A. Stephen Morse,et al.  Asynchronous distributed averaging using double linear iterations , 2012, 2012 American Control Conference (ACC).

[35]  John N. Tsitsiklis,et al.  Distributed Anonymous Discrete Function Computation , 2010, IEEE Transactions on Automatic Control.

[36]  Yakov Pesin,et al.  The Multiplicative Ergodic Theorem , 2013 .