Exact rate for convergence in probability of averaging processes via generalized min-cut

We study the asymptotic exponential decay rate I for the convergence in probability of products W<sub>k</sub>W<sub>k-1</sub>...W<sub>1</sub> of random symmetric, stochastic matrices W<sub>k</sub>. Albeit it is known that the probability P that the product W<sub>k</sub>W<sub>k-1</sub>...W<sub>1</sub> is ∈ away from its limit converges exponentially fast to zero, i.e., P ~ e<sup>-kI</sup>, the asymptotic rate I has not been computed before. In this paper, assuming the positive entries of Wk are bounded away from zero, we explicitly characterize the rate I and show that it is a function of the underlying graphs that support the positive (non zero) entries of W<sub>k</sub>. In particular, the rate I is given by a certain generalization of the min-cut problem. Although this min-cut problem is in general combinatorial, we show how to exactly compute I in polynomial time for the commonly used matrix models, gossip and link failure. Further, for a class of models for which I is difficult to compute, we give easily computable bounds: I ≤ I ≤ I̅, where I and I̅ differ by a constant ratio. Finally, we show the relevance of I as a system design metric with the example of optimal power allocation in consensus+innovations distributed detection.

[1]  Alireza Tahbaz-Salehi,et al.  Consensus Over Ergodic Stationary Graph Processes , 2010, IEEE Transactions on Automatic Control.

[2]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[3]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[4]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[5]  Mechthild Stoer,et al.  A simple min-cut algorithm , 1997, JACM.

[6]  Behrouz Touri,et al.  On backward product of stochastic matrices , 2011, Autom..

[7]  José M. F. Moura,et al.  Large Deviations Performance of Consensus+Innovations Distributed Detection With Non-Gaussian Observations , 2011, IEEE Transactions on Signal Processing.

[8]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[9]  Behrouz Touri,et al.  Product of Random Stochastic Matrices , 2011, IEEE Transactions on Automatic Control.

[10]  José M. F. Moura,et al.  Distributed Detection via Gaussian Running Consensus: Large Deviations Asymptotic Analysis , 2011, IEEE Transactions on Signal Processing.

[11]  Alireza Tahbaz-Salehi,et al.  On consensus over random networks , 2006 .

[12]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[13]  Ananthram Swami,et al.  Consensus algorithms over fading channels , 2010, 2010 - MILCOM 2010 MILITARY COMMUNICATIONS CONFERENCE.

[14]  João M. F. Xavier,et al.  Consensus and Products of Random Stochastic Matrices: Exact Rate for Convergence in Probability , 2012, IEEE Transactions on Signal Processing.

[15]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .