Robustness of Large-Scale Stochastic Matrices to Localized Perturbations

Many notions of network centrality can be formulated in terms of invariant probability vectors of suitably defined stochastic matrices encoding the network structure. Analogously, invariant probability vectors of stochastic matrices allow one to characterize the asymptotic behavior of many linear network dynamics, e.g., arising in opinion dynamics in social networks as well as in distributed averaging algorithms for estimation or control. Hence, a central problem in network science and engineering is that of assessing the robustness of such invariant probability vectors to perturbations possibly localized on some relatively small part of the network. In this work, upper bounds are derived on the total variation distance between the invariant probability vectors of two stochastic matrices differing on a subset $\mathcal {W}$ of rows. Such bounds depend on three parameters: the mixing time and the entrance time on the set $\mathcal {W}$ for the Markov chain associated to one of the matrices; and the exit probability from the set $\mathcal {W}$ for the Markov chain associated to the other matrix. These results, obtained through coupling techniques, prove particularly useful in scenarios where $\mathcal {W}$ is a small subset of the state space, even if the difference between the two matrices is not small in any norm. Several applications to large-scale network problems are discussed, including robustness of Google’s PageRank algorithm, distributed averaging, consensus algorithms, and the voter model.

[1]  A. Yu. Mitrophanov Stability and exponential convergence of continuous-time Markov chains , 2003 .

[2]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[3]  Amy Nicole Langville,et al.  Google's PageRank and beyond - the science of search engine rankings , 2006 .

[4]  T. Liggett Interacting Particle Systems , 1985 .

[5]  V. Eguíluz,et al.  Conservation laws for the voter model in complex networks , 2004, cond-mat/0408101.

[6]  C. D. Meyer,et al.  Comparison of perturbation bounds for the stationary distribution of a Markov chain , 2001 .

[7]  Ravi Montenegro,et al.  Mathematical Aspects of Mixing Times in Markov Chains , 2006, Found. Trends Theor. Comput. Sci..

[8]  John N. Tsitsiklis,et al.  Distributed asynchronous deterministic and stochastic gradient optimization algorithms , 1986 .

[9]  Balázs Csanád Csáji,et al.  PageRank optimization by edge selection , 2009, Discret. Appl. Math..

[10]  Paul Van Dooren,et al.  Maximizing PageRank via outlinks , 2007, ArXiv.

[11]  Fan Chung,et al.  The heat kernel as the pagerank of a graph , 2007, Proceedings of the National Academy of Sciences.

[12]  David J. Aldous,et al.  Lower bounds for covering times for reversible Markov chains and random walks on graphs , 1989 .

[13]  M. Degroot Reaching a Consensus , 1974 .

[14]  T M Li Ge Te Interacting Particle Systems , 2013 .

[15]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[16]  E. Seneta,et al.  Perturbation of the stationary distribution measured by ergodicity coefficients , 1988, Advances in Applied Probability.

[17]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[18]  M. Mobilia,et al.  Voting and catalytic processes with inhomogeneities. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  M. Mobilia Does a single zealot affect an infinite group of voters? , 2003, Physical review letters.

[20]  Konstantin Avrachenkov,et al.  The Effect of New Links on Google Pagerank , 2006 .

[21]  T. Liggett,et al.  Stochastic Interacting Systems: Contact, Voter and Exclusion Processes , 1999 .

[22]  Qun Li,et al.  Global Clock Synchronization in Sensor Networks , 2006, IEEE Trans. Computers.

[23]  Yanbin Liu,et al.  Reputation propagation and agreement in mobile ad-hoc networks , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[24]  A. Y. Mitrophanov,et al.  Sensitivity and convergence of uniformly ergodic Markov chains , 2005 .

[25]  Matthew O. Jackson,et al.  Naïve Learning in Social Networks and the Wisdom of Crowds , 2010 .

[26]  J. T. Cox,et al.  Coalescing Random Walks and Voter Model Consensus Times on the Torus in $\mathbb{Z}^d$ , 1989 .

[27]  Asuman E. Ozdaglar,et al.  Opinion Fluctuations and Disagreement in Social Networks , 2010, Math. Oper. Res..

[28]  E. Seneta Sensitivity of finite Markov chains under perturbation , 1993 .

[29]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[30]  F. Fagnani,et al.  Communication constraints in coordinated consensus problems , 2006, 2006 American Control Conference.

[31]  C. D. Meyer Sensitivity of the Stationary Distribution of a Markov Chain , 1994, SIAM J. Matrix Anal. Appl..

[32]  C. D. Meyer,et al.  Markov chain sensitivity measured by mean first passage times , 2000 .

[33]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[34]  P. Schweitzer Perturbation theory and finite Markov chains , 1968 .

[35]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[36]  Elizabeth L. Wilmer,et al.  Markov Chains and Mixing Times , 2008 .

[37]  S. Smale,et al.  On the mathematics of emergence , 2007 .

[38]  Asuman Ozdaglar,et al.  Spread of (Mis)Information in Social Networks , 2009 .

[39]  Roberto Tempo,et al.  Computing the PageRank Variation for Fragile Web Data , 2009 .

[40]  P. Donnelly,et al.  Finite particle systems and infection models , 1983, Mathematical Proceedings of the Cambridge Philosophical Society.

[41]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[42]  Taher H. Haveliwala Topic-Sensitive PageRank: A Context-Sensitive Ranking Algorithm for Web Search , 2003, IEEE Trans. Knowl. Data Eng..

[43]  P. DeMarzo,et al.  Persuasion Bias, Social Influence, and Uni-Dimensional Opinions , 2001 .

[44]  R. Durrett Random Graph Dynamics: References , 2006 .