Multilevel Adaptive Aggregation for Markov Chains, with Application to Web Ranking

A multilevel adaptive aggregation method for calculating the stationary probability vector of an irreducible stochastic matrix is described. The method is a special case of the adaptive smoothed aggregation and adaptive algebraic multigrid methods for sparse linear systems and is also closely related to certain extensively studied iterative aggregation/disaggregation methods for Markov chains. In contrast to most existing approaches, our aggregation process does not employ any explicit advance knowledge of the topology of the Markov chain. Instead, adaptive agglomeration is proposed that is based on the strength of connection in a scaled problem matrix, in which the columns of the original problem matrix at each recursive fine level are scaled with the current probability vector iterate at that level. The strength of connection is determined as in the algebraic multigrid method, and the aggregation process is fully adaptive, with optimized aggregates chosen in each step of the iteration and at all recursive levels. The multilevel method is applied to a set of stochastic matrices that provide models for web page ranking. Numerical tests serve to illustrate for which types of stochastic matrices the multilevel adaptive method may provide significant speedup compared to standard iterative methods. The tests also provide more insight into why Google's PageRank model is a successful model for determining a ranking of web pages.

[1]  U. Krieger.  Numerical Solution of Large Finite Markov Chains by Algebraic Multigrid Techniques , 1995 .

[2]  Amy Nicole Langville,et al.  Updating Markov Chains with an Eye on Google's PageRank , 2005, SIAM J. Matrix Anal. Appl..

[3]  Amy Nicole Langville,et al.  A Survey of Eigenvector Methods for Web Information Retrieval , 2005, SIAM Rev..

[4]  W. Stewart,et al.  ITERATIVE METHODS FOR COMPUTING STATIONARY DISTRIBUTIONS OF NEARLY COMPLETELY DECOMPOSABLE MARKOV CHAINS , 1984 .

[5]  Kyle W. Kindle,et al.  An iterative aggregation-disaggregation algorithm for solving linear equations , 1986 .

[6]  William J. Stewart,et al.  Iterative aggregation/disaggregation techniques for nearly uncoupled markov chains , 1985, JACM.

[7]  I. Marek,et al.  Convergence theory of some classes of iterative aggregation/disaggregation methods for computing stationary probability vectors of stochastic matrices , 2003 .

[8]  A. Brandt.  Algebraic multigrid theory: The symmetric case , 1986 .

[9]  J. W. Ruge,et al.  4. Algebraic Multigrid , 1987 .

[10]  C. D. Meyer,et al.  Updating the stationary vector of an irreducible Markov chain , 2002 .

[11]  Van Emden Henson,et al.  Robustness and Scalability of Algebraic Multigrid , 1999, SIAM J. Sci. Comput..

[12]  Shaozhi Ye,et al.  Distributed PageRank computation based on iterative aggregation-disaggregation methods , 2005, CIKM '05.

[13]  Graham Horton,et al.  A Multi-Level Method for the Steady State Solution of Markov Chains , 2004, SimVis.

[14]  Carl D. Meyer,et al.  Deeper Inside PageRank , 2004, Internet Math..

[15]  S. Leutenegger,et al.  ON THE UTILITY OF THE MULTI-LEVEL ALGORITHM FOR THE SOLUTION OF NEARLY COMPLETELY DECOMPOSABLE MARKOV CHAINS , 1994 .

[16]  T. Manteuffel,et al.  Adaptive Smoothed Aggregation ( α SA ) Multigrid ∗ , 2005 .

[17]  Udo R. Krieger,et al.  Modeling and Analysis of Communication Systems Based on Computational Methods for Markov Chains , 1990, IEEE J. Sel. Areas Commun..

[18]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[19]  Graham Horton,et al.  A multi-level solution algorithm for steady-state Markov chains , 1994, SIGMETRICS.

[20]  Tugrul Dayar,et al.  Comparison of Partitioning Techniques for Two-Level Iterative Solvers on Large, Sparse Markov Chains , 1999, SIAM J. Sci. Comput..

[21]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[22]  Thomas A. Manteuffel,et al.  Adaptive Smoothed Aggregation (AlphaSA) Multigrid , 2005, SIAM Rev..

[23]  Udo R. Krieger,et al.  On a two-level multigrid solution method for finite Markov chains , 1995 .

[24]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[25]  D. Bartuschat.  Algebraic Multigrid , 2007 .

[26]  Ivo Marek,et al.  Convergence analysis of an iterative aggregation/disaggregation method for computing stationary probability vectors of stochastic matrices , 1998, Numer. Linear Algebra Appl..

[27]  Hans De Sterck,et al.  Reducing Complexity in Parallel Algebraic Multigrid Preconditioners , 2004, SIAM J. Matrix Anal. Appl..

[28]  Taher H. Haveliwala,et al.  The Second Eigenvalue of the Google Matrix , 2003 .

[29]  Herbert A. Simon,et al.  Aggregation of Variables in Dynamic Systems , 1961 .

[30]  Thomas A. Manteuffel,et al.  Adaptive Algebraic Multigrid , 2005, SIAM J. Sci. Comput..