Sparsified block elimination for directed laplacians

We show that the sparsified block elimination algorithm for solving undirected Laplacian linear systems from [Kyng-Lee-Peng-Sachdeva-Spielman STOC’16] directly works for directed Laplacians. Given access to a sparsification algorithm that, on graphs with n vertices and m edges, takes time TS(m) to output a sparsifier with NS(n) edges, our algorithm solves a directed Eulerian system on n vertices and m edges to є relative accuracy in time O(TS(m) + NS(n)lognlog(n/є)) + Õ(TS(NS(n)) logn), where the Õ(·) notation hides loglog(n) factors. By previous results, this implies improved runtimes for linear systems in strongly connected directed graphs, PageRank matrices, and asymmetric M-matrices. When combined with slower constructions of smaller Eulerian sparsifiers based on short cycle decompositions, it also gives a solver algorithm that, after pre-processing the matrix in O(n2 logO(1) n) time, takes O(n log5n log(n / є)) time per solve. At the core of our analyses are constructions of augmented matrices whose Schur complements encode error matrices.

[1]  Jan van den Brand,et al.  Unifying Matrix Data Structures: Simplifying and Speeding up Iterative Algorithms , 2020, SOSA.

[2]  Jonathan A. Kelner,et al.  High-precision Estimation of Random Walks in Small Space , 2019, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[3]  Di Wang,et al.  Expander Decomposition and Pruning: Faster, Stronger, and Simpler , 2018, SODA.

[4]  Sushant Sachdeva,et al.  Short Cycles via Low-Diameter Decompositions , 2018, SODA.

[5]  Amin Saberi,et al.  Perron-Frobenius Theory in Nearly Linear Time: Positive Eigenvectors, M-matrices, Graph Kernels, and Other Applications , 2018, SODA.

[6]  Eylon Yogev,et al.  Optimal Short Cycle Decomposition in Almost Linear Time , 2019, ICALP.

[7]  Richard Peng,et al.  Solving Directed Laplacian Systems in Nearly-Linear Time through Sparse LU Factorizations , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[8]  Richard Peng,et al.  Graph Sparsification, Spectral Sketches, and Faster Resistance Computation, via Short Cycle Decompositions , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[9]  Richard Peng,et al.  Almost-linear-time algorithms for Markov chains and new spectral primitives for directed graphs , 2016, STOC.

[10]  Richard Peng,et al.  Faster Algorithms for Computing the Stationary Distribution, Simulating Random Walks, and More , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[11]  Sushant Sachdeva,et al.  Approximate Gaussian Elimination for Laplacians - Fast, Sparse, and Simple , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[12]  Richard Peng,et al.  Sparsified Cholesky and multigrid solvers for connection laplacians , 2015, STOC.

[13]  Yu Cheng,et al.  Efficient Sampling for Gaussian Graphical Models via Spectral Sparsification , 2015, COLT.

[14]  Richard Peng,et al.  An efficient parallel solver for SDD linear systems , 2013, STOC.

[15]  Shang-Hua Teng,et al.  Spectral sparsification of graphs: theory and algorithms , 2013, CACM.

[16]  Zeyuan Allen Zhu,et al.  A simple, combinatorial algorithm for solving SDD systems in nearly-linear time , 2013, STOC '13.

[17]  Gary L. Miller,et al.  Approximate Maximum Flow on Separable Undirected Graphs , 2012, SODA.

[18]  D. Spielman Algorithms, Graph Theory, and Linear Equations in Laplacian Matrices , 2011 .

[19]  Shang-Hua Teng,et al.  The Laplacian Paradigm: Emerging Algorithms for Massive Graphs , 2010, TAMC.