Fully dynamic spectral vertex sparsifiers and applications

We study dynamic algorithms for maintaining spectral vertex sparsifiers of graphs with respect to a set of terminals T of our choice. Such objects preserve pairwise resistances, solutions to systems of linear equations, and energy of electrical flows between the terminals in T. We give a data structure that supports insertions and deletions of edges, and terminal additions, all in sublinear time. We then show the applicability of our result to the following problems. (1) A data structure for dynamically maintaining solutions to Laplacian systems L x = b, where L is the graph Laplacian matrix and b is a demand vector. For a bounded degree, unweighted graph, we support modifications to both L and b while providing access to є-approximations to the energy of routing an electrical flow with demand b, as well as query access to entries of a vector x such that ∥x−L† b ∥L ≤ є ∥L† b ∥L in Õ(n11/12є−5) expected amortized update and query time. (2) A data structure for maintaining fully dynamic All-Pairs Effective Resistance. For an intermixed sequence of edge insertions, deletions, and resistance queries, our data structures returns (1 ± є)-approximation to all the resistance queries against an oblivious adversary with high probability. Its expected amortized update and query times are Õ(min(m3/4,n5/6 є−2) є−4) on an unweighted graph, and Õ(n5/6є−6) on weighted graphs. The key ingredients in these results are (1) the intepretation of Schur complement as a sum of random walks, and (2) a suitable choice of terminals based on the behavior of these random walks to make sure that the majority of walks are local, even when the graph itself is highly connected and (3) maintenance of these local walks and numerical solutions using data structures. These results together represent the first data structures for maintain key primitives from the Laplacian paradigm for graph algorithms in sublinear time without assumptions on the underlying graph topologies. The importance of routines such as effective resistance, electrical flows, and Laplacian solvers in the static setting make us optimistic that some of our components can provide new building blocks for dynamic graph algorithms.

[1]  David R. Karger,et al.  Approximating s – t Minimum Cuts in ~ O(n 2 ) Time , 2007 .

[2]  Alexandr Andoni,et al.  Towards (1 + ∊)-Approximate Flow Sparsifiers , 2013, SODA.

[3]  Aleksander Madry,et al.  Fast Approximation Algorithms for Cut-Based Problems in Undirected Graphs , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[4]  Shay Solomon,et al.  Simple deterministic algorithms for fully dynamic maximal matching , 2012, STOC '13.

[5]  Florian Dörfler,et al.  Kron Reduction of Graphs With Applications to Electrical Networks , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[7]  D. Spielman Algorithms, Graph Theory, and Linear Equations in Laplacian Matrices , 2011 .

[8]  Ittai Abraham,et al.  Fully dynamic all-pairs shortest paths with worst-case update-time revisited , 2016, SODA.

[9]  Pierre Vandergheynst,et al.  Spectrally approximating large graphs with smaller graphs , 2018, ICML.

[10]  Uriel Feige,et al.  Short random walks on graphs , 1993, SIAM J. Discret. Math..

[11]  Shiri Chechik,et al.  Deterministic decremental single source shortest paths: beyond the o(mn) bound , 2016, STOC.

[12]  Christian Wulff-Nilsen,et al.  Dynamic Minimum Spanning Forest with Subpolynomial Worst-Case Update Time , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[13]  Sandeep Sen,et al.  Fully Dynamic Maximal Matching in O (log n) Update Time , 2011, FOCS.

[14]  Aleksander Madry,et al.  Fast Generation of Random Spanning Trees and the Effective Resistance Metric , 2015, SODA.

[15]  Shang-Hua Teng,et al.  Spectral Sparsification of Graphs , 2008, SIAM J. Comput..

[16]  Sandeep Sen,et al.  Fully Dynamic Maximal Matching in O(log n) Update Time , 2015, SIAM J. Comput..

[17]  Nikhil Srivastava,et al.  Graph sparsification by effective resistances , 2008, SIAM J. Comput..

[18]  Giuseppe F. Italiano,et al.  A new approach to dynamic all pairs shortest paths , 2004, JACM.

[19]  Shang-Hua Teng,et al.  The Laplacian Paradigm: Emerging Algorithms for Massive Graphs , 2010, TAMC.

[20]  Shay Solomon,et al.  Deterministic Algorithms for Fully Dynamic Maximal Matching , 2012, ArXiv.

[21]  Sebastian Krinninger,et al.  Dynamic low-stretch trees via dynamic low-diameter decompositions , 2018, STOC.

[22]  Zhongzhi Zhang,et al.  Kirchhoff Index as a Measure of Edge Centrality in Weighted Networks: Nearly Linear Time Algorithms , 2017, SODA.

[23]  Greg N. Frederickson,et al.  Data Structures for On-Line Updating of Minimum Spanning Trees, with Applications , 1985, SIAM J. Comput..

[24]  Richard Peng,et al.  Fully Dynamic $(1+\epsilon)$-Approximate Matchings , 2013, 1304.0378.

[25]  Richard Peng,et al.  Offline Dynamic Higher Connectivity , 2017, ArXiv.

[26]  Mikkel Thorup,et al.  Poly-logarithmic deterministic fully-dynamic algorithms for connectivity, minimum spanning tree, 2-edge, and biconnectivity , 2001, JACM.

[27]  Satish Rao,et al.  Localization of Electrical Flows , 2017, SODA.

[28]  David Eppstein,et al.  Offline Algorithms for Dynamic Minimum Spanning Tree Problems , 1991, J. Algorithms.

[29]  Frank Thomson Leighton,et al.  Vertex Sparsifiers and Abstract Rounding Algorithms , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[30]  Soumojit Sarkar,et al.  Fully dynamic randomized algorithms for graph spanners , 2012, TALG.

[31]  Yu Cheng,et al.  Efficient Sampling for Gaussian Graphical Models via Spectral Sparsification , 2015, COLT.

[32]  Gary L. Miller,et al.  A Nearly-m log n Time Solver for SDD Linear Systems , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[33]  Ankur Moitra,et al.  Approximation Algorithms for Multicommodity-Type Problems with Guarantees Independent of the Graph Size , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[34]  Christian Wulff-Nilsen,et al.  Fully-dynamic minimum spanning forest with improved worst-case update time , 2016, STOC.

[35]  Christian Wulff-Nilsen,et al.  Faster Fully-Dynamic Minimum Spanning Forest , 2014, ESA.

[36]  Monika Henzinger,et al.  Decremental Single-Source Shortest Paths on Undirected Graphs in Near-Linear Total Update Time , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[37]  Richard Peng,et al.  Faster Spectral Sparsification and Numerical Algorithms for SDD Matrices , 2012, ACM Trans. Algorithms.

[38]  Jose Augusto Ramos Soares,et al.  Graph Spanners: a Survey , 1992 .

[39]  Harald Räcke,et al.  Optimal hierarchical decompositions for congestion minimization in networks , 2008, STOC.

[40]  Gary L. Miller,et al.  Approximate Maximum Flow on Separable Undirected Graphs , 2012, SODA.

[41]  Joel A. Tropp,et al.  User-Friendly Tail Bounds for Sums of Random Matrices , 2010, Found. Comput. Math..

[42]  John Peebles,et al.  Sampling random spanning trees faster than matrix multiplication , 2016, STOC.

[43]  Alexandr Andoni,et al.  On Solving Linear Systems in Sublinear Time , 2018, ITCS.

[44]  Robert Krauthgamer,et al.  Mimicking Networks and Succinct Representations of Terminal Cuts , 2013, SODA.

[45]  Pan Peng,et al.  Dynamic Effective Resistances and Approximate Schur Complement on Separable Graphs , 2018, ESA.

[46]  Shang-Hua Teng,et al.  Nearly-Linear Time Algorithms for Preconditioning and Solving Symmetric, Diagonally Dominant Linear Systems , 2006, SIAM J. Matrix Anal. Appl..

[47]  Krzysztof Onak,et al.  Maintaining a large matching and a small vertex cover , 2010, STOC '10.

[48]  David Eppstein,et al.  Sparsification—a technique for speeding up dynamic graph algorithms , 1997, JACM.

[49]  Thatchaphol Saranurak,et al.  Dynamic spanning forest with worst-case update time: adaptive, Las Vegas, and O(n1/2 - ε)-time , 2017, STOC.

[50]  Jonah Sherman,et al.  Nearly Maximum Flows in Nearly Linear Time , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[51]  Mikkel Thorup,et al.  Incremental Exact Min-Cut in Poly-logarithmic Amortized Update Time , 2016, ESA.

[52]  Giuseppe F. Italiano,et al.  A new approach to dynamic all pairs shortest paths , 2003, STOC '03.

[53]  Monika Henzinger,et al.  A Static 2-Approximation Algorithm for Vertex Connectivity and Incremental Approximation Algorithms for Edge and Vertex Connectivity , 1997, J. Algorithms.

[54]  Shang-Hua Teng,et al.  Spectral sparsification of graphs: theory and algorithms , 2013, CACM.

[55]  Sushant Sachdeva,et al.  Approximate Gaussian Elimination for Laplacians - Fast, Sparse, and Simple , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[56]  Satish Rao,et al.  A tight bound on approximating arbitrary metrics by tree metrics , 2003, STOC '03.

[57]  Richard Peng,et al.  Determinant-Preserving Sparsification of SDDM Matrices with Applications to Counting and Sampling Spanning Trees , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[58]  Piotr Sankowski,et al.  Min-Cuts and Shortest Cycles in Planar Graphs in O(n loglogn) Time , 2011, ESA.

[59]  Monika Henzinger,et al.  New deterministic approximation algorithms for fully dynamic matching , 2016, STOC.

[60]  Yin Tat Lee,et al.  An Almost-Linear-Time Algorithm for Approximate Max Flow in Undirected Graphs, and its Multicommodity Generalizations , 2013, SODA.

[61]  Andreas Loukas Graph reduction by local variation , 2018, ArXiv.

[62]  Richard J. Lipton,et al.  Random walks, universal traversal sequences, and the complexity of maze problems , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[63]  Pan Peng,et al.  The Power of Vertex Sparsifiers in Dynamic Graph Algorithms , 2017, ESA.

[64]  Richard Peng,et al.  Sparsified Cholesky and multigrid solvers for connection laplacians , 2015, STOC.

[65]  Piotr Sankowski,et al.  Dynamic transitive closure via dynamic matrix inverse: extended abstract , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[66]  Monika Henzinger,et al.  Dynamic Approximate All-Pairs Shortest Paths: Breaking the O(mn) Barrier and Derandomization , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[67]  Bruce M. Kapron,et al.  Dynamic graph connectivity in polylogarithmic worst case time , 2013, SODA.

[68]  Konstantin Makarychev,et al.  Metric extension operators, vertex sparsifiers and Lipschitz extendability , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[69]  Mikkel Thorup,et al.  Fully-dynamic min-cut , 2001, STOC '01.

[70]  Richard Peng,et al.  On Fully Dynamic Graph Sparsifiers , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[71]  Aaron Schild,et al.  An almost-linear time algorithm for uniform random spanning tree generation , 2017, STOC.

[72]  Mikkel Thorup,et al.  Incremental Exact Min-Cut in Polylogarithmic Amortized Update Time , 2018, ACM Trans. Algorithms.

[73]  Shay Solomon,et al.  Fully Dynamic Maximal Matching in Constant Update Time , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[74]  Richard Peng,et al.  An efficient parallel solver for SDD linear systems , 2013, STOC.

[75]  Richard Peng,et al.  Density Independent Algorithms for Sparsifying k-Step Random Walks , 2017, APPROX-RANDOM.

[76]  Sudipto Guha,et al.  Semi-Supervised Learning on Data Streams via Temporal Label Propagation , 2018, ICML.