Improved Distributed Expander Decomposition and Nearly Optimal Triangle Enumeration

An(ε,φ)-expander decomposition of a graph G=(V,E) is a clustering of the vertices V=V1∪…∪ Vx such that (1) each cluster Vi induces subgraph with conductance at least φ, and (2) the number of inter-cluster edges is at most ε|E|. In this paper, we give an improved distributed expander decomposition, and obtain a nearly optimal distributed triangle enumeration algorithm in the CONGEST model. Specifically, we construct an (ε,φ)-expander decomposition with φ=(ε/log n)2 O(k) in O(n2/k ⋅ poly (1/φ, log n))rounds for any ε ∈(0,1) and positive integer k. For example, a (1/no(1), 1/no(1))-expander decomposition only requires O(no(1)) rounds to compute, which is optimal up to subpolynomial factors, and a (0.01,1/poly log n)-expander decomposition can be computed in O(nγ) rounds, for any arbitrarily small constant γ > 0. Previously, the algorithm by Chang, Pettie, and Zhang can construct a (1/6,1/poly log n)-expander decomposition using Õ (n1-δ) rounds for any δ > 0, with a caveat that the algorithm is allowed to throw away a set of edges into an extra part which form a subgraph with arboricity at most nδ. Our algorithm does not have this caveat. By slightly modifying the distributed algorithm for routing on expanders by Ghaffari, Kuhn and Su [PODC'17], we obtain a triangle enumeration algorithm using Õ(n1/3) rounds. This matches the lower bound by Izumi and LeGall [PODC'17] and Pandurangan, Robinson and Scquizzato [SPAA'18] of Ø(n1/3) which holds even in the CONGESTED-CLIQUE model. To the best of our knowledge, this provides the first non-trivial example for a distributed problem that has essentially the same complexity (up to a polylogarithmic factor) in both CONGEST and CONGESTED-CLIQUE. The key technique in our proof is the first distributed approximation algorithm for finding a low conductance cut that is as balanced as possible. Previous distributed sparse cut algorithms do not have this nearly most balanced guarantee.

[1]  Richard Peng,et al.  Almost-linear-time algorithms for Markov chains and new spectral primitives for directed graphs , 2016, STOC.

[2]  Seth Pettie,et al.  Distributed Triangle Detection via Expander Decomposition , 2018, SODA.

[3]  Klaus Jansen,et al.  Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques , 2006, Lecture Notes in Computer Science.

[4]  Hsin-Hao Su,et al.  Distributed MST and Routing in Almost Mixing Time , 2017, PODC.

[5]  Mikkel Thorup,et al.  Planning for Fast Connectivity Updates , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[6]  Mark Jerrum,et al.  Approximating the Permanent , 1989, SIAM J. Comput..

[7]  Nisheeth K. Vishnoi,et al.  Towards an SDP-based approach to spectral methods: a nearly-linear-time algorithm for graph partitioning and decomposition , 2010, SODA '11.

[8]  Christoph Lenzen,et al.  Fooling views: a new lower bound technique for distributed computations under congestion , 2017, Distributed Computing.

[9]  Christian Wulff-Nilsen,et al.  Dynamic Minimum Spanning Forest with Subpolynomial Worst-Case Update Time , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[10]  Keren Censor-Hillel,et al.  Sparse Matrix Multiplication and Triangle Listing in the Congested Clique Model , 2018, OPODIS.

[11]  Shang-Hua Teng,et al.  A Local Clustering Algorithm for Massive Graphs and Its Application to Nearly Linear Time Graph Partitioning , 2008, SIAM J. Comput..

[12]  Satish Rao,et al.  Expander flows, geometric embeddings and graph partitioning , 2004, STOC '04.

[13]  Santosh S. Vempala,et al.  On clusterings-good, bad and spectral , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[14]  Christoph Lenzen,et al.  "Tri, Tri Again": Finding Triangles and Small Subgraphs in a Distributed Setting - (Extended Abstract) , 2012, DISC.

[15]  Anisur Rahaman Molla,et al.  Distributed Computation of Sparse Cuts via Random Walks , 2015, ICDCN.

[16]  Prasad Raghavendra,et al.  Graph expansion and the unique games conjecture , 2010, STOC '10.

[17]  Zeyuan Allen Zhu,et al.  Flow-Based Algorithms for Local Graph Clustering , 2013, SODA.

[18]  Dana Ron,et al.  A Sublinear Bipartiteness Tester for Bounded Degree Graphs , 1999, Comb..

[19]  Shang-Hua Teng,et al.  Spectral Sparsification of Graphs , 2008, SIAM J. Comput..

[20]  Gary L. Miller,et al.  Parallel graph decompositions using random shifts , 2013, SPAA.

[21]  Fabian Kuhn,et al.  Possibilities and Impossibilities for Distributed Subgraph Detection , 2018, SPAA.

[22]  Christian Wulff-Nilsen,et al.  Fully-dynamic minimum spanning forest with improved worst-case update time , 2016, STOC.

[23]  Christoph Lenzen,et al.  Algebraic methods in the congested clique , 2015, Distributed Computing.

[24]  Shang-Hua Teng,et al.  Nearly-Linear Time Algorithms for Preconditioning and Solving Symmetric, Diagonally Dominant Linear Systems , 2006, SIAM J. Matrix Anal. Appl..

[25]  Monika Henzinger,et al.  Distributed edge connectivity in sublinear time , 2019, STOC.

[26]  Peter Robinson,et al.  On the Distributed Complexity of Large-Scale Graph Computations , 2016, SPAA.

[27]  Sriram V. Pemmaraju,et al.  Equitable colorings extend Chernoff-Hoeffding bounds , 2001, SODA '01.

[28]  N Linial,et al.  Low diameter graph decompositions , 1993, Comb..

[29]  Luca Trevisan,et al.  Approximation algorithms for unique games , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[30]  Mohsen Ghaffari,et al.  New Distributed Algorithms in Almost Mixing Time via Transformations from Parallel Algorithms , 2018, DISC.

[31]  Dana Ron,et al.  A Sublinear Bipartiteness Tester for Bounded Degree Graphs , 1998, STOC '98.

[32]  Nikhil Srivastava,et al.  Graph sparsification by effective resistances , 2008, SIAM J. Comput..

[33]  Thatchaphol Saranurak,et al.  Dynamic spanning forest with worst-case update time: adaptive, Las Vegas, and O(n1/2 - ε)-time , 2017, STOC.

[34]  François Le Gall,et al.  Triangle Finding and Listing in CONGEST Networks , 2017, PODC.

[35]  Tomasz Jurdzinski,et al.  MST in O(1) Rounds of Congested Clique , 2018, SODA.

[36]  François Le Gall,et al.  Powers of tensors and fast matrix multiplication , 2014, ISSAC.

[37]  Ken-ichi Kawarabayashi,et al.  Deterministic Edge Connectivity in Near-Linear Time , 2014, J. ACM.

[38]  Fabian Kuhn,et al.  On the power of the congested clique model , 2014, PODC.

[39]  Lenore Cowen,et al.  Low-Diameter Graph Decomposition Is in NC , 1992, Random Struct. Algorithms.

[40]  Sanjeev Arora,et al.  Subexponential Algorithms for Unique Games and Related Problems , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[41]  Richard Peng,et al.  Graph Sparsification, Spectral Sketches, and Faster Resistance Computation, via Short Cycle Decompositions , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[42]  Shang-Hua Teng,et al.  Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems , 2003, STOC '04.

[43]  Anisur Rahaman Molla,et al.  Distributed Sparse Cut Approximation , 2015, OPODIS.

[44]  Yin Tat Lee,et al.  An Almost-Linear-Time Algorithm for Approximate Max Flow in Undirected Graphs, and its Multicommodity Generalizations , 2013, SODA.

[45]  Mohsen Ghaffari,et al.  Congested Clique Algorithms for the Minimum Cut Problem , 2018, PODC.

[46]  Di Wang,et al.  Expander Decomposition and Pruning: Faster, Stronger, and Simpler , 2018, SODA.