MST in O(1) Rounds of Congested Clique

We present a distributed randomized algorithm finding Minimum Spanning Tree (MST) of a given graph in O(1) rounds, with high probability, in the Congested Clique model. The input graph in the Congested Clique model is a graph of n nodes, where each node initially knows only its incident edges. The communication graph is a clique with limited edge bandwidth: each two nodes (not necessarily neighbours in the input graph) can exchange $O(\log n)$ bits. As in previous works, the key part of the MST algorithm is an efficient Connected Components (CC) algorithm. However, unlike the former approaches, we do not aim at simulating the standard Boruvka algorithm, at least at initial stages of the CC algorithm. Instead, we develop a new technique which combines connected components of sample sparse subgraphs of the input graph in order to accelerate the process of uncovering connected components of the original input graph. More specifically, we develop a sparsification technique which reduces an initial CC problem in $O(1)$ rounds to its two restricted instances. The former instance has a graph with maximal degree $O(\log \log n)$ as the input -- here our sample-combining technique helps. In the latter instance, a partition of the input graph into $O(n/\log \log n)$ connected components is known. This gives an opportunity to apply previous algorithms to determine connected components in $O(1)$ rounds. Our result addresses the problem from and the $O(\log \log n)$ algorithm of Lotker et al. [SPAA 2003; SICOMP 2005], improves over previous $O(\log* n)$ algorithm of Ghaffari et al. [PODC 2016] and $O(\log \log \log n)$ algorithm of Hegeman et al. [PODC 2015] . It also determines $\Theta(1)$ round complexity in the congested clique for MST, as well as other graph problems, including bipartiteness, cut verification, s-t connectivity and cycle containment.

[1]  Janne H. Korhonen Deterministic MST Sparsification in the Congested Clique , 2016, ArXiv.

[2]  Merav Parter,et al.  MST in Log-Star Rounds of Congested Clique , 2016, PODC.

[3]  Christoph Lenzen,et al.  Optimal deterministic routing and sorting on the congested clique , 2012, PODC '13.

[4]  David Peleg,et al.  Distributed Computing: A Locality-Sensitive Approach , 1987 .

[5]  Boaz Patt-Shamir,et al.  MST construction in O(log log n) communication rounds , 2003, SPAA '03.

[6]  Sriram V. Pemmaraju,et al.  Toward Optimal Bounds in the Congested Clique: Graph Connectivity and MST , 2015, PODC.

[7]  Nathan Linial,et al.  Locality in Distributed Graph Algorithms , 1992, SIAM J. Comput..

[8]  Sergei Vassilvitskii,et al.  A model of computation for MapReduce , 2010, SODA '10.

[9]  Hartmut Klauck,et al.  Distributed Computation of Large-scale Graph Problems , 2015, SODA.

[10]  Sriram V. Pemmaraju,et al.  Super-Fast MST Algorithms in the Congested Clique Using o(m) Messages , 2016, FSTTCS.

[11]  Sriram V. Pemmaraju,et al.  Lessons from the Congested Clique Applied to MapReduce , 2014, SIROCCO.

[12]  Sudipto Guha,et al.  Analyzing graph structure via linear measurements , 2012, SODA.

[13]  Pedro Montealegre-Barba,et al.  Brief Announcement: Deterministic Graph Connectivity in the Broadcast Congested Clique , 2016, PODC.

[14]  Tomasz Jurdzinski,et al.  MSF and Connectivity in Limited Variants of the Congested Clique , 2017, ArXiv.

[15]  Gregory Schwartzman,et al.  Derandomizing local distributed algorithms under bandwidth restrictions , 2016, Distributed Computing.

[16]  Philip N. Klein,et al.  A randomized linear-time algorithm to find minimum spanning trees , 1995, JACM.

[17]  Fabian Kuhn,et al.  On the power of the congested clique model , 2014, PODC.

[18]  Tomasz Jurdzinski,et al.  Brief Announcement: On Connectivity in the Broadcast Congested Clique , 2017, DISC.

[19]  Ivan Rapaport,et al.  The Simultaneous Number-in-Hand Communication Model for Networks: Private Coins, Public Coins and Determinism , 2014, SIROCCO.