New Distributed Algorithms in Almost Mixing Time via Transformations from Parallel Algorithms

We show that many classical optimization problems --- such as $(1\pm\epsilon)$-approximate maximum flow, shortest path, and transshipment --- can be computed in $\newcommand{\tmix}{{\tau_{\text{mix}}}}\tmix(G)\cdot n^{o(1)}$ rounds of distributed message passing, where $\tmix(G)$ is the mixing time of the network graph $G$. This extends the result of Ghaffari et al.\ [PODC'17], whose main result is a distributed MST algorithm in $\tmix(G)\cdot 2^{O(\sqrt{\log n \log\log n})}$ rounds in the CONGEST model, to a much wider class of optimization problems. For many practical networks of interest, e.g., peer-to-peer or overlay network structures, the mixing time $\tmix(G)$ is small, e.g., polylogarithmic. On these networks, our algorithms bypass the $\tilde\Omega(\sqrt n+D)$ lower bound of Das Sarma et al.\ [STOC'11], which applies for worst-case graphs and applies to all of the above optimization problems. For all of the problems except MST, this is the first distributed algorithm which takes $o(\sqrt n)$ rounds on a (nontrivial) restricted class of network graphs. Towards deriving these improved distributed algorithms, our main contribution is a general transformation that simulates any work-efficient PRAM algorithm running in $T$ parallel rounds via a distributed algorithm running in $T\cdot \tmix(G)\cdot 2^{O(\sqrt{\log n})}$ rounds. Work- and time-efficient parallel algorithms for all of the aforementioned problems follow by combining the work of Sherman [FOCS'13, SODA'17] and Peng and Spielman [STOC'14]. Thus, simulating these parallel algorithms using our transformation framework produces the desired distributed algorithms. The core technical component of our transformation is the algorithmic problem of solving \emph{multi-commodity routing}---that is, roughly, routing $n$ packets each from a given source to a given destination---in random graphs. For this problem, we obtain a...

[1]  Leslie M. Goldschlager,et al.  A unified approach to models of synchronous parallel machines , 1978, STOC.

[2]  Richard Peng,et al.  An efficient parallel solver for SDD linear systems , 2013, STOC.

[3]  Richard M. Karp,et al.  A Survey of Parallel Algorithms for Shared-Memory Machines , 1988 .

[4]  G. Pucci,et al.  The complexity of deterministic PRAM simulation on distributed memory machines , 2007, Theory of Computing Systems.

[5]  Kai-Yeung Siu,et al.  Distributed construction of random expander networks , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[6]  Leslie G. Valiant,et al.  A bridging model for parallel computation , 1990, CACM.

[7]  Bruce M. Maggs,et al.  Universal packet routing algorithms , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[8]  George Karypis,et al.  Introduction to Parallel Computing , 1994 .

[9]  Peter Robinson,et al.  DEX: self-healing expanders , 2014, 2014 IEEE 28th International Parallel and Distributed Processing Symposium.

[10]  Friedhelm Meyer auf der Heide,et al.  Efficient PRAM simulation on a distributed memory machine , 1992, STOC '92.

[11]  Alan M. Frieze,et al.  Random Walks on Random Graphs , 2008, NanoNet.

[12]  Hsin-Hao Su,et al.  Distributed MST and Routing in Almost Mixing Time , 2017, PODC.

[13]  Krzysztof Krzywdzinski,et al.  Distributed algorithms for random graphs , 2015, Theor. Comput. Sci..

[14]  Sanjeev Saxena,et al.  On Parallel Prefix Computation , 1994, Parallel Process. Lett..

[15]  Reza Fathi,et al.  Fast and Efficient Distributed Computation of Hamiltonian Cycles in Random Graphs , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[16]  Gopal Pandurangan,et al.  Xheal: localized self-healing using expanders , 2011, PODC '11.

[17]  John Augustine,et al.  Enabling Robust and Efficient Distributed Computation in Dynamic Peer-to-Peer Networks , 2015, 2015 IEEE 56th Annual Symposium on Foundations of Computer Science.

[18]  Christoph Lenzen,et al.  Near-Optimal Approximate Shortest Paths and Transshipment in Distributed and Streaming Models , 2016, DISC.

[19]  David Peleg,et al.  Distributed Computing: A Locality-Sensitive Approach , 1987 .

[20]  Walter J. Savitch,et al.  Time Bounded Random Access Machines with Parallel Processing , 1979, JACM.

[21]  Christian Scheideler,et al.  The hyperring: a low-congestion deterministic data structure for distributed environments , 2004, SODA '04.

[22]  Steven Fortune,et al.  Parallelism in random access machines , 1978, STOC.

[23]  Bernhard Haeupler,et al.  Distributed Algorithms for Planar Networks II: Low-Congestion Shortcuts, MST, and Min-Cut , 2016, SODA.

[24]  Guy Louchard,et al.  A distributed algorithm to find Hamiltonian cycles in G(n, p) random graphs , 2005 .

[25]  Ramesh Subramonian,et al.  LogP: towards a realistic model of parallel computation , 1993, PPOPP '93.

[26]  Jonah Sherman,et al.  Generalized Preconditioning and Undirected Minimum-Cost Flow , 2017, SODA.

[27]  Geppino Pucci,et al.  A General Pram Simulation Scheme For Clustered Machines , 2003, Int. J. Found. Comput. Sci..

[28]  Prabhakar Raghavan,et al.  Parallel graph algorithms that are efficient on average , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[29]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[30]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[31]  Eli Upfal,et al.  Building low-diameter peer-to-peer networks , 2003, IEEE J. Sel. Areas Commun..

[32]  Christian Schindelhauer,et al.  Peer-to-peer networks based on random transformations of connected regular undirected graphs , 2005, SPAA '05.

[33]  Jonah Sherman,et al.  Nearly Maximum Flows in Nearly Linear Time , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.