Distributed Symmetry Breaking in Sampling (Optimal Distributed Randomly Coloring with Fewer Colors)

We examine the problem of almost-uniform sampling proper $q$-colorings of a graph whose maximum degree is $\Delta$. A famous result, discovered independently by Jerrum(1995) and Salas and Sokal(1997), is that, assuming $q > (2+\delta) \Delta$, the Glauber dynamics (a.k.a.~single-site dynamics) for this problem has mixing time $O(n \log n)$, where $n$ is the number of vertices, and thus provides a nearly linear time sampling algorithm for this problem. A natural question is the extent to which this algorithm can be parallelized. Previous work Feng, Sun and Yin [PODC'17] has shown that a $O(\Delta \log n)$ time parallelized algorithm is possible, and that $\Omega(\log n)$ time is necessary. We give a distributed sampling algorithm, which we call the Lazy Local Metropolis Algorithm, that achieves an optimal parallelization of this classic algorithm. It improves its predecessor, the Local Metropolis algorithm of Feng, Sun and Yin [PODC'17], by introducing a step of distributed symmetry breaking that helps the mixing of the distributed sampling algorithm. For sampling almost-uniform proper $q$-colorings of graphs $G$ on $n$ vertices, we show that the Lazy Local Metropolis algorithm achieves an optimal $O(\log n)$ mixing time if either of the following conditions is true for an arbitrary constant $\delta>0$: (1) $q\ge(2+\delta)\Delta$, on general graphs with maximum degree $\Delta$; (2) $q \geq (\alpha^* + \delta)\Delta$, where $\alpha^* \approx 1.763$ satisfies $\alpha^* = \mathrm{e}^{1/\alpha^*}$, on graphs with sufficiently large maximum degree $\Delta\ge \Delta_0(\delta)$ and girth at least $9$.

[1]  Martin E. Dyer,et al.  Randomly coloring graphs with lower bounds on girth and maximum degree , 2003, Random Struct. Algorithms.

[2]  Hsin-Hao Su,et al.  Distributed algorithms for the Lovász local lemma and graph coloring , 2014, Distributed Computing.

[3]  Mark Jerrum,et al.  A Very Simple Algorithm for Estimating the Number of k-Colorings of a Low-Degree Graph , 1995, Random Struct. Algorithms.

[4]  Roger Wattenhofer,et al.  On the complexity of distributed graph coloring , 2006, PODC '06.

[5]  Öjvind Johansson Simple Distributed Delta+1-coloring of Graphs , 1999, Inf. Process. Lett..

[6]  Thomas P. Hayes,et al.  Convergence of MCMC and Loopy BP in the Tree Uniqueness Region for the Hard-Core Model , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[7]  Desh Ranjan,et al.  Balls and Bins: A Study in Negative Dependence , 1996 .

[8]  Pierre Fraigniaud,et al.  Local Conflict Coloring , 2015, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[9]  Nathan Linial,et al.  Distributive graph algorithms Global solutions from local data , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[10]  Eric Vigoda,et al.  Improved bounds for sampling colorings , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[11]  Sundar Vishwanathan,et al.  Locality based graph coloring , 1993, STOC.

[12]  Roger Wattenhofer,et al.  A new technique for distributed symmetry breaking , 2010, PODC '10.

[13]  Mohsen Ghaffari,et al.  A Simple Parallel and Distributed Sampling Technique: Local Glauber Dynamics , 2018, DISC.

[14]  Nathan Linial,et al.  Locality in Distributed Graph Algorithms , 1992, SIAM J. Comput..

[15]  Thomas P. Hayes,et al.  A general lower bound for mixing of single-site dynamics on graphs , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[16]  Martin E. Dyer,et al.  Path coupling: A technique for proving rapid mixing in Markov chains , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[17]  A. Sokal,et al.  Absence of phase transition for antiferromagnetic Potts models via the Dobrushin uniqueness theorem , 1996, cond-mat/9603068.

[18]  Martin E. Dyer,et al.  Randomly colouring graphs with lower bounds on girth and maximum degree , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[19]  Leslie Ann Goldberg,et al.  Strong Spatial Mixing with Fewer Colors for Lattice Graphs , 2005, SIAM J. Comput..

[20]  Leonid Barenboim,et al.  Deterministic (Δ + 1)-Coloring in Sublinear (in Δ) Time in Static, Dynamic, and Faulty Networks , 2016, J. ACM.

[21]  Aravind Srinivasan,et al.  On the Complexity of Distributed Network Decomposition , 1996, J. Algorithms.

[22]  Michael Molloy,et al.  The Glauber Dynamics on Colorings of a Graph with High Girth and Maximum Degree , 2004, SIAM J. Comput..

[23]  V. Climenhaga Markov chains and mixing times , 2013 .

[24]  L. A. Goldberg,et al.  Systematic scan for sampling colorings , 2006, math/0603323.

[25]  Dmitriy Katz,et al.  Strong spatial mixing of list coloring of graphs , 2012, Random Struct. Algorithms.

[26]  Martin E. Dyer,et al.  Randomly coloring constant degree graphs , 2004, Random Struct. Algorithms.

[27]  Alan M. Frieze,et al.  On randomly colouring locally sparse graphs , 2006, Discret. Math. Theor. Comput. Sci..

[28]  Thomas P. Hayes,et al.  Coupling with the stationary distribution and improved sampling for colorings and independent sets , 2005, SODA '05.

[29]  Thomas P. Hayes,et al.  A non-Markovian coupling for randomly sampling colorings , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[30]  Thomas P. Hayes,et al.  Sampling Random Colorings of Sparse Random Graphs , 2017, SODA.

[31]  Leonid Barenboim,et al.  The Locality of Distributed Symmetry Breaking , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[32]  Thomas P. Hayes Randomly coloring graphs of girth at least five , 2003, STOC '03.

[33]  Andrew V. Goldberg,et al.  Network decomposition and locality in distributed computation , 1989, 30th Annual Symposium on Foundations of Computer Science.

[34]  Martin E. Dyer,et al.  Dobrushin Conditions and Systematic Scan , 2006, Combinatorics, Probability and Computing.

[35]  Thomas P. Hayes Local uniformity properties for glauber dynamics on graph colorings , 2013, Random Struct. Algorithms.

[36]  Eric Vigoda,et al.  A survey on the use of Markov chains to randomly sample colorings , 2006 .

[37]  Weiming Feng,et al.  On Local Distributed Sampling and Counting , 2018, PODC.

[38]  Weiming Feng,et al.  What can be sampled locally? , 2018, Distributed Computing.

[39]  Andrew V. Goldberg,et al.  Parallel symmetry-breaking in sparse graphs , 1987, STOC.

[40]  Arthur Gretton,et al.  Parallel Gibbs Sampling: From Colored Fields to Thin Junction Trees , 2011, AISTATS.

[41]  Fabian Kuhn,et al.  On the complexity of local distributed graph problems , 2016, STOC.

[42]  Leonid Barenboim,et al.  Deterministic Distributed Vertex Coloring in Polylogarithmic Time , 2010, JACM.