On sampling symmetric Gibbs distributions on sparse random graphs and hypergraphs

We consider efficient algorithms for approximate sampling from symmetric Gibbs distributions on the sparse random (hyper)graph. The examples we consider here include (but are not restricted to) important distributions on spin systems and spin-glasses such as the q state antiferromagnetic Potts model for $q\geq 2$, including the random colourings, the uniform distributions over the Not-All-Equal solutions of random k-CNF formulas. Finally, we present an algorithm for sampling from the spin-glass distribution called the k-spin model. To our knowledge this is the first, rigorously analysed, efficient algorithm for spin-glasses which operates in a non trivial range of the parameters. Our approach relies on the one that was introduced in [Efthymiou: SODA 2012]. For a symmetric Gibbs distribution $\mu$ on a random (hyper)graph whose parameters are within an certain range, our algorithm has the following properties: with probability $1-o(1)$ over the input instances, it generates a configuration which is distributed within total variation distance $n^{-\Omega(1)}$ from $\mu$. The time complexity is $O(n^{2}\log n)$. It is evident that the algorithm requires a range of the parameters of the distributions that coincide with the tree-uniqueness region, parametrised w.r.t. the expected degree d. More precisely, this is true for distributions for which the uniqueness region is known. For many of the distributions we consider, we are far from establishing what is believed to be their uniqueness region. This imposes certain limitations to our purposes. We build a novel approach which utilises the notion of contiguity between Gibbs distributions and the so-called teacher-student model. With this approach we bring together tools and notions from sampling and statistical inference algorithms.

[1]  Martin E. Dyer,et al.  Randomly coloring graphs with lower bounds on girth and maximum degree , 2003, Random Struct. Algorithms.

[2]  TYLER HELMUTH,et al.  PR ] 2 0 Se p 20 19 EFFICIENT SAMPLING AND COUNTING ALGORITHMS FOR THE POTTS MODEL ON Z d AT ALL TEMPERATURES , 2022 .

[3]  Will Perkins,et al.  Algorithms for #BIS-hard problems on expander graphs , 2018, SODA.

[4]  Allan Sly,et al.  Proof of the Satisfiability Conjecture for Large k , 2014, STOC.

[5]  B. Bollobás The evolution of random graphs , 1984 .

[6]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[7]  Uriel Feige,et al.  Relations between average case complexity and approximation complexity , 2002, STOC '02.

[8]  Piyush Srivastava,et al.  A Deterministic Algorithm for Counting Colorings with 2-Delta Colors , 2019, 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS).

[9]  Randomly Coloring Constant Degree Graphs , 2004, FOCS.

[10]  Pinyan Lu,et al.  Counting hypergraph colorings in the local lemma regime , 2017, SIAM J. Comput..

[11]  Elchanan Mossel,et al.  Exact thresholds for Ising–Gibbs samplers on general graphs , 2009, The Annals of Probability.

[12]  Eric Vigoda,et al.  Sampling in Uniqueness from the Potts and Random-Cluster Models on Random Regular Graphs , 2018, APPROX-RANDOM.

[13]  M. Talagrand,et al.  Bounds for diluted mean-fields spin glass models , 2004, math/0405357.

[14]  Will Perkins,et al.  Efficient sampling and counting algorithms for the Potts model on ℤᵈ at all temperatures , 2020, STOC.

[15]  Amin Coja-Oghlan,et al.  The replica symmetric phase of random constraint satisfaction problems , 2018, Combinatorics, Probability and Computing.

[16]  Florent Krzakala,et al.  Information-theoretic thresholds from the cavity method , 2016, STOC.

[17]  M. Mézard,et al.  Analytic and Algorithmic Solution of Random Satisfiability Problems , 2002, Science.

[18]  Leslie Ann Goldberg,et al.  Counting solutions to random CNF formulas , 2020, ICALP.

[19]  Nicholas C. Wormald,et al.  Almost All Regular Graphs Are Hamiltonian , 1994, Random Struct. Algorithms.

[20]  Michael Molloy,et al.  The Freezing Threshold for k-Colourings of a Random Graph , 2018, J. ACM.

[21]  Ankur Moitra,et al.  Approximate counting, the Lovasz local lemma, and inference in graphical models , 2016, STOC.

[22]  Cristopher Moore,et al.  Random k-SAT: Two Moments Suffice to Cross a Sharp Threshold , 2003, SIAM J. Comput..

[23]  Leslie Ann Goldberg,et al.  Uniqueness for the 3-State Antiferromagnetic Potts Model on the Tree , 2018, ArXiv.

[24]  Amin Coja-Oghlan,et al.  Planting Colourings Silently , 2014, Combinatorics, Probability and Computing.

[25]  Florent Krzakala,et al.  Statistical physics of inference: thresholds and algorithms , 2015, ArXiv.

[26]  S. Kak Information, physics, and computation , 1996 .

[27]  Santosh S. Vempala,et al.  University of Birmingham On the Complexity of Random Satisfiability Problems with Planted Solutions , 2018 .

[28]  Leslie Ann Goldberg,et al.  Strong Spatial Mixing with Fewer Colors for Lattice Graphs , 2005, SIAM J. Comput..

[29]  Oded Goldreich,et al.  Candidate One-Way Functions Based on Expander Graphs , 2011, Studies in Complexity and Cryptography.

[30]  Charilaos Efthymiou A simple algorithm for random colouring G(n, d/n) using (2 + ε)d colours , 2012, SODA.

[31]  Thomas P. Hayes,et al.  A non-Markovian coupling for randomly sampling colorings , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[32]  Thomas P. Hayes Local uniformity properties for glauber dynamics on graph colorings , 2013, Random Struct. Algorithms.

[33]  Cristopher Moore,et al.  Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Andrea Montanari,et al.  Gibbs states and the set of solutions of random constraint satisfaction problems , 2006, Proceedings of the National Academy of Sciences.

[35]  Eric Vigoda,et al.  A survey on the use of Markov chains to randomly sample colorings , 2006 .

[36]  Amin Coja-Oghlan,et al.  Algorithmic Barriers from Phase Transitions , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[37]  A. Frieze,et al.  On the connectivity of proper colorings of random graphs and hypergraphs , 2020, Random Structures & Algorithms.

[38]  Amin Coja-Oghlan,et al.  On independent sets in random graphs , 2010, SODA '11.

[39]  Yitong Yin,et al.  Sampling in Potts Model on Sparse Random Graphs , 2016, APPROX-RANDOM.

[40]  Florent Krzakala,et al.  Hiding Quiet Solutions in Random Constraint Satisfaction Problems , 2009, Physical review letters.

[41]  Svante Janson,et al.  Random Regular Graphs: Asymptotic Distributions and Contiguity , 1995, Combinatorics, Probability and Computing.

[42]  Cristopher Moore,et al.  The Computer Science and Physics of Community Detection: Landscapes, Phase Transitions, and Hardness , 2017, Bull. EATCS.

[43]  Dror Weitz,et al.  Counting independent sets up to the tree threshold , 2006, STOC '06.

[44]  Alexander I. Barvinok,et al.  Combinatorics and Complexity of Partition Functions , 2017, Algorithms and combinatorics.

[45]  Viresh Patel,et al.  Deterministic polynomial-time approximation algorithms for partition functions and graph polynomials , 2016, Electron. Notes Discret. Math..

[46]  Luke Postle,et al.  Improved Bounds for Randomly Sampling Colorings via Linear Programming , 2018, SODA.

[47]  Thomas P. Hayes,et al.  Sampling Random Colorings of Sparse Random Graphs , 2017, SODA.

[48]  Piyush Srivastava,et al.  A deterministic algorithm for counting colorings with 2Δ colors , 2019, ArXiv.

[49]  Nicolas Macris,et al.  Spatial Coupling as a Proof Technique and Three Applications , 2013, IEEE Transactions on Information Theory.

[50]  Alan M. Frieze,et al.  Analyzing Walksat on Random Formulas , 2011, ANALCO.

[51]  Amin Coja-Oghlan,et al.  Local Convergence of Random Graph Colorings , 2015, APPROX-RANDOM.

[52]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[53]  Bimal Kumar Roy,et al.  Counting, sampling and integrating: Algorithms and complexity , 2013 .

[54]  Nima Anari,et al.  Spectral Independence in High-Dimensional Expanders and Applications to the Hardcore Model , 2020, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[55]  J. Jonasson Uniqueness of uniform random colorings of regular trees , 2002 .

[56]  Eric Vigoda,et al.  Improved bounds for sampling colorings , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[57]  Thomas P. Hayes,et al.  Randomly coloring planar graphs with fewer colors than the maximum degree , 2007, STOC '07.