Universality of the SAT-UNSAT (jamming) threshold in non-convex continuous constraint satisfaction problems

Random constraint satisfaction problems (CSP) have been studied extensively using statistical physics techniques. They provide a benchmark to study average case scenarios instead of the worst case one. The interplay between statistical physics of disordered systems and computer science has brought new light into the realm of computational complexity theory, by introducing the notion of clustering of solutions, related to replica symmetry breaking. However, the class of problems in which clustering has been studied often involve discrete degrees of freedom: standard random CSPs are random K-SAT (aka disordered Ising models) or random coloring problems (aka disordered Potts models). In this work we consider instead problems that involve continuous degrees of freedom. The simplest prototype of these problems is the perceptron. Here we discuss in detail the full phase diagram of the model. In the regions of parameter space where the problem is non-convex, leading to multiple disconnected clusters of solutions, the solution is critical at the SAT/UNSAT threshold and lies in the same universality class of the jamming transition of soft spheres. We show how the critical behavior at the satisfiability threshold emerges, and we compute the critical exponents associated to the approach to the transition from both the SAT and UNSAT phase. We conjecture that there is a large universality class of non-convex continuous CSPs whose SAT-UNSAT threshold is described by the same scaling solution.

[1]  F. Krzakala,et al.  Following Gibbs states adiabatically: the energy landscape of mean field glassy systems , 2009, 0909.3820.

[2]  G. Parisi,et al.  The simplest model of jamming , 2015, 1501.03397.

[3]  Andrea Cavagna,et al.  Supercooled liquids for pedestrians , 2009, 0903.4264.

[4]  Giorgio Parisi,et al.  Exact theory of dense amorphous hard spheres in high dimension. III. The full replica symmetry breaking solution , 2013, 1310.2549.

[5]  Giorgio Parisi,et al.  Exact theory of dense amorphous hard spheres in high dimension. II. The high density regime and the Gardner transition. , 2013, The journal of physical chemistry. B.

[6]  M. Mézard,et al.  Journal of Statistical Mechanics: Theory and Experiment , 2011 .

[7]  G. Biroli,et al.  Theoretical perspective on the glass transition and amorphous materials , 2010, 1011.2578.

[8]  Bertrand Duplantier COMMENT: Comment on Parisi's equation for the SK model for spin glasses , 1981 .

[9]  Giorgio Parisi,et al.  Jamming criticality revealed by removing localized buckling excitations. , 2014, Physical review letters.

[10]  Andrea Montanari,et al.  Gibbs states and the set of solutions of random constraint satisfaction problems , 2006, Proceedings of the National Academy of Sciences.

[11]  Corrado Rainone,et al.  Following the evolution of glassy states under external perturbations: the full replica symmetry breaking solution , 2015, 1512.00341.

[12]  M. A. Virasoro,et al.  A method that reveals the multi-level ultrametric tree hidden in p-spin glass like systems , 2015 .

[13]  Matthieu Wyart,et al.  Low-energy non-linear excitations in sphere packings , 2013, 1302.3990.

[14]  A. Cavagna,et al.  Spin-glass theory for pedestrians , 2005, cond-mat/0505032.

[15]  Giorgio Parisi,et al.  Universal microstructure and mechanical stability of jammed packings. , 2012, Physical review letters.

[16]  F. Stillinger,et al.  Jammed hard-particle packings: From Kepler to Bernal and beyond , 2010, 1008.2982.

[17]  Giorgio Parisi,et al.  Fractal free energy landscapes in structural glasses , 2014, Nature Communications.

[18]  S. Franz,et al.  Mean-field avalanches in jammed spheres. , 2016, Physical review. E.

[19]  P. Wolynes,et al.  Structural Glasses and Supercooled Liquids: Theory, Experiment, and Applications , 2012 .

[20]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[21]  Andrea J. Liu,et al.  Jamming at zero temperature and zero applied stress: the epitome of disorder. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Matthieu Wyart,et al.  Marginal stability constrains force and pair distributions at random close packing. , 2012, Physical review letters.

[23]  Monasson Structural glass transition and the entropy of the metastable states. , 1995, Physical Review Letters.

[24]  E. Gardner,et al.  Optimal storage properties of neural network models , 1988 .

[25]  Andrea J. Liu,et al.  Scaling ansatz for the jamming transition , 2016, Proceedings of the National Academy of Sciences.

[26]  Yoav Kallus Scaling collapse at the jamming transition. , 2016, Physical review. E.

[27]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[28]  Giorgio Parisi,et al.  Replica field theory for random manifolds , 1991 .

[29]  Rémi Monasson,et al.  Determining computational complexity from characteristic ‘phase transitions’ , 1999, Nature.

[30]  Giorgio Parisi,et al.  Glass and Jamming Transitions: From Exact Results to Finite-Dimensional Descriptions , 2016, 1605.03008.

[31]  G. Parisi,et al.  A Simple hypothesis for the spin glass phase of the pnfinite-ranged SK model , 1980 .

[32]  Corrado Rainone,et al.  Following the evolution of hard sphere glasses in infinite dimensions under external perturbations: compression and shear strain. , 2014, Physical review letters.

[33]  G. Parisi,et al.  Universal spectrum of normal modes in low-temperature glasses , 2015, Proceedings of the National Academy of Sciences.

[34]  M. Mézard,et al.  Analytic and Algorithmic Solution of Random Satisfiability Problems , 2002, Science.

[35]  Matthieu Wyart,et al.  On the rigidity of a hard-sphere glass near random close packing , 2006 .

[36]  G. Biroli,et al.  Dynamical Heterogeneities in Glasses, Colloids, and Granular Media , 2011 .

[37]  T. R. Kirkpatrick,et al.  Colloquium : Random first order transition theory concepts in biology and physics , 2015 .

[38]  Giorgio Parisi,et al.  The jamming transition in high dimension: an analytical study of the TAP equations and the effective thermodynamic potential , 2016, 1607.00966.

[39]  Giorgio Parisi,et al.  Mean-field theory of hard sphere glasses and jamming , 2008, 0802.2180.

[40]  G. Parisi,et al.  Recipes for metastable states in spin glasses , 1995 .

[41]  R. Palmer,et al.  Solution of 'Solvable model of a spin glass' , 1977 .

[42]  Matthieu Wyart,et al.  Force distribution affects vibrational properties in hard-sphere glasses , 2014, Proceedings of the National Academy of Sciences.

[43]  E. Gardner Spin glasses with p-spin interactions , 1985 .