The Threshold Energy of Low Temperature Langevin Dynamics for Pure Spherical Spin Glasses

We study the Langevin dynamics for spherical $p$-spin models, focusing on the short time regime described by the Cugliandolo-Kurchan equations. Confirming a 1999 conjecture of Biroli, we show the asymptotic energy achieved is exactly $E_{\infty}(p)=2\sqrt{\frac{p-1}{p}}$ in the low temperature limit. The upper bound uses hardness results for Lipschitz optimization algorithms and applies for all temperatures. For the lower bound, we prove the dynamics reaches and stays above the lowest energy of any approximate local maximum. In fact the latter behavior holds for any Hamiltonian obeying natural smoothness estimates, even with disorder-dependent initialization and on exponential time-scales.

[1]  L. Cugliandolo Recent Applications of Dynamical Mean-Field Methods , 2023, Annual Review of Condensed Matter Physics.

[2]  Mark Sellke,et al.  Algorithmic Threshold for Multi-Species Spherical Spin Glasses , 2023, ArXiv.

[3]  H. Yau,et al.  Spectral Gap Estimates for Mixed $p$-Spin Models at High Temperature , 2022, 2208.07844.

[4]  Antonio Auffinger,et al.  Optimization of random high-dimensional functions: Structure and algorithms , 2022, 2206.10217.

[5]  Frederic Koehler,et al.  Entropic independence: optimal mixing of down-up random walks , 2022, STOC.

[6]  G. B. Arous,et al.  High-dimensional limit theorems for SGD: Effective dynamics and critical scaling , 2022, NeurIPS.

[7]  Andrea Montanari,et al.  The high-dimensional asymptotics of first order methods with random data , 2021, 2112.07572.

[8]  Eliran Subag,et al.  TAP approach for multispecies spherical spin glasses II: The free energy of the pure models , 2021, The Annals of Probability.

[9]  Mark Sellke,et al.  Tight Lipschitz Hardness for optimizing Mean Field Spin Glasses , 2021, 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS).

[10]  Ofer Zeitouni,et al.  Concentration of the complexity of spherical pure p-spin models at arbitrary energies , 2021, Journal of Mathematical Physics.

[11]  D. Gamarnik The overlap gap property: A topological barrier to optimizing over random structures , 2021, Proceedings of the National Academy of Sciences.

[12]  Pax Kivimae The Ground State Energy and Concentration of Complexity in Spherical Bipartite Models , 2021, 2107.13138.

[13]  Benjamin McKenna Complexity of bipartite spherical spin glasses , 2021, 2105.05043.

[14]  Mark Sellke Optimizing Mean Field Spin Glasses with External Field , 2021, 2105.03506.

[15]  David Belius,et al.  Triviality of the Geometry of Mixed p-Spin Spherical Hamiltonians with External Field , 2021, Journal of Statistical Physics.

[16]  Ronen Eldan,et al.  A spectral condition for spectral gap: fast mixing in high-temperature Ising models , 2020, Probability Theory and Related Fields.

[17]  A. Dembo,et al.  Diffusions interacting through a random matrix: universality via stochastic Taylor expansion , 2020, 2006.13167.

[18]  David Gamarnik,et al.  Low-Degree Hardness of Random Optimization Problems , 2020, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[19]  G. B. Arous,et al.  Online stochastic gradient descent on non-convex losses from high-dimensional inference , 2020, J. Mach. Learn. Res..

[20]  J. MacLaurin An emergent autonomous flow for mean-field spin glasses , 2020, Probability Theory and Related Fields.

[21]  Andrea Montanari,et al.  Optimization of mean-field spin glasses , 2020, The Annals of Probability.

[22]  G. Ben Arous,et al.  Bounding Flows for Spherical Spin Glass Dynamics , 2019, Communications in Mathematical Physics.

[23]  Aukosh Jagannath,et al.  Dynamics of mean field spin glasses on short and long timescales , 2019, Journal of Mathematical Physics.

[24]  A. Dembo,et al.  Dynamics for Spherical Spin Glasses: Disorder Dependent Initial Conditions , 2019, Journal of Statistical Physics.

[25]  Andrea Montanari,et al.  Optimization of the Sherrington-Kirkpatrick Hamiltonian , 2018, 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS).

[26]  Eliran Subag,et al.  Following the Ground States of Full‐RSB Spherical Spin Glasses , 2018, Communications on Pure and Applied Mathematics.

[27]  G. B. Arous,et al.  Algorithmic thresholds for tensor PCA , 2018, The Annals of Probability.

[28]  Reza Gheissari,et al.  Bounding Flows for Spherical Spin Glass Dynamics , 2018, Communications in Mathematical Physics.

[29]  Madhu Sudan,et al.  Performance of Sequential Local Algorithms for the Random NAE-K-SAT Problem , 2017, SIAM J. Comput..

[30]  Reza Gheissari,et al.  On the spectral gap of spherical spin glass dynamics , 2016, Annales de l'Institut Henri Poincaré, Probabilités et Statistiques.

[31]  Wei-Kuo Chen,et al.  Parisi formula for the ground state energy in the mixed p-spin model , 2016, 1606.05335.

[32]  Eliran Subag,et al.  The geometry of the Gibbs measure of pure spherical spin glasses , 2016, 1604.00679.

[33]  O. Zeitouni,et al.  The extremal process of critical points of the pure p-spin spherical spin glass model , 2015, 1509.03098.

[34]  Eliran Subag,et al.  The complexity of spherical p-spin models - a second moment approach , 2015, 1504.02251.

[35]  Moni Naor,et al.  Proceedings of the 5th conference on Innovations in theoretical computer science , 2014, ITCS 2014.

[36]  Madhu Sudan,et al.  Limits of local algorithms over sparse random graphs , 2013, ITCS.

[37]  Wei-Kuo Chen The Aizenman-Sims-Starr scheme and Parisi formula for mixed p-spin spherical models , 2012, 1204.5115.

[38]  G. Ben Arous,et al.  Universality and extremal aging for dynamics of spin glasses on subexponential time scales , 2012 .

[39]  Dmitry Panchenko,et al.  The Parisi formula for mixed $p$-spin models , 2011, 1112.4409.

[40]  Dmitry Panchenko,et al.  The Parisi ultrametricity conjecture , 2011, 1112.1003.

[41]  Antonio Auffinger,et al.  Complexity of random smooth functions on the high-dimensional sphere , 2011, 1110.5872.

[42]  Antonio Auffinger,et al.  Random Matrices and Complexity of Spin Glasses , 2010, 1003.1129.

[43]  Pompiliu Manuel Zamfir Limiting Dynamics for Spherical Models of Spin Glasses with Magnetic Field , 2008, 0806.3519.

[44]  G. B. Arous,et al.  Universality of the REM for Dynamics of Mean-Field Spin Glasses , 2007, 0706.2135.

[45]  A. Dembo,et al.  Limiting Dynamics for Spherical Models of Spin Glasses at High Temperature , 2006, math/0609546.

[46]  G. B. Arous,et al.  The arcsine law as a universal aging scheme for trap models , 2006, math/0603340.

[47]  G. B. Arous,et al.  Dynamics of trap models , 2006, math/0603344.

[48]  M. Talagrand Free energy of the spherical mean field model , 2006 .

[49]  F. Guerra,et al.  Spin Glasses , 2005, cond-mat/0507581.

[50]  A. Dembo,et al.  Cugliandolo-Kurchan equations for dynamics of Spin-Glasses , 2004, math/0409273.

[51]  A. Guionnet,et al.  Long time behaviour of the solution to non-linear Kraichnan equations , 2004, math/0409274.

[52]  G'erard Ben-Arous,et al.  Aging and spin-glass dynamics , 2003, math/0304364.

[53]  A. Dembo,et al.  Aging of spherical spin glasses , 2001 .

[54]  G. Biroli Dynamical TAP approach to mean field glassy systems , 1999, cond-mat/9909415.

[55]  A. Guionnet Averaged and quenched propagation of chaos for spin glass dynamics , 1997 .

[56]  G. B. Arous,et al.  Symmetric Langevin spin glass dynamics , 1997 .

[57]  M. Mézard,et al.  Out of equilibrium dynamics in spin-glasses and other glassy systems , 1997, cond-mat/9702070.

[58]  M. Grunwald Sanov results for Glauber spin-glass dynamics , 1996 .

[59]  J. Bouchaud,et al.  Aging on Parisi's Tree , 1994, Journal de Physique I.

[60]  J. Kurchan,et al.  Analytical solution of the off-equilibrium dynamics of a long-range spin-glass model. , 1993, Physical review letters.

[61]  H. Sompolinsky,et al.  Relaxational dynamics of the Edwards-Anderson model and the mean-field theory of spin-glasses , 1982 .

[62]  Giorgio Parisi,et al.  Infinite Number of Order Parameters for Spin-Glasses , 1979 .

[63]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[64]  An emergent autonomous flow for mean-field spin glasses. , 2022 .

[65]  Dieter Fuhrmann,et al.  Spin Glasses And Random Fields , 2016 .

[66]  Matthew J. Rosseinsky,et al.  Physical Review B , 2011 .

[67]  Alice Guionnet,et al.  Dynamics for Spherical Models of Spin-Glass and Aging , 2007 .

[68]  Hendrik B. Geyer,et al.  Journal of Physics A - Mathematical and General, Special Issue. SI Aug 11 2006 ?? Preface , 2006 .

[69]  M. Talagrand The parisi formula , 2006 .

[70]  G. Illies,et al.  Communications in Mathematical Physics , 2004 .

[71]  N. Curien,et al.  THE ANNALS of PROBABILITY , 2022 .

[72]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[73]  David Mumford,et al.  Communications on Pure and Applied Mathematics , 1989 .

[74]  H. P. Annales de l'Institut Henri Poincaré , 1931, Nature.

[75]  W. Browder,et al.  Annals of Mathematics , 1889 .

[76]  October I Physical Review Letters , 2022 .