Optimization hardness as transient chaos in an analog approach to constraint satisfaction

Constraint-satisfaction problems are among the computationally hardest tasks: solutions are efficiently checkable, but no efficient algorithms are known to compute those solutions. Fresh insight might come from physics. A study mapping optimization hardness onto the phenomena of turbulence and chaos suggests that constraint-satisfaction problems can be tackled using analog devices. Boolean satisfiability1 (k-SAT) is one of the most studied optimization problems, as an efficient (that is, polynomial-time) solution to k-SAT (for k≥3) implies efficient solutions to a large number of hard optimization problems2,3. Here we propose a mapping of k-SAT into a deterministic continuous-time dynamical system with a unique correspondence between its attractors and the k-SAT solution clusters. We show that beyond a constraint density threshold, the analog trajectories become transiently chaotic4,5,6,7, and the boundaries between the basins of attraction8 of the solution clusters become fractal7,8,9, signalling the appearance of optimization hardness10. Analytical arguments and simulations indicate that the system always finds solutions for satisfiable formulae even in the frozen regimes of random 3-SAT (ref. 11) and of locked occupation problems12 (considered among the hardest algorithmic benchmarks), a property partly due to the system’s hyperbolic4,13 character. The system finds solutions in polynomial continuous time, however, at the expense of exponential fluctuations in its energy function.

[1]  Benjamin W. Wah,et al.  Trace-Based Methods for Solving Nonlinear Global Optimization and Satisfiability Problems , 1997, J. Glob. Optim..

[2]  Mw Hirsch,et al.  Chaos In Dynamical Systems , 2016 .

[3]  L. Kadanoff,et al.  Escape from strange repellers. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Lenka Zdeborová,et al.  Locked constraint satisfaction problems. , 2008, Physical review letters.

[5]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[6]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[7]  References , 1971 .

[8]  A. Crisanti,et al.  Predictability in the large: an extension of the concept of Lyapunov exponent , 1996, chao-dyn/9606014.

[9]  Jun Gu,et al.  On optimizing the satisfiability (SAT) problem , 1999, Journal of Computer Science and Technology.

[10]  Lance Fortnow,et al.  The status of the P versus NP problem , 2009, CACM.

[11]  Cristopher Moore,et al.  Recursion Theory on the Reals and Continuous-Time Computation , 1996, Theor. Comput. Sci..

[12]  M. Mézard,et al.  Analytic and Algorithmic Solution of Random Satisfiability Problems , 2002, Science.

[13]  H T Siegelmann,et al.  Dating and Context of Three Middle Stone Age Sites with Bone Points in the Upper Semliki Valley, Zaire , 2007 .

[14]  C. Meneveau,et al.  The multifractal nature of turbulent energy dissipation , 1991, Journal of Fluid Mechanics.

[15]  Shih-Chii Liu,et al.  Analog VLSI: Circuits and Principles , 2002 .

[16]  Giorgio Parisi Some remarks on the survey decimation algorithm for K-satisfiability , 2003, ArXiv.

[17]  Celso Grebogi,et al.  Basin boundary metamorphoses: Changes in accessible boundary orbits☆ , 1987 .

[18]  Leon O. Chua,et al.  Cellular Neural Networks and Visual Computing: Foundations and Applications , 2002 .

[19]  Pekka Orponen,et al.  Focused local search for random 3-satisfiability , 2005, ArXiv.

[20]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[21]  Michael S. Branicky,et al.  Analog computation with continuous ODEs , 1994, Proceedings Workshop on Physics and Computation. PhysComp '94.

[22]  M. Mézard,et al.  Two Solutions to Diluted p-Spin Models and XORSAT Problems , 2003 .

[23]  Edward Ott,et al.  Chaos in Dynamical Systems - 2nd Edition , 2002 .

[24]  Ying-Cheng Lai,et al.  Chaotic transients in spatially extended systems , 2008 .

[25]  Riccardo Zecchina,et al.  Threshold values of random K‐SAT from the cavity method , 2003, Random Struct. Algorithms.

[26]  Federico Ricci-Tersenghi,et al.  Random Formulas Have Frozen Variables , 2009, SIAM J. Comput..

[27]  F. d’Ovidio,et al.  Mixing structures in the Mediterranean Sea from finite‐size Lyapunov exponents , 2004, nlin/0404041.

[28]  Ying-Cheng Lai,et al.  Transient Chaos: Complex Dynamics on Finite Time Scales , 2011 .

[29]  Assaf Naor,et al.  Rigorous location of phase transitions in hard optimization problems , 2005, Nature.

[30]  J. Westerweel,et al.  Repeller or attractor? Selecting the dynamical model for the onset of turbulence in pipe flow. , 2008, Physical review letters.

[31]  E. Ott Chaos in Dynamical Systems: Contents , 2002 .

[32]  J. Westerweel,et al.  Finite lifetime of turbulence in shear flows , 2006, Nature.

[33]  Michael Molloy Cores in random hypergraphs and Boolean formulas , 2005 .

[34]  Amin Coja-Oghlan,et al.  On the solution‐space geometry of random constraint satisfaction problems , 2011, Random Struct. Algorithms.

[35]  Masahiro Nagamatu,et al.  On the stability of Lagrange programming neural networks for satisfiability problems of propositional calculus , 1996, Neurocomputing.

[36]  J. Yorke,et al.  Basins of Attraction , 1996, Science.

[37]  V Elser,et al.  Searching with iterated maps , 2007, Proceedings of the National Academy of Sciences.