Phase Transitions and Backbones of 3-SAT and Maximum 3-SAT

Many real-world problems involve constraints that cannot be all satisfied. Solving an overconstrained problem then means to find solutions minimizing the number of constraints violated, which is an optimization problem. In this research, we study the behavior of the phase transitions and backbones of constraint optimization problems. We first investigate the relationship between the phase transitions of Boolean satisfiability, or precisely 3-SAT (a well-studied NP-complete decision problem), and the phase transitions of MAX 3-SAT (an NP-hard optimization problem). To bridge the gap between the easy-hard-easy phase transitions of 3-SAT and the easy-hard transitions of MAX 3-SAT, we analyze bounded 3-SAT, in which solutions of bounded quality, e.g., solutions with at most a constant number of constraints violated, are sufficient. We show that phase transitions are persistent in bounded 3-SAT and are similar to that of 3-SAT. We then study backbones of MAX 3-SAT, which are critically constrained variables that have fixed values in all optimal solutions. Our experimental results show that backbones of MAX 3-SAT emerge abruptly and experience sharp transitions from nonexistence when underconstrained to almost complete when overconstrained. More interestingly, the phase transitions of MAX 3-SAT backbones seem to concur with the phase transitions of satisfiability of 3-SAT. The backbone of MAX 3-SAT with size 0.5 approximately collocates with the 0.5 satisfiability of 3-SAT, and the backbone and satisfiability seems to follow a linear correlation near this 0.5-0.5 collocation.

[1]  Andrew J. Parkes,et al.  Clustering at the Phase Transition , 1997, AAAI/IAAI.

[2]  S. Kirkpatrick,et al.  Configuration space analysis of travelling salesman problems , 1985 .

[3]  Joseph C. Culberson,et al.  Frozen development in graph coloring , 2001, Theor. Comput. Sci..

[4]  Toby Walsh,et al.  The TSP Phase Transition , 1996, Artif. Intell..

[5]  Tad Hogg,et al.  Phase Transitions in Artificial Intelligence Systems , 1987, Artif. Intell..

[6]  Donald W. Loveland,et al.  A machine program for theorem-proving , 2011, CACM.

[7]  Tad Hogg,et al.  Phase Transitions and the Search Problem , 1996, Artif. Intell..

[8]  Weixiong Zhang,et al.  State-Space Search , 1999, Springer New York.

[9]  Weixiong Zhang State-space search - algorithms, complexity, extensions, and applications , 1999 .

[10]  Toby Walsh,et al.  Backbones in Optimization and Approximation , 2001, IJCAI.

[11]  Weixiong Zhang,et al.  A Study of Complexity Transitions on the Asymmetric Traveling Salesman Problem , 1996, Artif. Intell..

[12]  Bart Selman,et al.  Generating Satisfiable Problem Instances , 2000, AAAI/IAAI.

[13]  John K. Slaney,et al.  On the Hardness of Decision and Optimisation Problems , 1998, ECAI.

[14]  Peter C. Cheeseman,et al.  Where the Really Hard Problems Are , 1991, IJCAI.

[15]  Hector J. Levesque,et al.  Hard and Easy Distributions of SAT Problems , 1992, AAAI.

[16]  Eugene C. Freuder,et al.  Partial Constraint Satisfaction , 1989, IJCAI.

[17]  Alan Smaill,et al.  Backbone Fragility and the Local Search Cost Peak , 2000, J. Artif. Intell. Res..

[18]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[19]  J. Christopher Beck,et al.  This Is a Publication of The American Association for Artificial Intelligence , 2022 .

[20]  Richard E. Korf,et al.  Performance of Linear-Space Search Algorithms , 1995, Artif. Intell..

[21]  Francesca Rossi,et al.  Notes for the ECAI2000 tutorial on Solving and Programming with Soft Constraints: Theory and Practic , 2002 .

[22]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[23]  Richard M. Karp,et al.  Searching for an Optimal Path in a Tree with Random Costs , 1983, Artif. Intell..

[24]  Rémi Monasson,et al.  Determining computational complexity from characteristic ‘phase transitions’ , 1999, Nature.

[25]  David S. Johnson,et al.  Computers and In stractability: A Guide to the Theory of NP-Completeness. W. H Freeman, San Fran , 1979 .

[26]  Toby Walsh,et al.  Phase Transitions and Annealed Theories: Number Partitioning as a Case Study , 1996, ECAI.