On the complexity of circuit satisfiability

In this paper, we are concerned with the exponential complexity of the Circuit Satisfiability (CktSat) problem and more generally with the exponential complexity of NP-complete problems. Over the past 15 years or so, researchers have obtained a number of exponential-time algorithms with improved running times for exactly solving a variety of NP-complete problems. The improvements are typically in the form of better exponents compared to exhaustive search. Our goal is to develop techniques to prove specific lower bounds on the exponents under plausible complexity assumptions. We consider natural, though restricted, algorithmic paradigms and prove upper bounds on the success probability. Our approach has the advantage of clarifying the relative power of various algorithmic paradigms. Our main technique is a success probability amplification technique, called the Exponential Amplification Lemma, which shows that for any f(n,m)-size bounded probabilistic circuit family A that decides CktSat with success probability at least 2-α n for α<1 on inputs which are circuits of size m with n variables, there is another probabilistic circuit family B that decides CktSat with size roughly f(α n, f(n,m)) and success probability about 2-α2 n > 2-α n. In contrast, the standard method for boosting success probability by repeated trials will improve it to (1-(1-2-α n)t) (approx t2-α n for t=O(2α n)) using circuits of size about tf(n,m). Using this lemma, we derive tight bounds on the exponent of the success probability for deciding the CktSat problem in a variety of probabilistic computational models under complexity assumptions. For example, we show that the success probability cannot be better than 2-n+o(n) for deciding CktSat by probabilistic polynomial size circuits unless CktSat (thereby all of NP) for polynomial size instances can be decided by 2nμ size deterministic circuits for some μ <1, which is considered an unlikely event. As another example, we show that probabilistic quasilinear size circuits cannot achieve success probability better than 2-n+o(n) unless CktSat (as well as NP) has O(mO(lg lg m)) size deterministic circuits, which is very close to the statement NP ⊆ P/poly, an unlikely scenario.

[1]  Dániel Marx Can you beat treewidth? , 2007, FOCS.

[2]  Jon M. Kleinberg,et al.  A deterministic (2-2/(k+1))n algorithm for k-SAT based on local search , 2002, Theor. Comput. Sci..

[3]  Erich Kaltofen,et al.  On rank properties of Toeplitz matrices over finite fields , 1996, ISSAC '96.

[4]  Andreas Björklund,et al.  Computing the Tutte Polynomial in Vertex-Exponential Time , 2007, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[5]  Rafail Ostrovsky,et al.  Cryptography with constant computational overhead , 2008, STOC.

[6]  Rolf Niedermeier,et al.  Worst-case upper bounds for MAX-2-SAT with an application to MAX-CUT , 2003, Discret. Appl. Math..

[7]  U. Schöning A probabilistic algorithm for k-SAT and constraint satisfaction problems , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[8]  David Eppstein,et al.  Quasiconvex analysis of multivariate recurrence equations for backtracking algorithms , 2006, TALG.

[9]  Fabrizio Grandoni,et al.  Measure and conquer: a simple O(20.288n) independent set algorithm , 2006, SODA '06.

[10]  Russell Impagliazzo,et al.  Which Problems Have Strongly Exponential Complexity? , 2001, J. Comput. Syst. Sci..

[11]  Andreas Björklund,et al.  Set Partitioning via Inclusion-Exclusion , 2009, SIAM J. Comput..

[12]  Eugene L. Lawler,et al.  A Note on the Complexity of the Chromatic Number Problem , 1976, Inf. Process. Lett..

[13]  Andreas Björklund,et al.  Fourier meets möbius: fast subset convolution , 2006, STOC '07.

[14]  David Y. Y. Yun,et al.  Fast Solution of Toeplitz Systems of Equations and Computation of Padé Approximants , 1980, J. Algorithms.

[15]  V. Pan Structured Matrices and Polynomials , 2001 .

[16]  Harry B. Hunt,et al.  Power indices and easier hard problems , 2005, Mathematical systems theory.

[17]  Ravi Kumar,et al.  A sieve algorithm for the shortest lattice vector problem , 2001, STOC '01.

[18]  Leslie G. Valiant,et al.  NP is as easy as detecting unique solutions , 1985, STOC '85.

[19]  H. Bodlaender,et al.  An exact algorithm for graph coloring with polynomial memory , 2006 .

[20]  V. Pan Structured Matrices and Polynomials: Unified Superfast Algorithms , 2001 .

[21]  Michael R. Fellows,et al.  Fixed-Parameter Tractability and Completeness IV: On Completeness for W[P] and PSPACE Analogues , 1995, Ann. Pure Appl. Log..

[22]  Claus-Peter Schnorr Satisfiability Is Quasilinear Complete in NQL , 1978, JACM.

[23]  Patrick Traxler The Time Complexity of Constraint Satisfaction , 2008, IWPEC.

[24]  Dániel Marx,et al.  On the Optimality of Planar and Geometric Approximation Schemes , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[25]  M. Held,et al.  A dynamic programming approach to sequencing problems , 1962, ACM National Meeting.

[26]  David Eppstein,et al.  3-coloring in time 0(1.3446/sup n/): a no-MIS algorithm , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[27]  Pavel Pudlák,et al.  Satisfiability Coding Lemma , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[28]  Ge Xia,et al.  Strong computational lower bounds via parameterized complexity , 2006, J. Comput. Syst. Sci..

[29]  Russell Impagliazzo,et al.  On the Complexity of k-SAT , 2001, J. Comput. Syst. Sci..

[30]  Ioannis Koutis,et al.  Faster Algebraic Algorithms for Path and Packing Problems , 2008, ICALP.

[31]  Ryan Williams,et al.  Finding paths of length k in O*(2k) time , 2008, Inf. Process. Lett..

[32]  Dieter van Melkebeek,et al.  A Survey of Lower Bounds for Satisfiability and Related Problems , 2007, Found. Trends Theor. Comput. Sci..

[33]  Daniele Micciancio,et al.  Faster exponential time algorithms for the shortest vector problem , 2010, SODA '10.

[34]  Daniele Micciancio,et al.  A Deterministic Single Exponential Time Algorithm for Most Lattice Problems based on Voronoi Cell Computations ( Extended Abstract ) , 2009 .

[35]  Michael J. Fischer,et al.  Relations Among Complexity Measures , 1979, JACM.

[36]  Richard M. Karp,et al.  Dynamic programming meets the principle of inclusion and exclusion , 1982, Oper. Res. Lett..

[37]  Richard Bellman,et al.  Dynamic Programming Treatment of the Travelling Salesman Problem , 1962, JACM.

[38]  John Michael Robson,et al.  Algorithms for Maximum Independent Sets , 1986, J. Algorithms.

[39]  Jesper Makholm Byskov Algorithms for k-colouring and finding maximal independent sets , 2003, SODA '03.

[40]  Richard Beigel,et al.  Finding maximum independent sets in sparse and general graphs , 1999, SODA '99.