Understanding Space in Proof Complexity: Separations and Trade-offs via Substitutions

For current state-of-the-art satisfiability algorithms based on the DPLL procedure and clause learning, the tw main bottlenecks are the amounts of time and memory used. In the field of proof complexity, these resources correspond to the length and space of resolution proofs for formulas in conjunctive normal form (CNF). There has been a long line of research investigating these proof complexity measures, but while strong results have been established for length, our understanding of space and how it relates to length has remained quite poor. In particular, the question whether resolution proofs can be optimized for length and space simultaneously, or whether there are trade-offs between these two measures, has remained essentially open apart from a few results in restricted settings. In this paper, we remedy this situation by proving a host of length-space trade-off results for resolution in a completely general setting. Our collection of trade-offs cover almost the whole range of values for the space complexity of formulas, and most of the trade-offs are superpolynomial or even exponential and essentially tight. Using similar techniques, we show that these trade-offs in fact extend (albeit with worse parameters) to the exponentially stronger k -DNF resolution proof systems, which operate with formulas in disjunctive normal form with terms of bounded arity k . We also answer the open question whether the k -DNF resolution systems form a strict hierarchy with respect to space in the affirmative. Our key technical contribution is the following, somewhat surprising, theorem: Any CNF formula F can be transformed by simple variable substitution into a new formula F0such that ifF has the right properties, F0can be proven in essentially the same length asF , whereas on the other hand the minimal number of linesone needs to keep in memory simultaneously in any proof off is lower-bounded by the minimal number of variablesneeded simultaneously in any proof off Applying this theorem to so-called pebbling formulas defined in terms of pebble games on directed acyclic graphs, we obtain our results.

[1]  Eli Ben-Sasson,et al.  A Space Hierarchy for k-DNF Resolution , 2009, Electron. Colloquium Comput. Complex..

[2]  Stephen A. Cook,et al.  Storage requirements for deterministic / polynomial time recognizable languages , 1974, STOC '74.

[3]  Stephen A. Cook,et al.  The Relative Efficiency of Propositional Proof Systems , 1979, Journal of Symbolic Logic.

[4]  Eli Ben-Sasson,et al.  Short proofs are narrow—resolution made simple , 2001, JACM.

[5]  Michael Alekhnovich Lower bounds for k-DNF resolution on random 3-CNFs , 2005, STOC.

[6]  J. Kraj On the Weak Pigeonhole Principle , 2001 .

[7]  Maria M. Klawe,et al.  A tight bound for black and white pebbles on the pyramid , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[8]  Eli Ben-Sasson,et al.  Size space tradeoffs for resolution , 2002, STOC '02.

[9]  Leslie G. Valiant,et al.  On Time Versus Space , 1977, JACM.

[10]  Miklós Ajtai,et al.  The complexity of the Pigeonhole Principle , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[11]  Samuel R. Buss,et al.  A Switching Lemma for Small Restrictions and Lower Bounds for k-DNF Resolution , 2004, SIAM J. Comput..

[12]  Maria Luisa Bonet,et al.  On the Relative Complexity of Resolution Refinements and Cutting Planes Proof Systems , 2000, SIAM J. Comput..

[13]  John E. Savage,et al.  Graph pebbling with many free pebbles can be difficult , 1980, STOC '80.

[14]  Nathan Segerlind Exponential separation between Res(k) and Res(k+1) for k leq varepsilonlogn , 2005, Inf. Process. Lett..

[15]  Bala Kalyanasundaram,et al.  On the power of white pebbles , 1991, STOC '88.

[16]  Michael Alekhnovich,et al.  Space complexity in propositional calculus , 2000, STOC '00.

[17]  Donald W. Loveland,et al.  A machine program for theorem-proving , 2011, CACM.

[18]  Toniann Pitassi,et al.  Hardness amplification in proof complexity , 2009, STOC '10.

[19]  Roberto J. Bayardo,et al.  Using CSP Look-Back Techniques to Solve Real-World SAT Instances , 1997, AAAI/IAAI.

[20]  Johan Håstad,et al.  Towards an Optimal Separation of Space and Length in Resolution , 2013, Theory Comput..

[21]  WigdersonAvi,et al.  Short proofs are narrowresolution made simple , 2001 .

[22]  Albert Atserias,et al.  A combinatorial characterization of resolution width , 2003, 18th IEEE Annual Conference on Computational Complexity, 2003. Proceedings..

[23]  Jakob Nordstr On the Relative Strength of Pebbling and Resolution , 2011 .

[24]  Michael Alekhnovich,et al.  An exponential separation between regular and general resolution , 2002, STOC '02.

[25]  Stephen A. Cook,et al.  An observation on time-storage trade off , 1973, J. Comput. Syst. Sci..

[26]  Hilary Putnam,et al.  A Computing Procedure for Quantification Theory , 1960, JACM.

[27]  Oliver Kullmann,et al.  An application of matroid theory to the SAT problem , 2000, Proceedings 15th Annual IEEE Conference on Computational Complexity.

[28]  Jakob Nordström A simplified way of proving trade-off results for resolution , 2009, Inf. Process. Lett..

[29]  Jacobo Torán Lower Bounds for Space in Resolution , 1999, CSL.

[30]  Endre Szemerédi,et al.  Many hard examples for resolution , 1988, JACM.

[31]  Friedhelm Meyer auf der Heide,et al.  A Comparison of two Variations of a Pebble Game on Graphs , 1981, Theor. Comput. Sci..

[32]  Stephen A. Cook,et al.  Storage Requirements for Deterministic Polynomial Time Recognizable Languages , 1976, J. Comput. Syst. Sci..

[33]  Joao Marques-Silva,et al.  GRASP-A new search algorithm for satisfiability , 1996, Proceedings of International Conference on Computer Aided Design.

[34]  Toniann Pitassi,et al.  Exponential Time/Space Speedups for Resolution and the PSPACE-completeness of Black-White Pebbling , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[35]  Robert E. Tarjan,et al.  Space bounds for a game on graphs , 1976, STOC '76.

[36]  J. Krajícek On the weak pigeonhole principle , 2001 .

[37]  Jakob Nordström,et al.  Narrow proofs may be spacious: separating space and width in resolution , 2006, STOC '06.

[38]  Alexander Hertel,et al.  Applications of Games to Propositional Proof Complexity , 2008 .

[39]  Jochen Messner,et al.  On Minimal Unsatisfiability and Time-Space Trade-offs for k-DNF Resolution , 2009, ICALP.

[40]  Robert E. Tarjan,et al.  Asymptotically tight bounds on time-space trade-offs in a pebble game , 1982, JACM.

[41]  Maria Luisa Bonet,et al.  Lower Bounds for the Weak Pigeonhole Principle and Random Formulas beyond Resolution , 2002, Inf. Comput..

[42]  John E. Savage,et al.  Extreme Time-Space Tradeoffs for Graphs with Small Space Requirements , 1982, Inf. Process. Lett..

[43]  Jacobo Torán,et al.  Minimally Unsatisfiable CNF Formulas , 2001, Bull. EATCS.

[44]  Eli Ben-Sasson,et al.  Space complexity of random formulae in resolution , 2003, Random Struct. Algorithms.

[45]  Eli Ben-Sasson,et al.  Short Proofs May Be Spacious: An Optimal Separation of Space and Length in Resolution , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[46]  Henry A. Kautz,et al.  Using Problem Structure for Efficient Clause Learning , 2003, SAT.

[47]  Eli Ben-Sasson,et al.  Near Optimal Separation Of Tree-Like And General Resolution , 2004, Comb..

[48]  N. S. Narayanaswamy,et al.  An Optimal Lower Bound for Resolution with 2-Conjunctions , 2002, MFCS.

[49]  Maria Luisa Bonet,et al.  On the automatizability of resolution and related propositional proof systems , 2002, Inf. Comput..

[50]  Jacobo Torán,et al.  Space Bounds for Resolution , 1999, STACS.

[51]  Nathan Linial,et al.  Minimal non-two-colorable hypergraphs and minimal unsatisfiable formulas , 1986, J. Comb. Theory, Ser. A.

[52]  Robert E. Tarjan,et al.  The Space Complexity of Pebble Games on Trees , 1980, Inf. Process. Lett..

[53]  Archie Blake Canonical expressions in Boolean algebra , 1938 .

[54]  Toniann Pitassi,et al.  Exponential Time/Space Speedups for Resolution and the PSPACE-completeness of Black-White Pebbling , 2007, FOCS 2007.

[55]  Toniann Pitassi,et al.  The PSPACE-Completeness of Black-White Pebbling , 2010, SIAM J. Comput..

[56]  Toniann Pitassi,et al.  The complexity of resolution refinements , 2003, 18th Annual IEEE Symposium of Logic in Computer Science, 2003. Proceedings..

[57]  Ran Raz,et al.  Separation of the Monotone NC Hierarchy , 1999, Comb..

[58]  Robert E. Tarjan,et al.  Variations of a pebble game on graphs , 1978 .