Hardness amplification in proof complexity

We present a general method for converting any family of unsatisfiable CNF formulas that is hard for one of the simplest proof systems -- tree resolution -- into formulas that require large rank in very strong proof systems, including any proof system that manipulates polynomials of degree at most k (known as Th(k) proofs). These include high degree versions of Lovasz-Schrijver and Cutting Planes proofs. We introduce two very general families of these proof systems, denoted Tcc(k) and Rcc(k). The proof lines of Tcc(k) are arbitrary Boolean functions, each of which can be evaluated by an efficient k-party randomized communication protocol. Tcc(k) proofs include Th(k-1) proofs as a special case. Rcc(k) proofs generalize Tcc(k) proofs and require only that each inference be checkable by a short k-party protocol. For all k in O(loglog n), our main results are as follows: First, any unsatisfiable CNF formula of high resolution rank can be efficiently transformed into another CNF formula requiring high rank in all Rcc(k) systems, and exponential tree size in all Tcc(k) systems. Secondly, there are strict rank hierarchies for all Rcc(k) systems, and strict tree-size hierarchies for all Tcc(k) systems. Finally, we apply our general method to give optimal integrality gaps for low rank Rcc(2) proofs for MAX-2t-SAT, which imply optimal integrality gaps for low rank Cutting Planes and Th(1) proofs.

[1]  Madhur Tulsiani,et al.  A Linear Round Lower Bound for Lovasz-Schrijver SDP Relaxations of Vertex Cover , 2007, Twenty-Second Annual IEEE Conference on Computational Complexity (CCC'07).

[2]  Ralph E. Gomory,et al.  Outline of an Algorithm for Integer Solutions to Linear Programs and An Algorithm for the Mixed Integer Problem , 2010, 50 Years of Integer Programming.

[3]  Alasdair Urquhart Regular and General Resolution: An Improved Separation , 2008, SAT.

[4]  Pavel Pudlák,et al.  Lower bounds for resolution and cutting plane proofs and monotone computations , 1997, Journal of Symbolic Logic.

[5]  Rahul Santhanam,et al.  Making hard problems harder , 2006, 21st Annual IEEE Conference on Computational Complexity (CCC'06).

[6]  Eli Ben-Sasson,et al.  Short proofs are narrow—resolution made simple , 2001, JACM.

[7]  Toniann Pitassi,et al.  Lower bounds for Lov´ asz-Schrijver systems and beyond, using multiparty communication complexity , 2005 .

[8]  Toniann Pitassi,et al.  Exponential Lower Bounds and Integrality Gaps for Tree-Like Lovász-Schrijver Procedures , 2009, SIAM J. Comput..

[9]  A. Razborov Communication Complexity , 2011 .

[10]  Eli Ben-Sasson,et al.  Understanding Space in Resolution: Optimal Lower Bounds and Exponential Trade-offs , 2009, Electron. Colloquium Comput. Complex..

[11]  A. S The Pattern Matrix Method for Lower Bounds on Quantum Communication ∗ , 2007 .

[12]  Avi Wigderson,et al.  Short Proofs are Narrow { Resolution made , 2000 .

[13]  Noam Nisan,et al.  On the degree of boolean functions as real polynomials , 1992, STOC '92.

[14]  Toniann Pitassi,et al.  Rank Bounds and Integrality Gaps for Cutting Planes Procedures , 2006, Theory Comput..

[15]  Vasek Chvátal Edmonds polytopes and a hierarchy of combinatorial problems , 2006, Discret. Math..

[16]  J. A. Robinson,et al.  Review: Martin Davis, George Logemann, Donald Loveland, A Machine Program for Theorem-Proving , 1967 .

[17]  Toniann Pitassi,et al.  Conditional Lower Bound for a System of Constant-Depth Proofs with Modular Connectives , 2006, 21st Annual IEEE Symposium on Logic in Computer Science (LICS'06).

[18]  Emanuele Viola,et al.  Improved Separations between Nondeterministic and Randomized Multiparty Communication , 2008, APPROX-RANDOM.

[19]  Ran Raz,et al.  Super-logarithmic depth lower bounds via direct sum in communication complexity , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[20]  Russell Impagliazzo,et al.  Communication complexity towards lower bounds on circuit depth , 2001, computational complexity.

[21]  Rishi Saket,et al.  SDP Integrality Gaps with Local̀ 1-Embeddability Subhash Khot , 2009 .

[22]  Ran Raz,et al.  Separation of the Monotone NC Hierarchy , 1999, Comb..

[23]  Russell Impagliazzo,et al.  Complexity of k-SAT , 1999, Proceedings. Fourteenth Annual IEEE Conference on Computational Complexity (Formerly: Structure in Complexity Theory Conference) (Cat.No.99CB36317).

[24]  Jean B. Lasserre,et al.  An Explicit Exact SDP Relaxation for Nonlinear 0-1 Programs , 2001, IPCO.

[25]  Alexander A. Sherstov The Pattern Matrix Method , 2009, SIAM J. Comput..

[26]  Paul Beame,et al.  MULTIPARTY COMMUNICATION COMPLEXITY AND THRESHOLD CIRCUIT SIZE OF AC0∗ , 2010 .

[27]  Toniann Pitassi,et al.  The complexity of resolution refinements , 2003, 18th Annual IEEE Symposium of Logic in Computer Science, 2003. Proceedings..

[28]  Saburo Muroga,et al.  Threshold logic and its applications , 1971 .

[29]  Warren P. Adams,et al.  A hierarchy of relaxation between the continuous and convex hull representations , 1990 .

[30]  Endre Szemerédi,et al.  Many hard examples for resolution , 1988, JACM.

[31]  Russell Impagliazzo,et al.  Upper and lower bounds for tree-like cutting planes proofs , 1994, Proceedings Ninth Annual IEEE Symposium on Logic in Computer Science.

[32]  Troy Lee,et al.  Disjointness Is Hard in the Multi-party Number-on-the-Forehead Model , 2008, Computational Complexity Conference.

[33]  Dima Grigoriev,et al.  Linear lower bound on degrees of Positivstellensatz calculus proofs for the parity , 2001, Theor. Comput. Sci..

[34]  Discretely Ordered Modules as a First-Order Extension of The Cutting Planes Proof System , 1998, J. Symb. Log..

[35]  T. Pitassi,et al.  Integrality gaps of 2 - o(1) for Vertex Cover SDPs in the Lovész-Schrijver Hierarchy , 2007, FOCS 2007.

[36]  Subhash Khot,et al.  SDP Integrality Gaps with Local ell_1-Embeddability , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[37]  Moses Charikar,et al.  Integrality gaps for Sherali-Adams relaxations , 2009, STOC '09.

[38]  Grant Schoenebeck,et al.  Linear Level Lasserre Lower Bounds for Certain k-CSPs , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[39]  Prasad Raghavendra,et al.  Integrality Gaps for Strong SDP Relaxations of UNIQUE GAMES , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[40]  Ronald de Wolf,et al.  Quantum lower bounds by polynomials , 2001, JACM.

[41]  Arkadev Chattopadhyay,et al.  Multiparty Communication Complexity of Disjointness , 2008, Electron. Colloquium Comput. Complex..

[42]  Donald W. Loveland,et al.  A machine program for theorem-proving , 2011, CACM.

[43]  Toniann Pitassi,et al.  Lower Bounds for Lovász-Schrijver Systems and Beyond Follow from Multiparty Communication Complexity , 2005, ICALP.

[44]  Alexander A. Sherstov The pattern matrix method for lower bounds on quantum communication , 2008, STOC '08.

[45]  Madhur Tulsiani,et al.  Tight integrality gaps for Lovasz-Schrijver LP relaxations of vertex cover and max cut , 2007, STOC '07.

[46]  Alexander Schrijver,et al.  Cones of Matrices and Set-Functions and 0-1 Optimization , 1991, SIAM J. Optim..

[47]  Madhur Tulsiani CSP gaps and reductions in the lasserre hierarchy , 2009, STOC '09.

[48]  Dima Grigoriev,et al.  Complexity of Null-and Positivstellensatz proofs , 2001, Ann. Pure Appl. Log..

[49]  Ran Raz,et al.  Lower bounds for cutting planes proofs with small coefficients , 1995, Symposium on the Theory of Computing.

[50]  Toniann Pitassi,et al.  Integrality gaps of 2 - o(1) for Vertex Cover SDPs in the Lovész-Schrijver Hierarchy , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[51]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Between the Continuous and Convex Hull Representations for Zero-One Programming Problems , 1990, SIAM J. Discret. Math..

[52]  Madhur Tulsiani,et al.  Optimal Sherali-Adams Gaps from Pairwise Independence , 2009, APPROX-RANDOM.

[53]  Arist Kojevnikov,et al.  Lower Bounds of Static Lovász-Schrijver Calculus Proofs for Tseitin Tautologies , 2006, ICALP.

[54]  Alexander A. Sherstov The Pattern Matrix Method (Journal Version) , 2009, ArXiv.

[55]  Phuong Nguyen,et al.  Separating DAG-Like and Tree-Like Proof Systems , 2007, 22nd Annual IEEE Symposium on Logic in Computer Science (LICS 2007).

[56]  Dima Grigoriev,et al.  Complexity of Semi-algebraic Proofs , 2002, STACS.

[57]  HierarchyRan Raz,et al.  Separation of the Monotone NC , 1999 .

[58]  Vasek Chvátal,et al.  Edmonds polytopes and a hierarchy of combinatorial problems , 1973, Discret. Math..

[59]  Alexander A. Sherstov Separating AC0 from depth-2 majority circuits , 2007, STOC '07.

[60]  Troy Lee,et al.  Disjointness is Hard in the Multiparty Number-on-the-Forehead Model , 2007, 2008 23rd Annual IEEE Conference on Computational Complexity.