Lifting with Simple Gadgets and Applications to Circuit and Proof Complexity

We significantly strengthen and generalize the theorem lifting Nullstellensatz degree to monotone span program size by Pitassi and Robere (2018) so that it works for any gadget with high enough rank, in particular, for useful gadgets such as equality and greater-than. We apply our generalized theorem to solve two open problems: * We present the first result that demonstrates a separation in proof power for cutting planes with unbounded versus polynomially bounded coefficients. Specifically, we exhibit CNF formulas that can be refuted in quadratic length and constant line space in cutting planes with unbounded coefficients, but for which there are no refutations in subexponential length and subpolynomial line space if coefficients are restricted to be of polynomial magnitude. * We give the first explicit separation between monotone Boolean formulas and monotone real formulas. Specifically, we give an explicit family of functions that can be computed with monotone real formulas of nearly linear size but require monotone Boolean formulas of exponential size. Previously only a non-explicit separation was known. An important technical ingredient, which may be of independent interest, is that we show that the Nullstellensatz degree of refuting the pebbling formula over a DAG G over any field coincides exactly with the reversible pebbling price of G. In particular, this implies that the standard decision tree complexity and the parity decision tree complexity of the corresponding falsified clause search problem are equal.

[1]  Toniann Pitassi,et al.  The Landscape of Communication Complexity Classes , 2018, computational complexity.

[2]  Toniann Pitassi,et al.  Lower Bounds for Lovász-Schrijver Systems and Beyond Follow from Multiparty Communication Complexity , 2005, ICALP.

[3]  Prasad Raghavendra,et al.  Lower Bounds on the Size of Semidefinite Programming Relaxations , 2014, STOC.

[4]  Rahul Jain,et al.  Extension Complexity of Independent Set Polytopes , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[5]  Pavel Pudlák,et al.  A note on monotone real circuits , 2018, Inf. Process. Lett..

[6]  Vasek Chvátal,et al.  Edmonds polytopes and a hierarchy of combinatorial problems , 1973, Discret. Math..

[7]  Prasad Raghavendra,et al.  Approximating rectangles by juntas and weakly-exponential lower bounds for LP relaxations of CSPs , 2016, STOC.

[8]  Jan Kraíček,et al.  Interpolation by a Game , 1998 .

[9]  Russell Impagliazzo,et al.  Communication complexity towards lower bounds on circuit depth , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[10]  Avi Wigderson,et al.  Monotone Circuits for Connectivity Require Super-Logarithmic Depth , 1990, SIAM J. Discret. Math..

[11]  Alexander A. Razborov,et al.  Applications of matrix methods to the theory of lower bounds in computational complexity , 1990, Comb..

[12]  Jan Krajícek,et al.  Proof complexity in algebraic systems and bounded depth Frege systems with modular counting , 1997, computational complexity.

[13]  Or Meir,et al.  Toward the KRW Composition Conjecture: Cubic Formula Lower Bounds via Communication Complexity , 2016, computational complexity.

[14]  Samuel R. Buss Lower bounds on Nullstellensatz proofs via designs , 1996, Proof Complexity and Feasible Arithmetics.

[15]  Toniann Pitassi,et al.  Lifting Nullstellensatz to monotone span programs over any field , 2018, Electron. Colloquium Comput. Complex..

[16]  Anna Gál A characterization of span program size and improved lower bounds for monotone span programs , 1998, STOC '98.

[17]  Robert Robere,et al.  Unified Lower Bounds for Monotone Computation , 2018 .

[18]  Ran Raz,et al.  Separation of the Monotone NC Hierarchy , 1999, Comb..

[19]  Michael Alekhnovich,et al.  Space Complexity in Propositional Calculus , 2002, SIAM J. Comput..

[20]  Nicola Galesi,et al.  A Framework for Space Complexity in Algebraic Proof Systems , 2015, J. ACM.

[21]  Jan Krajícek Interpolation by a Game , 1998, Math. Log. Q..

[22]  William J. Cook,et al.  On the complexity of cutting-plane proofs , 1987, Discret. Appl. Math..

[23]  Robert E. Tarjan,et al.  Space bounds for a game on graphs , 1976, STOC '76.

[24]  Russell Impagliazzo,et al.  Homogenization and the polynomial calculus , 2000, computational complexity.

[25]  Toniann Pitassi,et al.  Strongly exponential lower bounds for monotone computation , 2017, Electron. Colloquium Comput. Complex..

[26]  Avi Wigderson,et al.  Composition of the Universal Relation , 1990, Advances In Computational Complexity Theory.

[27]  Peter Clote,et al.  Cutting planes, connectivity, and threshold logic , 1996, Arch. Math. Log..

[28]  Bruno Loff,et al.  Lifting Theorems for Equality , 2018, Electron. Colloquium Comput. Complex..

[29]  Jakob Nordström,et al.  On the virtue of succinct proofs: amplifying communication complexity hardness to time-space trade-offs in proof complexity , 2012, STOC '12.

[30]  Eli Ben-Sasson,et al.  Short proofs are narrow—resolution made simple , 2001, JACM.

[31]  Jacobo Torán,et al.  Space Bounds for Resolution , 1999, STACS.

[32]  Yuval Filmus,et al.  Space Complexity in Polynomial Calculus , 2015, SIAM J. Comput..

[33]  Charles H. Bennett Time/Space Trade-Offs for Reversible Computation , 1989, SIAM J. Comput..

[34]  G. Marsaglia,et al.  When Does Rank(A+B)=Rank(A)+Rank(B)? , 1972, Canadian Mathematical Bulletin.

[35]  Russell Impagliazzo,et al.  Stabbing Planes , 2017, ITCS.

[36]  Or Meir,et al.  Improved Composition Theorems for Functions and Relations , 2018, APPROX-RANDOM.

[37]  Pavel Pudlák,et al.  Lower bounds for resolution and cutting plane proofs and monotone computations , 1997, Journal of Symbolic Logic.

[38]  Shachar Lovett,et al.  Rectangles Are Nonnegative Juntas , 2015, SIAM J. Comput..

[39]  Toniann Pitassi,et al.  Randomized Communication vs. Partition Number , 2015, Electron. Colloquium Comput. Complex..

[40]  Pavel Pudlák,et al.  The space complexity of cutting planes refutations , 2014, Electron. Colloquium Comput. Complex..

[41]  J. Kraj,et al.  On Frege and Extended Frege Proof Systems , 1993 .

[42]  Dmitry Sokolov Dag-Like Communication and Its Applications , 2016, CSR.

[43]  Alexander A. Sherstov The Pattern Matrix Method , 2009, SIAM J. Comput..

[44]  Marc Vinyals,et al.  How Limited Interaction Hinders Real Communication (and What It Means for Proof and Circuit Complexity) , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[45]  Jan Krajícek,et al.  Interpolation theorems, lower bounds for proof systems, and independence results for bounded arithmetic , 1997, Journal of Symbolic Logic.

[46]  Saburo Muroga,et al.  Threshold logic and its applications , 1971 .

[47]  Ralph E. Gomory,et al.  Outline of an Algorithm for Integer Solutions to Linear Programs and An Algorithm for the Mixed Integer Problem , 2010, 50 Years of Integer Programming.

[48]  Siu Man Chan Just a Pebble Game , 2013, 2013 IEEE Conference on Computational Complexity.

[49]  Paul Wollan,et al.  Space proof complexity for random 3-CNFs , 2017, Inf. Comput..

[50]  Ankit Garg,et al.  Monotone circuit lower bounds from resolution , 2018, Electron. Colloquium Comput. Complex..

[51]  E. Kushilevitz,et al.  Communication Complexity: Basics , 1996 .

[52]  Eli Ben-Sasson,et al.  Short Proofs May Be Spacious: An Optimal Separation of Space and Length in Resolution , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[53]  Jan Johannsen,et al.  Lower Bounds for Monotone Real Circuit Depth and Formula Size and Tree-Like Cutting Planes , 1998, Inf. Process. Lett..

[54]  Toniann Pitassi,et al.  Query-to-Communication Lifting for P^NP , 2017, Electron. Colloquium Comput. Complex..

[55]  Toniann Pitassi,et al.  Exponential Lower Bounds for Monotone Span Programs , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[56]  Jan Krajíček On Frege and Extended Frege Proof Systems , 1995 .

[57]  Toniann Pitassi,et al.  Deterministic Communication vs. Partition Number , 2015, 2015 IEEE 56th Annual Symposium on Foundations of Computer Science.

[58]  Maria Luisa Bonet,et al.  On the Relative Complexity of Resolution Refinements and Cutting Planes Proof Systems , 2000, SIAM J. Comput..

[59]  Alexander A. Razborov,et al.  Majority gates vs. general weighted threshold gates , 2005, computational complexity.

[60]  Ran Raz,et al.  Super-logarithmic depth lower bounds via the direct sum in communication complexity , 1995, computational complexity.

[61]  Arkadev Chattopadhyay,et al.  Simulation beats richness: new data-structure lower bounds , 2018, Electron. Colloquium Comput. Complex..

[62]  Toniann Pitassi,et al.  Communication lower bounds via critical block sensitivity , 2013, STOC.

[63]  Eli Ben-Sasson,et al.  Space complexity of random formulae in resolution , 2003, Random Struct. Algorithms.

[64]  Ran Raz,et al.  Lower bounds for cutting planes proofs with small coefficients , 1995, Symposium on the Theory of Computing.

[65]  Christoph Berkholz,et al.  Near-Optimal Lower Bounds on Quantifier Depth and Weisfeiler–Leman Refinement Steps , 2016, 2016 31st Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[66]  Noga Alon,et al.  The monotone circuit complexity of boolean functions , 1987, Comb..

[67]  Arnold Rosenbloom,et al.  Monotone Real Circuits are More Powerful than Monotone Boolean Circuits , 1997, Inf. Process. Lett..

[68]  Or Meir,et al.  Toward Better Formula Lower Bounds: The Composition of a Function and a Universal Relation , 2017, SIAM J. Comput..