Rigid Matrices From Rectangular PCPs or: Hard Claims Have Complex Proofs

We introduce a variant of PCPs, that we refer to as rectangular PCPs, wherein proofs are thought of as square matrices, and the random coins used by the verifier can be partitioned into two disjoint sets, one determining the row of each query and the other determining the *column*. We construct PCPs that are efficient, short, smooth and (almost-)rectangular. As a key application, we show that proofs for hard languages in NTIME$(2^n)$, when viewed as matrices, are rigid infinitely often. This strengthens and considerably simplifies a recent result of Alman and Chen [FOCS, 2019] constructing explicit rigid matrices in FNP. Namely, we prove the following theorem: - There is a constant $\delta \in (0,1)$ such that there is an FNP-machine that, for infinitely many $N$, on input $1^N$ outputs $N \times N$ matrices with entries in $\mathbb{F}_2$ that are $\delta N^2$-far (in Hamming distance) from matrices of rank at most $2^{\log N/\Omega(\log \log N)}$. Our construction of rectangular PCPs starts with an analysis of how randomness yields queries in the Reed--Muller-based outer PCP of Ben-Sasson, Goldreich, Harsha, Sudan and Vadhan [SICOMP, 2006; CCC, 2005]. We then show how to preserve rectangularity under PCP composition and a smoothness-inducing transformation. This warrants refined and stronger notions of rectangularity, which we prove for the outer PCP and its transforms.

[1]  Avi Wigderson,et al.  In search of an easy witness: exponential time vs. probabilistic polynomial time , 2001, Proceedings 16th Annual IEEE Conference on Computational Complexity.

[2]  Oded Goldreich,et al.  Locally testable codes and PCPs of almost-linear length , 2006, JACM.

[3]  Richard Ryan Williams,et al.  Probabilistic rank and matrix rigidity , 2016, STOC.

[4]  Ryan Williams,et al.  Almost-Everywhere Circuit Lower Bounds from Non-Trivial Derandomization , 2020, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[5]  Ryan Williams,et al.  Natural proofs versus derandomization , 2012, STOC '13.

[6]  Oded Goldreich,et al.  Universal arguments and their applications , 2002, Proceedings 17th IEEE Annual Conference on Computational Complexity.

[7]  Leslie G. Valiant,et al.  Graph-Theoretic Arguments in Low-Level Complexity , 1977, MFCS.

[8]  Michael J. Fischer,et al.  Relations Among Complexity Measures , 1979, JACM.

[9]  Ryan Williams,et al.  Improving exhaustive search implies superpolynomial lower bounds , 2010, STOC '10.

[10]  Stephen A. Cook,et al.  Short Propositional Formulas Represent Nondeterministic Computations , 1988, Inf. Process. Lett..

[11]  Sanjeev Arora,et al.  Probabilistic checking of proofs: a new characterization of NP , 1998, JACM.

[12]  Timothy M. Chan,et al.  Deterministic APSP , Orthogonal Vectors , and More : Quickly , 2019 .

[13]  Ryan Williams Nonuniform ACC Circuit Lower Bounds , 2014, JACM.

[14]  Daniel A. Spielman,et al.  A Remark on Matrix Rigidity , 1997, Inf. Process. Lett..

[15]  Omer Reingold,et al.  Assignment testers: towards a combinatorial proof of the PCP-theorem , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[16]  Irit Dinur,et al.  Composition of Low-Error 2-Query PCPs Using Decodable PCPs , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[17]  Henning Wunderlich On a Theorem of Razborov , 2011, computational complexity.

[18]  Leonid A. Levin,et al.  Checking computations in polylogarithmic time , 1991, STOC '91.

[19]  Noga Alon,et al.  Simple Construction of Almost k-wise Independent Random Variables , 1992, Random Struct. Algorithms.

[20]  Uriel Feige,et al.  Universal Factor Graphs , 2012, ICALP.

[21]  Josh Alman,et al.  Efficient Construction of Rigid Matrices Using an NP Oracle , 2019, 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS).

[22]  Manuel Blum,et al.  Self-testing/correcting with applications to numerical problems , 1990, STOC '90.

[23]  Eli Ben-Sasson,et al.  Randomness-efficient low degree tests and short PCPs via epsilon-biased sets , 2003, STOC '03.

[24]  Emanuele Viola,et al.  Short PCPs with Projection Queries , 2014, ICALP.

[25]  Oded Goldreich,et al.  A Sample of Samplers - A Computational Perspective on Sampling (survey) , 1997, Electron. Colloquium Comput. Complex..

[26]  Avishay Tal,et al.  Matrix rigidity of random Toeplitz matrices , 2016, computational complexity.

[27]  Sanjeev Arora,et al.  Computational Complexity: A Modern Approach , 2009 .

[28]  G. David Forney,et al.  Concatenated codes , 2009, Scholarpedia.

[29]  Stanislav Zák,et al.  A Turing Machine Time Hierarchy , 1983, Theor. Comput. Sci..

[30]  Carsten Lund,et al.  Proof verification and hardness of approximation problems , 1992, Proceedings., 33rd Annual Symposium on Foundations of Computer Science.

[31]  Jonathan Katz,et al.  On the efficiency of local decoding procedures for error-correcting codes , 2000, STOC '00.

[32]  Orr Paradise,et al.  Smooth and Strong PCPs , 2021, Electron. Colloquium Comput. Complex..

[33]  Luca Trevisan,et al.  Inapproximability of Combinatorial Optimization Problems , 2004, Electron. Colloquium Comput. Complex..

[34]  Eli Ben-Sasson,et al.  Short PCPs verifiable in polylogarithmic time , 2005, 20th Annual IEEE Conference on Computational Complexity (CCC'05).

[35]  Zeev Dvir,et al.  Fourier and circulant matrices are not rigid , 2019, CCC.

[36]  Thilo Mie,et al.  Short PCPPs verifiable in polylogarithmic time with O(1) queries , 2009, Annals of Mathematics and Artificial Intelligence.

[37]  Avishay Tal,et al.  Rigid Matrices From Rectangular PCPs or: Hard Claims Have Complex Proofs , 2020, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[38]  Irit Dinur,et al.  The PCP theorem by gap amplification , 2006, STOC.

[39]  Joel Friedman,et al.  A note on matrix rigidity , 1993, Comb..

[40]  Timothy M. Chan,et al.  Deterministic APSP, Orthogonal Vectors, and More: Quickly Derandomizing Razborov-Smolensky , 2016, SODA.

[41]  Zeev Dvir,et al.  Matrix rigidity and the Croot-Lev-Pach lemma , 2017, Theory Comput..

[42]  Richard Ryan Williams,et al.  Stronger connections between circuit analysis and circuit lower bounds, via PCPs of proximity , 2019, CCC.

[43]  Eli Ben-Sasson,et al.  Short PCPs with Polylog Query Complexity , 2008, SIAM J. Comput..

[44]  Johan Håstad,et al.  Optimal Inapproximability with Universal Factor Graphs , 2019, Electron. Colloquium Comput. Complex..

[45]  Ran Raz,et al.  Sub-constant error low degree test of almost-linear size , 2006, STOC '06.

[46]  Rahul Santhanam,et al.  On Uniformity and Circuit Lower Bounds , 2014, computational complexity.

[47]  Daniel A. Spielman,et al.  Linear-time encodable and decodable error-correcting codes , 1995, STOC '95.

[48]  Satyanarayana V. Lokam Complexity Lower Bounds using Linear Algebra , 2009, Found. Trends Theor. Comput. Sci..

[49]  Moni Naor,et al.  Small-bias probability spaces: efficient constructions and applications , 1990, STOC '90.

[50]  Eli Ben-Sasson,et al.  Robust PCPs of Proximity, Shorter PCPs, and Applications to Coding , 2004, SIAM J. Comput..