Strongly refuting all semi-random Boolean CSPs

We give an efficient algorithm to strongly refute \emph{semi-random} instances of all Boolean constraint satisfaction problems. The number of constraints required by our algorithm matches (up to polylogarithmic factors) the best-known bounds for efficient refutation of fully random instances. Our main technical contribution is an algorithm to strongly refute semi-random instances of the Boolean $k$-XOR problem on $n$ variables that have $\widetilde{O}(n^{k/2})$ constraints. (In a semi-random $k$-XOR instance, the equations can be arbitrary and only the right-hand sides are random.) One of our key insights is to identify a simple combinatorial property of random XOR instances that makes spectral refutation work. Our approach involves taking an instance that does not satisfy this property (i.e., is \emph{not} pseudorandom) and reducing it to a partitioned collection of $2$-XOR instances. We analyze these subinstances using a carefully chosen quadratic form as a proxy, which in turn is bounded via a combination of spectral methods and semidefinite programming. The analysis of our spectral bounds relies only on an off-the-shelf matrix Bernstein inequality. Even for the purely random case, this leads to a shorter proof compared to the ones in the literature that rely on problem-specific trace-moment computations.

[1]  Beating Simplex for Fractional Packing and Covering Linear Programs , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[2]  A. Bandeira,et al.  Sharp nonasymptotic bounds on the norm of random matrices with independent entries , 2014, 1408.6185.

[3]  Huijia Lin,et al.  Indistinguishability Obfuscation from Constant-Degree Graded Encoding Schemes , 2016, EUROCRYPT.

[4]  Venkatesan Guruswami,et al.  Sum-of-Squares Certificates for Maxima of Random Tensors on the Sphere , 2016, APPROX-RANDOM.

[5]  Avi Wigderson,et al.  Public-key cryptography from different assumptions , 2010, STOC '10.

[6]  Ryan O'Donnell,et al.  Sum of squares lower bounds for refuting any CSP , 2017, STOC.

[7]  Michael Alekhnovich,et al.  Lower bounds for polynomial calculus: non-binomial case , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[8]  U. Feige,et al.  Finding and certifying a large hidden clique in a semirandom graph , 2000, Random Struct. Algorithms.

[9]  Michael Krivelevich,et al.  Efficient Recognition of Random Unsatisfiable k-SAT Instances by Spectral Methods , 2001, STACS.

[10]  Alan M. Frieze,et al.  An efficient sparse regularity concept , 2009, SODA.

[11]  Joel H. Spencer,et al.  Coloring Random and Semi-Random k-Colorable Graphs , 1995, J. Algorithms.

[12]  David Witmer,et al.  Goldreich's PRG: Evidence for Near-Optimal Polynomial Stretch , 2014, 2014 IEEE 29th Conference on Computational Complexity (CCC).

[13]  Dima Grigoriev,et al.  Linear lower bound on degrees of Positivstellensatz calculus proofs for the parity , 2001, Theor. Comput. Sci..

[14]  Andrea Montanari,et al.  The threshold for SDP-refutation of random regular NAE-3SAT , 2018, SODA.

[15]  Stefano Tessaro,et al.  Indistinguishability Obfuscation from Trilinear Maps and Block-Wise Local PRGs , 2017, CRYPTO.

[16]  Jacques Verstraëte,et al.  Parity check matrices and product representations of squares , 2008, Comb..

[17]  Oded Goldreich,et al.  Candidate One-Way Functions Based on Expander Graphs , 2000, Studies in Complexity and Cryptography.

[18]  Luca Trevisan,et al.  A New Algorithm for the Robust Semi-random Independent Set Problem , 2018, SODA.

[19]  Ryan O'Donnell,et al.  How to Refute a Random CSP , 2015, 2015 IEEE 56th Annual Symposium on Foundations of Computer Science.

[20]  Sanjeev Arora,et al.  Towards Strong Nonapproximability Results in the Lovász-Schrijver Hierarchy , 2011, STOC '05.

[21]  Eli Ben-Sasson,et al.  Random Cnf’s are Hard for the Polynomial Calculus , 2010, computational complexity.

[22]  Madhur Tulsiani CSP gaps and reductions in the lasserre hierarchy , 2009, STOC '09.

[23]  Eli Ben-Sasson,et al.  Short proofs are narrow—resolution made simple , 2001, JACM.

[24]  Patrick Briest,et al.  Uniform Budgets and the Envy-Free Pricing Problem , 2008, ICALP.

[25]  Refutation of random constraint satisfaction problems using the sum of squares proof system , 2017 .

[26]  M. Laurent Sums of Squares, Moment Matrices and Optimization Over Polynomials , 2009 .

[27]  Stephen A. Cook,et al.  On the complexity of proof systems , 1996 .

[28]  Prasad Raghavendra,et al.  Strongly refuting random CSPs below the spectral threshold , 2016, STOC.

[29]  Vinod Vaikuntanathan,et al.  Indistinguishability Obfuscation from DDH-Like Assumptions on Constant-Degree Graded Encodings , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[30]  Michael E. Saks,et al.  The Efficiency of Resolution and Davis--Putnam Procedures , 2002, SIAM J. Comput..

[31]  Amit Sahai,et al.  Projective Arithmetic Functional Encryption and Indistinguishability Obfuscation from Degree-5 Multilinear Maps , 2017, EUROCRYPT.

[32]  Madhur Tulsiani,et al.  SDP Gaps from Pairwise Independence , 2012, Theory Comput..

[33]  Santosh S. Vempala,et al.  University of Birmingham On the Complexity of Random Satisfiability Problems with Planted Solutions , 2018 .

[34]  Huijia Lin,et al.  Indistinguishability Obfuscation from SXDH on 5-Linear Maps and Locality-5 PRGs , 2017, CRYPTO.

[35]  Michael Alekhnovich More on Average Case vs Approximation Complexity , 2011, computational complexity.

[36]  Andreas Goerdt,et al.  Recognizing more random unsatisfiable 3-SAT instances efficiently , 2003, Electron. Notes Discret. Math..

[37]  K. Roberts,et al.  Thesis , 2002 .

[38]  Uriel Feige,et al.  Relations between average case complexity and approximation complexity , 2002, STOC '02.

[39]  Nathan Linial,et al.  From average case complexity to improper learning complexity , 2013, STOC.

[40]  Ryuhei Mori,et al.  Lower bounds for CSP refutation by SDP hierarchies , 2016, APPROX-RANDOM.

[41]  Guy Kindler,et al.  On the optimality of semidefinite relaxations for average-case and generalized constraint satisfaction , 2013, ITCS '13.

[42]  Amin Coja-Oghlan,et al.  Strong Refutation Heuristics for Random k-SAT , 2004, APPROX-RANDOM.

[43]  Subhash Khot,et al.  Linear Equations Modulo 2 and the L1 Diameter of Convex Bodies , 2008, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[44]  Toniann Pitassi,et al.  Rank Bounds and Integrality Gaps for Cutting Planes Procedures , 2006, Theory Comput..

[45]  Grant Schoenebeck,et al.  Linear Level Lasserre Lower Bounds for Certain k-CSPs , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[46]  Ran Raz,et al.  Time-Space Tradeoffs for Distinguishing Distributions and Applications to Security of Goldreich's PRG , 2020, APPROX/RANDOM.

[47]  Nathan Linial,et al.  More data speeds up training time in learning halfspaces over sparse vectors , 2013, NIPS.

[48]  Uriel Feige,et al.  Heuristics for Semirandom Graph Problems , 2001, J. Comput. Syst. Sci..

[49]  Pravesh Kothari,et al.  Limits on Low-Degree Pseudorandom Generators (Or: Sum-of-Squares Meets Program Obfuscation) , 2018, Electron. Colloquium Comput. Complex..

[50]  Noga Alon,et al.  Optimizing budget allocation among channels and influencers , 2012, WWW.

[51]  Ankur Moitra,et al.  Tensor Prediction, Rademacher Complexity and Random 3-XOR , 2015, ArXiv.

[52]  Amin Coja-Oghlan Colouring Semirandom Graphs , 2007, Comb. Probab. Comput..

[53]  Madhur Tulsiani,et al.  LS+ Lower Bounds from Pairwise Independence , 2013, 2013 IEEE Conference on Computational Complexity.

[54]  Amin Coja-Oghlan Solving NP-hard semirandom graph problems in polynomial expected time , 2007, J. Algorithms.

[55]  Yuan Zhou,et al.  Approximability and proof complexity , 2012, SODA.

[56]  Benny Applebaum,et al.  Cryptographic Hardness of Random Local Functions , 2013, computational complexity.

[57]  Pravesh Kothari,et al.  Semialgebraic Proofs and Efficient Algorithm Design , 2019, Electron. Colloquium Comput. Complex..

[58]  Yonatan Bilu,et al.  A Gap in Average Proof Complexity , 2002, Electron. Colloquium Comput. Complex..

[59]  Pravesh Kothari,et al.  Sum of Squares Lower Bounds from Pairwise Independence , 2015, STOC.

[60]  J. Krivine Constantes de Grothendieck et fonctions de type positif sur les sphères , 1979 .

[61]  David Steurer,et al.  Sum-of-squares proofs and the quest toward optimal algorithms , 2014, Electron. Colloquium Comput. Complex..

[62]  Endre Szemerédi,et al.  Many hard examples for resolution , 1988, JACM.

[63]  Amit Sahai,et al.  Indistinguishability Obfuscation from Simple-to-State Hard Problems: New Assumptions, New Techniques, and Simplification , 2020, IACR Cryptol. ePrint Arch..

[64]  Erik D. Demaine,et al.  Combination can be hard: approximability of the unique coverage problem , 2006, SODA '06.

[65]  JOEL FRIEDMAN,et al.  Recognizing More Unsatisfiable Random k-SAT Instances Efficiently , 2005, SIAM J. Comput..

[66]  Alexandra Kolla,et al.  How to Play Unique Games Against a Semi-random Adversary: Study of Semi-random Models of Unique Games , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[67]  Joel A. Tropp,et al.  User-Friendly Tail Bounds for Sums of Random Matrices , 2010, Found. Comput. Math..

[68]  Uriel Feige Refuting Smoothed 3CNF Formulas , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[69]  Eli Ben-Sasson,et al.  Random Cnf’s are Hard for the Polynomial Calculus , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[70]  A. Grothendieck Résumé de la théorie métrique des produits tensoriels topologiques , 1996 .

[71]  Cristopher Moore,et al.  The Kikuchi Hierarchy and Tensor PCA , 2019, 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS).

[72]  Amit Daniely,et al.  Complexity theoretic limitations on learning halfspaces , 2015, STOC.

[73]  The 3-SAT problem with large number of clauses in the ∞-replica symmetry breaking scheme , 2001, cond-mat/0108433.

[74]  Rina Panigrahy,et al.  Efficient multicast on a terabit router , 2004, Proceedings. 12th Annual IEEE Symposium on High Performance Interconnects.

[75]  Aravindan Vijayaraghavan,et al.  Approximation algorithms for semi-random partitioning problems , 2012, STOC '12.