Hypercontractivity, sum-of-squares proofs, and their applications

We study the computational complexity of approximating the 2-to-q norm of linear operators (defined as |A|2->q = maxv≠ 0|Av|q/|v|2) for q > 2, as well as connections between this question and issues arising in quantum information theory and the study of Khot's Unique Games Conjecture (UGC). We show the following: For any constant even integer q ≥ 4, a graph G is a small-set expander if and only if the projector into the span of the top eigenvectors of G's adjacency matrix has bounded 2->q norm. As a corollary, a good approximation to the 2->q norm will refute the Small-Set Expansion Conjecture --- a close variant of the UGC. We also show that such a good approximation can be obtained in exp(n2/q) time, thus obtaining a different proof of the known subexponential algorithm for Small-Set-Expansion. Constant rounds of the "Sum of Squares" semidefinite programing hierarchy certify an upper bound on the 2->4 norm of the projector to low degree polynomials over the Boolean cube, as well certify the unsatisfiability of the "noisy cube" and "short code" based instances of Unique-Games considered by prior works. This improves on the previous upper bound of exp(logO(1) n) rounds (for the "short code"), as well as separates the "Sum of Squares"/"Lasserre" hierarchy from weaker hierarchies that were known to require ω(1) rounds. We show reductions between computing the 2->4 norm and computing the injective tensor norm of a tensor, a problem with connections to quantum information theory. Three corollaries are: (i) the 2->4 norm is NP-hard to approximate to precision inverse-polynomial in the dimension, (ii) the 2->4 norm does not have a good approximation (in the sense above) unless 3-SAT can be solved in time exp(√n poly log(n)), and (iii) known algorithms for the quantum separability problem imply a non-trivial additive approximation for the 2->4 norm.

[1]  Guy Kindler,et al.  The UGC hardness threshold of the ℓp Grothendieck problem , 2008, SODA '08.

[2]  Andris Ambainis,et al.  Quantum t-designs: t-wise Independence in the Quantum World , 2007, Twenty-Second Annual IEEE Conference on Computational Complexity (CCC'07).

[3]  Matthias Christandl,et al.  A quasipolynomial-time algorithm for the quantum separability problem , 2010, STOC '11.

[4]  Nisheeth K. Vishnoi,et al.  The Unique Games Conjecture, Integrality Gap for Cut Problems and Embeddability of Negative Type Metrics into l1 , 2005, FOCS.

[5]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[6]  Prasad Raghavendra,et al.  Rounding Semidefinite Programming Hierarchies via Global Correlation , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[7]  Prasad Raghavendra,et al.  Making the long code shorter, with applications to the Unique Games Conjecture , 2011, Electron. Colloquium Comput. Complex..

[8]  Madhur Tulsiani CSP gaps and reductions in the lasserre hierarchy , 2009, STOC '09.

[9]  Ronald de Wolf,et al.  Near-Optimal and Explicit Bell Inequality Violations , 2012, Theory Comput..

[10]  M. Horodecki,et al.  Separability of mixed states: necessary and sufficient conditions , 1996, quant-ph/9605038.

[11]  David Steurer Subexponential Algorithms for dto-1 Two-Prover Games and for Certifying Almost Perfect Expansion , 2010 .

[12]  A. Harrow,et al.  Testing Product States, Quantum Merlin-Arthur Games and Tensor Optimization , 2010, JACM.

[13]  Michael W. Mahoney,et al.  Future Directions in Tensor-Based Computation and Modeling , 2009 .

[14]  Leonid Gurvits Classical deterministic complexity of Edmonds' Problem and quantum entanglement , 2003, STOC '03.

[15]  Thomas Kühn,et al.  Remarks on symmetries of trilinear forms , 2000 .

[16]  Elias M. Stein,et al.  Interpolation of linear operators , 1956 .

[17]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Between the Continuous and Convex Hull Representations for Zero-One Programming Problems , 1990, SIAM J. Discret. Math..

[18]  Bonnie Berger,et al.  The fourth moment method , 1991, SODA '91.

[19]  N. Z. Shor An approach to obtaining global extremums in polynomial mathematical programming problems , 1987 .

[20]  Yurii Nesterov,et al.  Squared Functional Systems and Optimization Problems , 2000 .

[21]  Alexander Schrijver,et al.  Cones of Matrices and Set-Functions and 0-1 Optimization , 1991, SIAM J. Optim..

[22]  P. Parrilo Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[23]  A. V. D. Vaart,et al.  Lectures on probability theory and statistics , 2002 .

[24]  Grant Schoenebeck,et al.  Linear Level Lasserre Lower Bounds for Certain k-CSPs , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[25]  M. Rudelson,et al.  Hanson-Wright inequality and sub-gaussian concentration , 2013 .

[26]  Rishi Saket,et al.  SDP Integrality Gaps with Local̀ 1-Embeddability Subhash Khot , 2009 .

[27]  Prasad Raghavendra,et al.  Approximations for the isoperimetric and spectral profile of graphs and related parameters , 2010, STOC '10.

[28]  P. Parrilo,et al.  Complete family of separability criteria , 2003, quant-ph/0308032.

[29]  A. Montanaro Weak Multiplicativity for Random Quantum Channels , 2011, Communications in Mathematical Physics.

[30]  Ryan O'Donnell,et al.  Noise stability of functions with low influences: Invariance and optimality , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[31]  Salman Beigi,et al.  Approximating the set of separable states using the positive partial transpose test , 2009, 0902.1806.

[32]  Arkadi Nemirovski,et al.  Robust Convex Optimization , 1998, Math. Oper. Res..

[33]  Monique Laurent,et al.  A Comparison of the Sherali-Adams, Lovász-Schrijver, and Lasserre Relaxations for 0-1 Programming , 2003, Math. Oper. Res..

[34]  Daureen Steinberg COMPUTATION OF MATRIX NORMS WITH APPLICATIONS TO ROBUST OPTIMIZATION , 2007 .

[35]  M. Ledoux,et al.  Logarithmic Sobolev Inequalities , 2014 .

[36]  Ryan O'Donnell,et al.  Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? , 2007, SIAM J. Comput..

[37]  François Le Gall,et al.  On QMA protocols with two short quantum proofs , 2011, Quantum Inf. Comput..

[38]  Prasad Raghavendra,et al.  Graph expansion and the unique games conjecture , 2010, STOC '10.

[39]  Subhash Khot,et al.  Approximate Lasserre Integrality Gap for Unique Games , 2010, APPROX-RANDOM.

[40]  Punyashloka Biswal,et al.  Hypercontractivity and its applications , 2011, ArXiv.

[41]  Claire Mathieu,et al.  Integrality Gaps of Linear and Semi-Definite Programming Relaxations for Knapsack , 2011, IPCO.

[42]  Venkatesan Guruswami,et al.  Lasserre Hierarchy, Higher Eigenvalues, and Approximation Schemes for Quadratic Integer Programming with PSD Objectives , 2011, Electron. Colloquium Comput. Complex..

[43]  Subhash Khot On the power of unique 2-prover 1-round games , 2002, STOC '02.

[44]  Prasad Raghavendra,et al.  Reductions between Expansion Problems , 2010, 2012 IEEE 27th Conference on Computational Complexity.

[45]  B. Bollobás THE VOLUME OF CONVEX BODIES AND BANACH SPACE GEOMETRY (Cambridge Tracts in Mathematics 94) , 1991 .

[46]  Ashley Montanaro,et al.  An Efficient Test for Product States with Applications to Quantum Merlin-Arthur Games , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[47]  Pablo A. Parrilo,et al.  Semidefinite programming relaxations for semialgebraic problems , 2003, Math. Program..

[48]  R. Adamczak,et al.  Sharp bounds on the rate of convergence of the empirical covariance matrix , 2010, 1012.0294.

[49]  C. Fuchs,et al.  Unknown Quantum States: The Quantum de Finetti Representation , 2001, quant-ph/0104088.

[50]  Warren P. Adams,et al.  A hierarchy of relaxation between the continuous and convex hull representations , 1990 .

[51]  L. Saloff-Coste,et al.  Lectures on finite Markov chains , 1997 .

[52]  Etienne de Klerk,et al.  On the Lasserre Hierarchy of Semidefinite Programming Relaxations of Convex Polynomial Optimization Problems , 2011, SIAM J. Optim..

[53]  R. Ryan Introduction to Tensor Products of Banach Spaces , 2002 .

[54]  Santosh S. Vempala,et al.  Tensor decomposition and approximation schemes for constraint satisfaction problems , 2005, STOC '05.

[55]  Subhash Khot,et al.  SDP Integrality Gaps with Local ell_1-Embeddability , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[56]  Prasad Raghavendra,et al.  Integrality Gaps for Strong SDP Relaxations of UNIQUE GAMES , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[57]  Ryan O'Donnell,et al.  Analysis of Boolean Functions , 2014, ArXiv.

[58]  Aditya Bhaskara,et al.  Approximating matrix p-norms , 2010, SODA '11.

[59]  Guy Kindler,et al.  Optimal inapproximability results for MAX-CUT and other 2-variable CSPs? , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[60]  Matthias Christandl,et al.  One-and-a-Half Quantum de Finetti Theorems , 2007 .

[61]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[62]  Venkatesan Guruswami,et al.  Lasserre Hierarchy, Higher Eigenvalues, and Approximation Schemes for Graph Partitioning and Quadratic Integer Programming with PSD Objectives , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[63]  M. Owari,et al.  Power of symmetric extensions for entanglement detection , 2009, 0906.2731.

[64]  Yi-Kai Liu The complexity of the consistency and N-representability problems for quantum states - eScholarship , 2007, 0712.3041.

[65]  Ronald de Wolf,et al.  Near-Optimal and Explicit Bell Inequality Violations , 2011, 2011 IEEE 26th Annual Conference on Computational Complexity.

[66]  Madhur Tulsiani,et al.  Convex Relaxations and Integrality Gaps , 2012 .

[67]  R. Adamczak,et al.  Quantitative estimates of the convergence of the empirical covariance matrix in log-concave ensembles , 2009, 0903.2323.

[68]  G. Pisier The volume of convex bodies and Banach space geometry , 1989 .

[69]  Russell Impagliazzo,et al.  Which problems have strongly exponential complexity? , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[70]  M. Laurent Sums of Squares, Moment Matrices and Optimization Over Polynomials , 2009 .

[71]  Graeme Mitchison,et al.  A most compendious and facile quantum de Finetti theorem , 2007 .

[72]  Sanjeev Arora,et al.  Subexponential Algorithms for Unique Games and Related Problems , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.