Inapproximability of Matrix $p\rightarrow q$ Norms

We study the problem of computing the $p\rightarrow q$ norm of a matrix $A \in R^{m \times n}$, defined as \[ \|A\|_{p\rightarrow q} ~:=~ \max_{x \,\in\, R^n \setminus \{0\}} \frac{\|Ax\|_q}{\|x\|_p} \] This problem generalizes the spectral norm of a matrix ($p=q=2$) and the Grothendieck problem ($p=\infty$, $q=1$), and has been widely studied in various regimes. When $p \geq q$, the problem exhibits a dichotomy: constant factor approximation algorithms are known if $2 \in [q,p]$, and the problem is hard to approximate within almost polynomial factors when $2 \notin [q,p]$. The regime when $p 2$ was studied by [Barak et al, STOC'12] who gave sub-exponential algorithms for a promise version of the problem (which captures small-set expansion) and also proved hardness of approximation results based on the Exponential Time Hypothesis. However, no NP-hardness of approximation is known for these problems for any $p < q$. We study the hardness of approximating matrix norms in both the above cases and prove the following results: - We show that for any $1< p < q < \infty$ with $2 \notin [p,q]$, $\|A\|_{p\rightarrow q}$ is hard to approximate within $2^{O(\log^{1-\epsilon}\!n)}$ assuming $NP \not\subseteq BPTIME(2^{\log^{O(1)}\!n})$. This suggests that, similar to the case of $p \geq q$, the hypercontractive setting may be qualitatively different when $2$ does not lie between $p$ and $q$. - For all $p \geq q$ with $2 \in [q,p]$, we show $\|A\|_{p\rightarrow q}$ is hard to approximate within any factor than $1/(\gamma_{p^*} \cdot \gamma_q)$, where for any $r$, $\gamma_r$ denotes the $r^{th}$ norm of a gaussian, and $p^*$ is the dual norm of $p$.

[1]  A. Grothendieck Résumé de la théorie métrique des produits tensoriels topologiques , 1996 .

[2]  Prasad Raghavendra,et al.  Bypassing UGC from Some Optimal Geometric Inapproximability Results , 2016, TALG.

[3]  Aram Wettroth Harrow,et al.  Estimating operator norms using covering nets , 2015, ArXiv.

[4]  Prasad Raghavendra,et al.  Graph expansion and the unique games conjecture , 2010, STOC '10.

[5]  Subhash Khot,et al.  Linear Equations Modulo 2 and the L1 Diameter of Convex Bodies , 2008, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[6]  Subhash Khot,et al.  SDP gaps and UGC-hardness for MAXCUTGAIN , 2006, IEEE Annual Symposium on Foundations of Computer Science.

[7]  Venkatesan Guruswami,et al.  Approximating Operator Norms via Generalized Krivine Rounding , 2018, Electron. Colloquium Comput. Complex..

[8]  Ashley Montanaro,et al.  Testing Product States, Quantum Merlin-Arthur Games and Tensor Optimization , 2010, JACM.

[9]  Guy Kindler,et al.  The UGC hardness threshold of the ℓp Grothendieck problem , 2008, SODA '08.

[10]  G. Schechtman More on embedding subspaces of $L_p$ in $l^n_r$ , 1987 .

[11]  P. V. Beek,et al.  An application of Fourier methods to the problem of sharpening the Berry-Esseen inequality , 1972 .

[12]  Yuan Zhou,et al.  Hypercontractivity, sum-of-squares proofs, and their applications , 2012, STOC '12.

[13]  Xiaodi Wu,et al.  Limitations of Semidefinite Programs for Separable States and Entangled Games , 2016, Communications in Mathematical Physics.

[14]  G. Biau,et al.  High-Dimensional \(p\)-Norms , 2013, 1311.0587.

[15]  Sidhanth Mohanty,et al.  On Sketching the q to p norms , 2018, APPROX-RANDOM.

[16]  Daureen Steinberg COMPUTATION OF MATRIX NORMS WITH APPLICATIONS TO ROBUST OPTIMIZATION , 2007 .

[17]  J. Wissel,et al.  On the Best Constants in the Khintchine Inequality , 2007 .

[18]  Noga Alon,et al.  A Fast and Simple Randomized Parallel Algorithm for the Maximal Independent Set Problem , 1985, J. Algorithms.

[19]  Piotr Indyk,et al.  Stable distributions, pseudorandom generators, embeddings, and data stream computation , 2006, JACM.

[20]  Prasad Raghavendra,et al.  Towards computing the Grothendieck constant , 2009, SODA.

[21]  Punyashloka Biswal,et al.  Hypercontractivity and its applications , 2011, ArXiv.

[22]  Subhash Khot,et al.  Grothendieck‐Type Inequalities in Combinatorial Optimization , 2011, ArXiv.

[23]  N. Alon,et al.  Quadratic forms on graphs , 2006 .

[24]  Subhash Khot,et al.  Hardness results for coloring 3-colorable 3-uniform hypergraphs , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[25]  G. Schechtman Two observations regarding embedding subsets of Euclidean spaces in normed spaces , 2006 .

[26]  Y. Nesterov Semidefinite relaxation and nonconvex quadratic optimization , 1998 .

[27]  G. Pisier Grothendieck's Theorem, past and present , 2011, 1101.4195.