On the Complexity and Approximation of $\lambda_\infty\,,$ Spread Constant and Maximum Variance Embedding

Twenty years ago, Bobkov, Houdr\'e, and the last author introduced a Poincar\'e-type functional graph parameter, $\lambda_\infty(G)$, of a graph $G$, and related it to the {\em vertex expansion} of $G$ via a Cheeger-type inequality. This is analogous to the Cheeger-type inequality relating the spectral gap, $\lambda_2(G)$, of the graph to its {\em edge expansion}. While $\lambda_2$ can be computed efficiently, the computational complexity of $\lambda_\infty$ has remained an open question. Following the work of the second author with Raghavendra and Vempala, wherein the complexity of $\lambda_\infty$ was related to the so-called Small-Set Expansion (SSE) problem, it has been believed that computing $\lambda_\infty$ is a hard problem. We settle this question by proving that computing $\lambda_\infty$ is indeed NP-hard. Additionally, we use our techniques to prove NP-hardness of computing the spread constant (of a graph), a geometric measure introduced by Alon, Boppana, and Spencer, in the context of deriving an asymptotic isoperimetric inequality on cartesian products of graphs. We complement our hardness results by providing approximation schemes for computing $\lambda_\infty$ and the spread constant of star graphs, and investigate constant approximability for weighted trees. Finally, we provide improved approximation results for the maximum variance embedding problem for general graphs, by replacing the optimal orthogonal projection (PCA) with a randomized projection approach.

[1]  Satish Rao,et al.  Expander flows, geometric embeddings and graph partitioning , 2004, STOC '04.

[2]  Stephen P. Boyd,et al.  Minimizing Effective Resistance of a Graph , 2008, SIAM Rev..

[3]  Silvio Lattanzi,et al.  Local Graph Clustering Beyond Cheeger's Inequality , 2013, 1304.8132.

[4]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[5]  Kilian Q. Weinberger,et al.  Learning a kernel matrix for nonlinear dimensionality reduction , 2004, ICML.

[6]  Le Song,et al.  Colored Maximum Variance Unfolding , 2007, NIPS.

[7]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[8]  N. Linial,et al.  Expander Graphs and their Applications , 2006 .

[9]  R. Merris Laplacian matrices of graphs: a survey , 1994 .

[10]  Prasad Raghavendra,et al.  Reductions between Expansion Problems , 2010, 2012 IEEE 27th Conference on Computational Complexity.

[11]  Miroslav Fiedler,et al.  Absolute algebraic connectivity of trees , 1990 .

[12]  Noga Alon,et al.  Eigenvalues and expanders , 1986, Comb..

[13]  Prasad Raghavendra,et al.  Graph expansion and the unique games conjecture , 2010, STOC '10.

[14]  John C. Platt,et al.  Fast Low-Rank Semidefinite Programming for Embedding and Clustering , 2007, AISTATS.

[15]  Fan Chung Graham,et al.  Isoperimetric Inequalities for Cartesian Products of Graphs , 1998, Comb. Probab. Comput..

[16]  Noga Alon,et al.  An Asymptotic Isoperimetric Inequality , 1998 .

[17]  Subhash Khot,et al.  Hardness of Approximation , 2016, ICALP.

[18]  Stephen P. Boyd,et al.  The Fastest Mixing Markov Process on a Graph and a Connection to a Maximum Variance Unfolding Problem , 2006, SIAM Rev..

[19]  N. Alon,et al.  il , , lsoperimetric Inequalities for Graphs , and Superconcentrators , 1985 .

[20]  George Giakkoupis,et al.  Rumor spreading and vertex expansion , 2012, SODA.

[21]  Oscar H. Ibarra,et al.  Fast Approximation Algorithms for the Knapsack and Sum of Subset Problems , 1975, JACM.

[22]  Mark Jerrum,et al.  Approximate Counting, Uniform Generation and Rapidly Mixing Markov Chains , 1987, WG.

[23]  Ravi Montenegro,et al.  Mathematical Aspects of Mixing Times in Markov Chains , 2006, Found. Trends Theor. Comput. Sci..

[24]  Miroslav Fiedler,et al.  Some minimax problems for graphs , 1993, Discret. Math..

[25]  Christoph Helmberg,et al.  Embedded in the Shadow of the Separator , 2008, SIAM J. Optim..

[26]  Kilian Q. Weinberger,et al.  An Introduction to Nonlinear Dimensionality Reduction by Maximum Variance Unfolding , 2006, AAAI.

[27]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[28]  Matemática,et al.  Society for Industrial and Applied Mathematics , 2010 .

[29]  J. Cheeger A lower bound for the smallest eigenvalue of the Laplacian , 1969 .

[30]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[31]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on a Graph , 2004, SIAM Rev..

[32]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[33]  Prasad Raghavendra,et al.  The Complexity of Approximating Vertex Expansion , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[34]  A. Naor Comparison of Metric Spectral Gaps , 2013, 1308.2851.

[35]  Chenzi Zhang,et al.  Spectral Properties of Hypergraph Laplacian and Approximation Algorithms , 2016, J. ACM.

[36]  P. Massart,et al.  Adaptive estimation of a quadratic functional by model selection , 2000 .

[37]  Derek G. Corneil,et al.  Complexity of finding embeddings in a k -tree , 1987 .

[38]  Renato D. C. Monteiro,et al.  A nonlinear programming algorithm for solving semidefinite programs via low-rank factorization , 2003, Math. Program..