On the Quality of Spectral Separators

Computing graph separators is an important step in many graph algorithms. A popular technique for finding separators involves spectral methods. However, there has not been much prior analysis of the quality of the separators produced by this technique; instead it is usually claimed that spectral methods "work well in practice." We present an initial attempt at such an analysis. In particular, we consider two popular spectral separator algorithms and provide counterexamples showing that these algorithms perform poorly on certain graphs. We also consider a generalized definition of spectral methods that allows the use of some specified number of the eigenvectors corresponding to the smallest eigenvalues of the Laplacian matrix of a graph, and we show that if such algorithms use a constant number of eigenvectors, then there are graphs for which they do no better than using only the second smallest eigenvector. Furthermore, using the second smallest eigenvector of these graphs produces partitions that are poor with respect to bounds on the gap between the isoperimetric number and the cut quotient of the spectral separator. Even if a generalized spectral algorithm uses $n^\epsilon$ for \mbox{$0 < \epsilon < \frac{1}{4}$} eigenvectors, there exist graphs for which the algorithm fails to find a separator with a cut quotient within \mbox{$n^{\frac{1}{4} - \epsilon} - 1$} of the isoperimetric number. We also introduce some facts about the structure of eigenvectors of certain types of Laplacian and symmetric matrices; these facts provide the basis for the analysis of the counterexamples. Finally, we discuss some developments in spectral partitioning that have occurred since these results first appeared.

[1]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[2]  A. Hoffman,et al.  Lower bounds for the partitioning of graphs , 1973 .

[3]  Alex Pothen,et al.  PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS* , 1990 .

[4]  M. Fiedler A property of eigenvectors of nonnegative symmetric matrices and its application to graph theory , 1975 .

[5]  David S. Johnson,et al.  Some Simplified NP-Complete Graph Problems , 1976, Theor. Comput. Sci..

[6]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[7]  Michael Doob,et al.  Spectra of graphs , 1980 .

[8]  E. Barnes An algorithm for partitioning the nodes of a graph , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[9]  P. Flajolet On approximate counting , 1982 .

[10]  J. Gilbert,et al.  Graph Coloring Using Eigenvalue Decomposition , 1983 .

[11]  N. Alon,et al.  il , , lsoperimetric Inequalities for Graphs , and Superconcentrators , 1985 .

[12]  N. Alon Eigenvalues and expanders , 1986, Comb..

[13]  Ravi B. Boppana,et al.  Eigenvalues and graph bisection: An average-case analysis , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[14]  Mark Jerrum,et al.  Approximate Counting, Uniform Generation and Rapidly Mixing Markov Chains , 1987, WG.

[15]  Noga Alon,et al.  Better Expanders and Superconcentrators , 1987, J. Algorithms.

[16]  D. Young,et al.  A Survey of Numerical Mathematics , 1988 .

[17]  Milena Mihail,et al.  Conductance and convergence of Markov chains-a combinatorial treatment of expanders , 1989, 30th Annual Symposium on Foundations of Computer Science.

[18]  Bojan Mohar,et al.  Isoperimetric numbers of graphs , 1989, J. Comb. Theory, Ser. B.

[19]  B. Mohar THE LAPLACIAN SPECTRUM OF GRAPHS y , 1991 .

[20]  Gary L. Miller,et al.  A unified geometric approach to graph separators , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[21]  Horst D. Simon,et al.  Partitioning of unstructured problems for parallel processing , 1991 .

[22]  Andrew B. Kahng,et al.  New spectral methods for ratio cut partitioning and clustering , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[23]  Franz Rendl,et al.  A computational study of graph partitioning , 1994, Math. Program..

[24]  T. Chan,et al.  Geometric Spectral Partitioning , 1994 .

[25]  Gary L. Miller,et al.  Geometric mesh partitioning: implementation and experiments , 1995, Proceedings of 9th International Parallel Processing Symposium.

[26]  Gary L. Miller,et al.  On the performance of spectral graph partitioning methods , 1995, SODA '95.

[27]  Franz Rendl,et al.  A projection technique for partitioning the nodes of a graph , 1995, Ann. Oper. Res..

[28]  Shang-Hua Teng,et al.  Spectral partitioning works: planar graphs and finite element meshes , 1996, Proceedings of 37th Conference on Foundations of Computer Science.

[29]  Nabil Kahale,et al.  A semidefinite bound for mixing rates of Markov chains , 1996, Random Struct. Algorithms.