Towards an SDP-based approach to spectral methods: a nearly-linear-time algorithm for graph partitioning and decomposition

In this paper, we consider the following graph partitioning problem: The input is an undirected graph <i>G</i> = (<i>V, E</i>), a balance parameter <i>b</i> ∈ (0, 1/2] and a target conductance value γ ∈ (0, 1). The output is a cut which, if non-empty, is of conductance at most <i>O</i>(<i>f</i>), for some function <i>f</i>(<i>G</i>, γ), and which is either balanced or well correlated with all cuts of conductance at most γ. In a seminal paper, Spielman and Teng [16] gave an <i>Õ</i>(|<i>E</i>|/γ<sup>2</sup>)-time algorithm for <i>f</i> = √γ log<sup>3</sup> |<i>V</i>| and used it to decompose graphs into a collection of near-expanders [18]. We present a new spectral algorithm for this problem which runs in time <i>Õ</i>(|<i>E</i>|/γ) for <i>f</i> = √γ. Our result yields the first nearly-linear time algorithm for the classic Balanced Separator problem that achieves the asymptotically optimal approximation guarantee for spectral methods. Our method has the advantage of being conceptually simple and relies on a primal-dual semidefinite-programming (SDP) approach. We first consider a natural SDP relaxation for the Balanced Separator problem. While it is easy to obtain from this SDP a certificate of the fact that the graph has no balanced cut of conductance less than γ, somewhat surprisingly, we can obtain a certificate for the stronger correlation condition. This is achieved via a novel separation oracle for our SDP and by appealing to Arora and Kale's [3] framework to bound the running time. Our result contains technical ingredients that may be of independent interest.

[1]  Satyen Kale Efficient algorithms using the multiplicative weights update method , 2007 .

[2]  Gary L. Miller,et al.  Approaching optimality for solving SDD systems , 2010, ArXiv.

[3]  D. Spielman Algorithms, Graph Theory, and Linear Equations in Laplacian Matrices , 2011 .

[4]  Luca Trevisan,et al.  Approximation algorithms for unique games , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[5]  Shang-Hua Teng,et al.  A Local Clustering Algorithm for Massive Graphs and Its Application to Nearly Linear Time Graph Partitioning , 2008, SIAM J. Comput..

[6]  Satish Rao,et al.  Expander flows, geometric embeddings and graph partitioning , 2004, STOC '04.

[7]  Miklós Simonovits,et al.  Random Walks in a Convex Body and an Improved Volume Algorithm , 1993, Random Struct. Algorithms.

[8]  Yuval Peres,et al.  Finding sparse cuts locally using evolving sets , 2008, STOC '09.

[9]  David Steurer,et al.  Fast SDP algorithms for constraint satisfaction problems , 2010, SODA '10.

[10]  Nikhil Srivastava,et al.  Graph sparsification by effective resistances , 2008, SIAM J. Comput..

[11]  Sanjeev Arora,et al.  A combinatorial, primal-dual approach to semidefinite programs , 2007, STOC.

[12]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[13]  Fan Chung Graham,et al.  Local Graph Partitioning using PageRank Vectors , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[14]  Gary L. Miller,et al.  Graph partitioning into isolated, high conductance clusters: theory, computation and applications to preconditioning , 2008, SPAA '08.

[15]  Shang-Hua Teng,et al.  Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems , 2003, STOC '04.

[16]  Clifford Stein,et al.  Approximation Algorithms for Semidefinite Packing Problems with Applications to Maxcut and Graph Coloring , 2005, IPCO.

[17]  Gary L. Miller,et al.  On the performance of spectral graph partitioning methods , 1995, SODA '95.

[18]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[19]  Santosh S. Vempala,et al.  On clusterings-good, bad and spectral , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[20]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[21]  Gary L. Miller,et al.  Approaching Optimality for Solving SDD Linear Systems , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.