Weighted Laplacian Method and Its Theoretical Applications

In this paper, we develop a novel weighted Laplacian method, which is partially inspired by the theory of graph Laplacian, to study recent popular graph problems, such as multilevel graph partitioning and balanced minimum cut problem, in a more convenient manner. Since the weighted Laplacian strategy inherits the virtues of spectral methods, graph algorithms designed using weighted Laplacian will necessarily possess more robust theoretical guarantees for algorithmic performances, comparing with those existing algorithms that are heuristically proposed. In order to illustrate its powerful utility both in theory and in practice, we also present two effective applications of our weighted Laplacian method to multilevel graph partitioning and balanced minimum cut problem, respectively. By means of variational methods and theory of partial differential equations (PDEs), we have established the equivalence relations among the weighted cut problem, balanced minimum cut problem and the initial clustering problem that arises in the middle stage of graph partitioning algorithms under a multilevel structure. These equivalence relations can indeed provide solid theoretical support for algorithms based on our proposed weighted Laplacian strategy. Moreover, from the perspective of the application to the balanced minimum cut problem, weighted Laplacian can make it possible for research of numerical solutions of PDEs to be a powerful tool for the algorithmic study of graph problems. Experimental results also indicate that the algorithm embedded with our strategy indeed outperforms other existing graph algorithms, especially in terms of accuracy, thus verifying the efficacy of the proposed weighted Laplacian.

[1]  Soon-Yeong Chung,et al.  Omega-Harmonic Functions and Inverse Conductivity Problems on Networks , 2005, SIAM J. Appl. Math..

[2]  Yousef Saad,et al.  Sampling and multilevel coarsening algorithms for fast matrix approximations , 2017, Numer. Linear Algebra Appl..

[3]  H. Wiener Structural determination of paraffin boiling points. , 1947, Journal of the American Chemical Society.

[4]  Feiping Nie,et al.  A Self-Balanced Min-Cut Algorithm for Image Clustering , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Peter Sanders,et al.  Advanced Coarsening Schemes for Graph Partitioning , 2012, ACM J. Exp. Algorithmics.

[6]  Abderrahim Elmoataz,et al.  On the p-Laplacian and ∞-Laplacian on Graphs with Applications in Image and Data Processing , 2015, SIAM J. Imaging Sci..

[7]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[8]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[9]  Francesco Bullo,et al.  Hitting time for doubly-weighted graphs with application to robotic surveillance , 2016, 2016 European Control Conference (ECC).

[10]  Chin-Teng Lin,et al.  A review of clustering techniques and developments , 2017, Neurocomputing.

[11]  Konstantin Andreev,et al.  Balanced Graph Partitioning , 2004, SPAA '04.

[12]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Fan Chung Graham,et al.  A Combinatorial Laplacian with Vertex Weights , 1996, J. Comb. Theory, Ser. A.

[15]  Berkant Barla Cambazoglu,et al.  Multi-level direct K-way hypergraph partitioning with multiple constraints and fixed vertices , 2008, J. Parallel Distributed Comput..

[16]  Andrew B. Kahng,et al.  New spectral methods for ratio cut partitioning and clustering , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[17]  Horst D. Simon,et al.  Fast multilevel implementation of recursive spectral bisection for partitioning unstructured problems , 1994, Concurr. Pract. Exp..

[18]  Silvia Sastre Gómez,et al.  Nonlocal diffusion problems , 2014 .

[19]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Adam M. Oberman Finite difference methods for the Infinity Laplace and p-Laplace equations , 2011, 1107.5278.

[21]  I. Dhillon,et al.  A Unified View of Kernel k-means , Spectral Clustering and Graph Cuts , 2004 .

[22]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[23]  Mark E. J. Newman,et al.  Community detection and graph partitioning , 2013, ArXiv.

[24]  Ruifang Liu,et al.  Weighted Graph Clustering for Community Detection of Large Social Networks , 2014, ITQM.

[25]  Xuelong Li,et al.  Balanced Clustering with Least Square Regression , 2017, AAAI.

[26]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[28]  Aurélien Esnard,et al.  A k-Way Greedy Graph Partitioning with Initial Fixed Vertices for Parallel Applications , 2016, 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP).

[29]  Peter Sanders,et al.  Think Locally, Act Globally: Highly Balanced Graph Partitioning , 2013, SEA.

[30]  Woong Kook,et al.  Harmonic cycles for graphs , 2019 .

[31]  Peter Sanders,et al.  Engineering a scalable high quality graph partitioner , 2009, 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS).

[32]  Xavier Bresson,et al.  Total Variation, Cheeger Cuts , 2010, ICML.

[33]  Kenneth M. Hall An r-Dimensional Quadratic Placement Algorithm , 1970 .

[34]  Pavel Drábek,et al.  The $p$-Laplacian – mascot of nonlinear analysis , 2007 .

[35]  Aurélien Esnard,et al.  Comparison of initial partitioning methods for multilevel direct k-way graph partitioning with fixed vertices , 2017, Parallel Comput..