Diffusion Operator and Spectral Analysis for Directed Hypergraph Laplacian

In spectral graph theory, the Cheeger's inequality gives upper and lower bounds of edge expansion in normal graphs in terms of the second eigenvalue of the graph's Laplacian operator. Recently this inequality has been extended to undirected hypergraphs and directed normal graphs via a non-linear operator associated with a diffusion process in the underlying graph. In this work, we develop a unifying framework for defining a diffusion operator on a directed hypergraph with stationary vertices, which is general enough for the following two applications. 1. Cheeger's inequality for directed hyperedge expansion. 2. Quadratic optimization with stationary vertices in the context of semi-supervised learning. Despite the crucial role of the diffusion process in spectral analysis, previous works have not formally established the existence of the corresponding diffusion processes. In this work, we give a proof framework that can indeed show that such diffusion processes are well-defined. In the first application, we use the spectral properties of the diffusion operator to achieve the Cheeger's inequality for directed hyperedge expansion. In the second application, the diffusion operator can be interpreted as giving a continuous analog to the subgradient method, which moves the feasible solution in discrete steps towards an optimal solution.

[1]  Richard Peng,et al.  Partitioning Well-Clustered Graphs: Spectral Clustering Works! , 2014, SIAM J. Comput..

[2]  Giorgio Gallo,et al.  Directed Hypergraphs and Applications , 1993, Discret. Appl. Math..

[3]  Naum Zuselevich Shor,et al.  Minimization Methods for Non-Differentiable Functions , 1985, Springer Series in Computational Mathematics.

[4]  Zhi-Li Zhang,et al.  Digraph Laplacian and the Degree of Asymmetry , 2012, Internet Math..

[5]  Sanjeev Arora,et al.  Subexponential Algorithms for Unique Games and Related Problems , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[6]  Yuichi Yoshida,et al.  Cheeger Inequalities for Submodular Transformations , 2017, SODA.

[7]  Olgica Milenkovic,et al.  Submodular Hypergraphs: p-Laplacians, Cheeger Inequalities and Spectral Clustering , 2018, ICML.

[8]  Prasad Raghavendra,et al.  Algorithmic Extensions of Cheeger's Inequality to Higher Eigenvalues and Partitions , 2011, APPROX-RANDOM.

[9]  Noga Alon,et al.  Eigenvalues and expanders , 1986, Comb..

[10]  Chenzi Zhang,et al.  Spectral Properties of Hypergraph Laplacian and Approximation Algorithms , 2016, J. ACM.

[11]  Yuichi Yoshida,et al.  Nonlinear Laplacian for Digraphs and its Applications to Network Analysis , 2016, WSDM.

[12]  Avi Wigderson,et al.  On the second eigenvalue of hypergraphs , 1995, Comb..

[13]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[14]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[15]  N. Alon,et al.  il , , lsoperimetric Inequalities for Graphs , and Superconcentrators , 1985 .

[16]  Yuichi Yoshida,et al.  Finding Cheeger Cuts in Hypergraphs via Heat Equation , 2018, Theor. Comput. Sci..

[17]  Bernhard Schölkopf,et al.  Learning with Hypergraphs: Clustering, Classification, and Embedding , 2006, NIPS.

[18]  Luca Trevisan,et al.  Improved Cheeger's inequality: analysis of spectral partitioning algorithms through higher order spectral gap , 2013, STOC '13.

[19]  Konstantin Makarychev,et al.  Approximation Algorithm for Sparsest k-Partitioning , 2013, SODA.

[20]  Aravindan Vijayaraghavan,et al.  Correlation Clustering with Noisy Partial Information , 2014, COLT.

[21]  N. Linial,et al.  Expander Graphs and their Applications , 2006 .

[22]  Chenzi Zhang,et al.  Re-revisiting Learning on Hypergraphs: Confidence Interval and Subgradient Method , 2017, ICML.

[23]  L. Qi,et al.  Spectral directed hypergraph theory via tensors , 2016 .

[24]  J. A. Rodŕıguez,et al.  Laplacian Eigenvalues and Partition Problems in Hypergraphs , 2004 .

[25]  Prasad Raghavendra,et al.  Many sparse cuts via higher eigenvalues , 2011, STOC '12.

[26]  Anand Louis,et al.  Hypergraph Markov Operators, Eigenvalues and Approximation Algorithms , 2014, STOC.

[27]  Fan Chung Graham The Laplacian of a Hypergraph , 1992, Expanding Graphs.

[28]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[29]  Luca Trevisan,et al.  Multi-way spectral partitioning and higher-order cheeger inequalities , 2011, STOC '12.

[30]  Matthias Hein,et al.  The Total Variation on Hypergraphs - Learning on Hypergraphs Revisited , 2013, NIPS.

[31]  Santosh S. Vempala,et al.  On clusterings-good, bad and spectral , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[32]  Juan Alberto Rodriguez Velazquez,et al.  Laplacian eigenvalues and partition problems in hypergraphs , 2004 .

[33]  Yin Tat Lee,et al.  Improved Cheeger's Inequality and Analysis of Local Graph Partitioning using Vertex Expansion and Expansion Profile , 2015, SIAM J. Comput..

[34]  Frank Bauer Normalized graph Laplacians for directed graphs , 2011 .