$K$-Graphs: An Algorithm for Graph Signal Clustering and Multiple Graph Learning

In graph signal processing (GSP), graph learning is concerned with the inference of an underlying graph best capable of modeling a dataset of graph signals. However, more complex datasets are derived from multiple underlying graphs. In such instances, it is necessary to learn multiple graph structures, each corresponding to the graph signals residing on the same structure. In other words, the graph signals need to be partitioned into a set of clusters, with a designated topology for each cluster. In this letter, inspired from classical <inline-formula><tex-math notation="LaTeX">$K$</tex-math></inline-formula>-means, a new algorithm for multiple graph learning, called <inline-formula><tex-math notation="LaTeX">$K$</tex-math></inline-formula>-graphs, is proposed. Numerical experiments demonstrate the high performance of this algorithm, in both graph learning and data clustering.

[1]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[2]  Pascal Frossard,et al.  Graph Laplacian Mixture Model , 2018, IEEE Transactions on Signal and Information Processing over Networks.

[3]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[4]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[5]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[6]  Bernhard Schölkopf,et al.  A Local Learning Approach for Clustering , 2006, NIPS.

[7]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[8]  Yi Yang,et al.  Image Clustering Using Local Discriminant Models and Global Integration , 2010, IEEE Transactions on Image Processing.

[9]  Kun Zhan,et al.  Graph Learning for Multiview Clustering , 2018, IEEE Transactions on Cybernetics.

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[13]  Feiping Nie,et al.  Multiview Consensus Graph Clustering , 2019, IEEE Transactions on Image Processing.

[14]  Pierre Vandergheynst,et al.  GSPBOX: A toolbox for signal processing on graphs , 2014, ArXiv.

[15]  Pascal Frossard,et al.  Graph learning under sparsity priors , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Santiago Segarra,et al.  Network Topology Inference from Spectral Templates , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[17]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Pascal Frossard,et al.  Learning Graphs From Data: A Signal Representation Perspective , 2018, IEEE Signal Processing Magazine.

[19]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[20]  Joshua B. Tenenbaum,et al.  Discovering Structure by Learning Sparse Graphs , 2010 .

[21]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .