Graph Laplacian Mixture Model

Graph learning methods have recently been receiving increasing interest as means to infer structure in datasets. Most of the recent approaches focus on different relationships between a graph and data sample distributions, mostly in settings where all available data relate to the same graph. This is, however, not always the case, as data is often available in mixed form, yielding the need for methods that are able to cope with mixture data and learn multiple graphs. We propose a novel generative model that represents a collection of distinct data which naturally live on different graphs. We assume the mapping of data to graphs is not known and investigate the problem of jointly clustering a set of data and learning a graph for each of the clusters. Experiments demonstrate promising performance in data clustering and multiple graph inference, and show desirable properties in terms of interpretability and coping with high dimensionality on weather and traffic data, as well as digit classification.

[1]  Ernst Wit,et al.  High dimensional Sparse Gaussian Graphical Mixture Model , 2013, ArXiv.

[2]  Benjamin Girault Signal Processing on Graphs - Contributions to an Emerging Field. (Traitement du signal sur graphes - Contributions à un domaine émergent) , 2015 .

[3]  Patrick Danaher,et al.  The joint graphical lasso for inverse covariance estimation across multiple classes , 2011, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[4]  Santiago Segarra,et al.  Connecting the Dots: Identifying Network Structure via Graph Signal Processing , 2018, IEEE Signal Processing Magazine.

[5]  Nathanael Perraudin,et al.  Large Scale Graph Learning from Smooth Signals , 2017, ICLR.

[6]  Lingrui Gan,et al.  Bayesian Joint Estimation of Multiple Graphical Models , 2019, NeurIPS.

[7]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[8]  Antonio Ortega,et al.  Graph Learning From Data Under Laplacian and Structural Constraints , 2016, IEEE Journal of Selected Topics in Signal Processing.

[9]  Santiago Segarra,et al.  Joint inference of networks from stationary graph signals , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[10]  Sergio Barbarossa,et al.  Graph Topology Inference Based on Sparsifying Transform Learning , 2018, IEEE Transactions on Signal Processing.

[11]  Antonio Ortega,et al.  Time-varying Graph Learning Based on Sparseness of Temporal Variation , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Sergio Barbarossa,et al.  Enabling Prediction via Multi-Layer Graph Inference and Sampling , 2019, 2019 13th International conference on Sampling Theory and Applications (SampTA).

[13]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[14]  Pascal Frossard,et al.  Learning Heat Diffusion Graphs , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[15]  Guang Cheng,et al.  Simultaneous Clustering and Estimation of Heterogeneous Graphical Models , 2016, J. Mach. Learn. Res..

[16]  Antonio Ortega,et al.  Disc-GLasso: Discriminative graph learning with sparsity regularization , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[18]  Pascal Frossard,et al.  Graph learning under sparsity priors , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Eduardo Pavez,et al.  Learning Graphs With Monotone Topology Properties and Multiple Connected Components , 2017, IEEE Transactions on Signal Processing.

[20]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[21]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[22]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[23]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[24]  Pascal Frossard,et al.  Graph Heat Mixture Model Learning , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[25]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[26]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[27]  Pascal Frossard,et al.  Learning Graphs From Data: A Signal Representation Perspective , 2018, IEEE Signal Processing Magazine.

[28]  Pascal Frossard,et al.  Learning time varying graphs , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Michael G. Rabbat,et al.  Characterization and Inference of Graph Diffusion Processes From Observations of Stationary Signals , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[30]  Antonio Ortega,et al.  ON LEARNING LAPLACIANS OF TREE STRUCTURED GRAPHS , 2018, 2018 IEEE Data Science Workshop (DSW).

[31]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[32]  Santiago Segarra,et al.  Network Topology Inference from Spectral Templates , 2016, IEEE Transactions on Signal and Information Processing over Networks.