Learning graphs with monotone topology properties

Learning graphs with topology properties is a non-convex optimization problem. We propose a tractable algorithm that finds the generalized Laplacian matrix of a graph with the desired type of topology. Given the covariance/similarity matrix, our algorithm first solves a combinatorial optimization problem to find a graph topology that satisfies the desired structural property, and second, it estimates a generalized Laplacian matrix by solving a sparsity constrained Log-Determinant divergence minimization problem. The proposed method is guaranteed to find a near optimal generalized Laplacian matrix if the graph family is monotone, i.e. it is closed under edge removal operations. We derive an specific instance of our algorithm to learn bipartite graphs and we evaluate the performance of our graph learning method via numerical experiments with synthetic and image data.

[1]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[2]  Inderjit S. Dhillon,et al.  Matrix Nearness Problems with Bregman Divergences , 2007, SIAM J. Matrix Anal. Appl..

[3]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[5]  Mihailo R. Jovanovic,et al.  Topology identification of undirected consensus networks via sparse inverse covariance estimation , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[6]  Eduardo Pavez,et al.  Learning Graphs With Monotone Topology Properties and Multiple Connected Components , 2017, IEEE Transactions on Signal Processing.

[7]  Pierre Borgnat,et al.  Subgraph-Based Filterbanks for Graph Signals , 2015, IEEE Transactions on Signal Processing.

[8]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[9]  P. P. Vaidyanathan,et al.  Extending Classical Multirate Signal Processing Theory to Graphs—Part I: Fundamentals , 2017, IEEE Transactions on Signal Processing.

[10]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[11]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[12]  Antonio Ortega,et al.  Transform-Based Distributed Data Gathering , 2009, IEEE Transactions on Signal Processing.

[13]  C. N. Liu,et al.  Approximating discrete probability distributions with dependence trees , 1968, IEEE Trans. Inf. Theory.

[14]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[15]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[16]  Pradeep Ravikumar,et al.  A Divide-and-Conquer Method for Sparse Inverse Covariance Estimation , 2012, NIPS.

[17]  Antonio Ortega,et al.  Generalized Laplacian precision matrix estimation for graph signal processing , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[19]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[20]  Charles R. Johnson Inverse M-matrices☆ , 1982 .

[21]  Po-Ling Loh,et al.  Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses , 2012, NIPS.

[22]  Ronald R. Coifman,et al.  Multiscale Wavelets on Trees, Graphs and High Dimensional Data: Theory and Applications to Semi Supervised Learning , 2010, ICML.

[23]  Antonio Ortega,et al.  Graph Learning From Data Under Laplacian and Structural Constraints , 2016, IEEE Journal of Selected Topics in Signal Processing.

[24]  Peter F. Stadler,et al.  Laplacian Eigenvectors of Graphs , 2007 .

[25]  Vincent Y. F. Tan,et al.  Learning Gaussian Tree Models: Analysis of Error Exponents and Extremal Structures , 2009, IEEE Transactions on Signal Processing.

[26]  Antonio Ortega,et al.  GTT: Graph template transforms with applications to image coding , 2015, 2015 Picture Coding Symposium (PCS).

[27]  Jieping Ye,et al.  Structural Graphical Lasso for Learning Mouse Brain Connectivity , 2015, KDD.

[28]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[29]  Shahin Shahrampour,et al.  Topology Identification of Directed Dynamical Networks via Power Spectral Analysis , 2013, IEEE Transactions on Automatic Control.