Characterization and inference of weighted graph topologies from observations of diffused signals

In the field of signal processing on graphs, a key tool to process signals is the graph Fourier transform. Transforming signals into the spectral domain is accomplished using the basis of eigenvectors of the graph Laplacian matrix. Such a matrix is dependent on the topology of the graph on which the signals are defined. Therefore it is of paramount importance to have a graph available. We consider the problem of inferring the graph topology from observations of signals. In this article we model the observations as being measured after a few steps of diffusing signals that are initially mutually independent and have independent entries. We propose a way to characterize and recover the possible graphs used for this diffusion. We show that the space of feasible matrices on which mutually independent signals can have evolved, based on the observations, is a convex polytope, and we propose two strategies to choose a point in this space as the topology estimate. These strategies enforce the selection of graphs that are, respectively, simple or sparse. Both methods can be formulated as linear programs and hence solved efficiently. Experiments suggest that in the ideal case when we are able to retrieve the exact covariance matrix of the signal, we are able to recover the graph on which the signals were diffused, with no error. We also apply our method to a synthetic case in which a limited number of signals are obtained by diffusion on a known graph, and show that we are able to recover a graph that is very close to the ground truth one, with an error decreasing as the number of observations increases. Finally, we illustrate our method on audio signals, and show that we are able to recover a graph that is globally one-dimensional.

[1]  J. Friedman,et al.  New Insights and Faster Computations for the Graphical Lasso , 2011 .

[2]  M. A. Girshick On the Sampling Theory of Roots of Determinantal Equations , 1939 .

[3]  Santiago Segarra,et al.  Network topology inference from non-stationary graph signals , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[5]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[6]  José M. F. Moura,et al.  Signal processing on graphs: Estimating the structure of a graph , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Alexander S Mikhailov,et al.  Evolutionary reconstruction of networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Weidong Liu,et al.  Adaptive Thresholding for Sparse Covariance Matrix Estimation , 2011, 1102.2237.

[9]  Santiago Segarra,et al.  Network Topology Inference from Spectral Templates , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[10]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[11]  Vincent Gripon,et al.  Graph reconstruction from the observation of diffused signals , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[13]  Harrison H. Zhou,et al.  OPTIMAL RATES OF CONVERGENCE FOR SPARSE COVARIANCE MATRIX ESTIMATION , 2012, 1302.3030.

[14]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[15]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[16]  Antonio Ortega,et al.  Graph Learning from Data under Structural and Laplacian Constraints , 2016, ArXiv.

[17]  Pierre Vandergheynst,et al.  Stationary Signal Processing on Graphs , 2016, IEEE Transactions on Signal Processing.

[18]  Alfred O. Hero,et al.  Learning sparse graphs under smoothness prior , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Shahin Shahrampour,et al.  Reconstruction of directed networks from consensus dynamics , 2013, 2013 American Control Conference.

[20]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[21]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[22]  Jing Li,et al.  Learning Brain Connectivity of Alzheimer's Disease from Neuroimaging Data , 2009, NIPS.

[23]  Nicolas Tremblay Réseaux et signal : des outils de traitement du signal pour l'analyse des réseaux , 2014 .

[24]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[25]  Trevor J. Hastie,et al.  Exact Covariance Thresholding into Connected Components for Large-Scale Graphical Lasso , 2011, J. Mach. Learn. Res..

[26]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[27]  Ali Shojaie,et al.  The cluster graphical lasso for improved estimation of Gaussian graphical models , 2013, Comput. Stat. Data Anal..

[28]  Adam J. Rothman,et al.  Sparse permutation invariant covariance estimation , 2008, 0801.4837.

[29]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[30]  Sergio Barbarossa,et al.  Graph topology inference based on transform learning , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[31]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[32]  Pascal Frossard,et al.  Graph learning under sparsity priors , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  G. Dantzig Origins of the simplex method , 1990 .

[34]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[35]  Tony Jebara,et al.  Laplacian Spectrum Learning , 2010, ECML/PKDD.

[36]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[37]  Trevor J. Hastie,et al.  The Graphical Lasso: New Insights and Alternatives , 2011, Electronic journal of statistics.

[38]  Han Xiao,et al.  Covariance matrix estimation for stationary time series , 2011, 1105.4563.

[39]  Jieping Ye,et al.  Structural Graphical Lasso for Learning Mouse Brain Connectivity , 2015, KDD.

[40]  Jonas Richiardi,et al.  Graph analysis of functional brain networks: practical issues in translational neuroscience , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  Pascal Frossard,et al.  Learning Heat Diffusion Graphs , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[42]  Antonio Ortega,et al.  Generalized Laplacian precision matrix estimation for graph signal processing , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[43]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[44]  Shiliang Sun,et al.  Network-Scale Traffic Modeling and Forecasting with Graphical Lasso and Neural Networks , 2012 .

[45]  Maziar Nekovee,et al.  Worm epidemics in wireless ad hoc networks , 2007, ArXiv.

[46]  Michael G. Rabbat Inferring sparse graphs from smooth signals with theoretical guarantees , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .