Characterization and Inference of Graph Diffusion Processes From Observations of Stationary Signals

Many tools from the field of graph signal processing exploit knowledge of the underlying graph's structure (e.g., as encoded in the Laplacian matrix) to process signals on the graph. Therefore, in the case when no graph is available, graph signal processing tools cannot be used anymore. Researchers have proposed approaches to infer a graph topology from observations of signals on its vertices. Since the problem is ill-posed, these approaches make assumptions, such as smoothness of the signals on the graph, or sparsity priors. In this paper, we propose a characterization of the space of valid graphs, in the sense that they can explain stationary signals. To simplify the exposition in this paper, we focus here on the case where signals were i.i.d. at some point back in time and were observed after diffusion on a graph. We show that the set of graphs verifying this assumption has a strong connection with the eigenvectors of the covariance matrix, and forms a convex set. Along with a theoretical study in which these eigenvectors are assumed to be known, we consider the practical case when the observations are noisy, and experimentally observe how fast the set of valid graphs converges to the set obtained when the exact eigenvectors are known, as the number of observations grows. To illustrate how this characterization can be used for graph recovery, we present two methods for selecting a particular point in this set under chosen criteria, namely graph simplicity and sparsity. Additionally, we introduce a measure to evaluate how much a graph is adapted to signals under a stationarity assumption. Finally, we evaluate how state-of-the-art methods relate to this framework through experiments on a dataset of temperatures.

[1]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[2]  D. Lawley TESTS OF SIGNIFICANCE FOR THE LATENT ROOTS OF COVARIANCE AND CORRELATION MATRICES , 1956 .

[3]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[4]  Santiago Segarra,et al.  Network topology inference from non-stationary graph signals , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Antonio Ortega,et al.  Generalized Laplacian precision matrix estimation for graph signal processing , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Santiago Segarra,et al.  Network Topology Inference from Spectral Templates , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[7]  Santiago Segarra,et al.  Network topology identification from spectral templates , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[8]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[9]  Antonio Ortega,et al.  Graph Learning from Data under Structural and Laplacian Constraints , 2016, ArXiv.

[10]  Vincent Gripon,et al.  Graph reconstruction from the observation of diffused signals , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[12]  Alexander S Mikhailov,et al.  Evolutionary reconstruction of networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Weidong Liu,et al.  Adaptive Thresholding for Sparse Covariance Matrix Estimation , 2011, 1102.2237.

[14]  T. W. Anderson ASYMPTOTIC THEORY FOR PRINCIPAL COMPONENT ANALYSIS , 1963 .

[15]  José M. F. Moura,et al.  Signal processing on graphs: Estimating the structure of a graph , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Santiago Segarra,et al.  Robust network topology inference , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Michael G. Rabbat Inferring sparse graphs from smooth signals with theoretical guarantees , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[19]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Pierre Vandergheynst,et al.  Stationary Signal Processing on Graphs , 2016, IEEE Transactions on Signal Processing.

[21]  Georgios B. Giannakis,et al.  Topology inference of directed graphs using nonlinear structural vector autoregressive models , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Pascal Frossard,et al.  Learning Heat Diffusion Graphs , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[23]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[24]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[25]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[26]  Shahin Shahrampour,et al.  Topology Identification of Directed Dynamical Networks via Power Spectral Analysis , 2013, IEEE Transactions on Automatic Control.

[27]  J. Friedman,et al.  New Insights and Faster Computations for the Graphical Lasso , 2011 .

[28]  M. A. Girshick On the Sampling Theory of Roots of Determinantal Equations , 1939 .

[29]  Pascal Frossard,et al.  Graph learning under sparsity priors , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  N. Wermuth Analogies between Multiplicative Models in Contingency Tables and Covariance Selection , 1976 .

[31]  Shiliang Sun,et al.  Network-Scale Traffic Modeling and Forecasting with Graphical Lasso and Neural Networks , 2012 .

[32]  Pierre Vandergheynst,et al.  GSPBOX: A toolbox for signal processing on graphs , 2014, ArXiv.

[33]  Maziar Nekovee,et al.  Worm epidemics in wireless ad hoc networks , 2007, ArXiv.

[34]  Jing Li,et al.  Learning Brain Connectivity of Alzheimer's Disease from Neuroimaging Data , 2009, NIPS.

[35]  Nicolas Tremblay Réseaux et signal : des outils de traitement du signal pour l'analyse des réseaux , 2014 .

[36]  Sergio Barbarossa,et al.  Graph topology inference based on transform learning , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[37]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[38]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[39]  Adam J. Rothman,et al.  Sparse permutation invariant covariance estimation , 2008, 0801.4837.

[40]  Benjamin Girault Signal Processing on Graphs - Contributions to an Emerging Field. (Traitement du signal sur graphes - Contributions à un domaine émergent) , 2015 .

[41]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[42]  Han Xiao,et al.  Covariance matrix estimation for stationary time series , 2011, 1105.4563.

[43]  Harrison H. Zhou,et al.  OPTIMAL RATES OF CONVERGENCE FOR SPARSE COVARIANCE MATRIX ESTIMATION , 2012, 1302.3030.

[44]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[45]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[46]  Alfred O. Hero,et al.  Learning sparse graphs under smoothness prior , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[48]  Trevor J. Hastie,et al.  Exact Covariance Thresholding into Connected Components for Large-Scale Graphical Lasso , 2011, J. Mach. Learn. Res..

[49]  Ali Shojaie,et al.  The cluster graphical lasso for improved estimation of Gaussian graphical models , 2013, Comput. Stat. Data Anal..

[50]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[51]  P. Bickel,et al.  Covariance regularization by thresholding , 2009, 0901.3079.

[52]  M. Pourahmadi,et al.  BANDING SAMPLE AUTOCOVARIANCE MATRICES OF STATIONARY PROCESSES , 2009 .

[53]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[54]  Tony Jebara,et al.  Laplacian Spectrum Learning , 2010, ECML/PKDD.

[55]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[56]  Santiago Segarra,et al.  Stationary Graph Processes and Spectral Estimation , 2016, IEEE Transactions on Signal Processing.

[57]  Trevor J. Hastie,et al.  The Graphical Lasso: New Insights and Alternatives , 2011, Electronic journal of statistics.

[58]  Jieping Ye,et al.  Structural Graphical Lasso for Learning Mouse Brain Connectivity , 2015, KDD.

[59]  Joshua B. Tenenbaum,et al.  Discovering Structure by Learning Sparse Graphs , 2010 .

[60]  Benjamin Girault Stationary graph signals using an isometric graph translation , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[61]  Jonas Richiardi,et al.  Graph analysis of functional brain networks: practical issues in translational neuroscience , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[62]  Shahin Shahrampour,et al.  Reconstruction of directed networks from consensus dynamics , 2013, 2013 American Control Conference.