Kernel-Based Reconstruction of Space-Time Functions on Dynamic Graphs

Graph-based methods pervade the inference toolkits of numerous disciplines including sociology, biology, neuroscience, physics, chemistry, and engineering. A challenging problem encountered in this context pertains to determining the attributes of a set of vertices given those of another subset at possibly diffe-rent time instants. Leveraging spatiotemporal dynamics can drastically reduce the number of observed vertices, and hence the sampling cost. Alleviating the limited flexibility of the existing approaches, the present paper broadens the kernel-based graph function estimation framework to reconstruct time-evolving functions over possibly time-evolving topologies. This approach inherits the versatility and generality of kernel-based methods, for which no knowledge on distributions or second-order statistics is required. Systematic guidelines are provided to construct two families of space-time kernels with complementary strengths: the first facilitates judicious control of regularization on a space-time frequency plane, whereas the second accommodates time-varying topologies. Batch and online estimators are also put forth. The latter comprise a novel kernel Kalman filter, developed to reconstruct space-time functions at affordable computational cost. Numerical tests with real datasets corroborate the merits of the proposed methods relative to competing alternatives.

[1]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[2]  Yuantao Gu,et al.  A Distributed Tracking Algorithm for Reconstruction of Graph Signals , 2015, IEEE Journal of Selected Topics in Signal Processing.

[3]  Georgios B. Giannakis,et al.  Dynamic Network Delay Cartography , 2012, IEEE Transactions on Information Theory.

[4]  Larry A. Wasserman,et al.  Statistical Analysis of Semi-Supervised Regression , 2007, NIPS.

[5]  Yoshihiro Yamanishi,et al.  On Pairwise Kernels: An Efficient Alternative and Generalization Analysis , 2009, PAKDD.

[6]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data , 2009 .

[7]  Georgios B. Giannakis,et al.  Electricity Market Forecasting via Low-Rank Multi-Kernel Learning , 2013, IEEE Journal of Selected Topics in Signal Processing.

[8]  L. Ralaivola,et al.  Time series filtering, smoothing and learning using the kernel Kalman filter , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[9]  Risi Kondor,et al.  Diffusion kernels on graphs and other discrete structures , 2002, ICML 2002.

[10]  B. Schölkopf,et al.  A Regularization Framework for Learning from Graph Data , 2004, ICML 2004.

[11]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[12]  G. Strang,et al.  Linear Algebra, Geodesy, and GPS , 1997 .

[13]  Geert Leus,et al.  Separable autoregressive moving average graph-temporal filters , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[14]  Pengfei Liu,et al.  Local-Set-Based Graph Signal Reconstruction , 2014, IEEE Transactions on Signal Processing.

[15]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[16]  José M. F. Moura,et al.  Signal Processing on Graphs: Causal Modeling of Unstructured Data , 2015, IEEE Transactions on Signal Processing.

[17]  J. S. Meditch,et al.  Estimation Theory , 1977, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[18]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[19]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[20]  G. Giannakis,et al.  Nonlinear Structural Vector Autoregressive Models for Inferring Effective Brain Network Connectivity , 2016, 1610.06551.

[21]  P. M. Weichsel THE KRONECKER PRODUCT OF GRAPHS , 1962 .

[22]  Jason Weston,et al.  Transductive Inference for Estimating Values of Functions , 1999, NIPS.

[23]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[24]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[25]  Badong Chen,et al.  Learning Nonlinear Generative Models of Time Series With a Kalman Filter in RKHS , 2014, IEEE Transactions on Signal Processing.

[26]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[27]  Jose M. F. Moura,et al.  Signal Processing on Graphs: Causal Modeling of Big Data , 2015 .

[28]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .

[29]  Eric Fleury,et al.  A unifying model for representing time-varying graphs , 2014, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[30]  Antonio Ortega,et al.  Submitted to Ieee Transactions on Signal Processing 1 Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies , 2022 .

[31]  Mehryar Mohri,et al.  On Transductive Regression , 2006, NIPS.

[32]  M. Kramer,et al.  Emergent network topology at seizure onset in humans , 2008, Epilepsy Research.

[33]  Michael I. Jordan,et al.  Learning graphical models for stationary time series , 2004, IEEE Transactions on Signal Processing.

[34]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[35]  Georgios B. Giannakis,et al.  Prediction of Partially Observed Dynamical Processes Over Networks via Dictionary Learning , 2014, IEEE Transactions on Signal Processing.

[36]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[37]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[38]  Sergio Barbarossa,et al.  Adaptive Least Mean Squares Estimation of Graph Signals , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[39]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.