Graph Learning for Spatiotemporal Signal with Long Short-Term Characterization

Mining natural associations from high-dimensional spatiotemporal signals have received significant attention in various fields including biology, climatology and financial analysis, etcetera. Due to the widespread correlation in diverse applications, ideas that taking full advantage of correlated property to find meaningful insights of spatiotemporal signals have begun to emerge. In this paper, we study the problem of uncovering graphs that better reveal the relations behind data, with the help of long and short term correlated property in spatiotemporal signals. A spatiotemporal signal model considering both spatial and temporal relationship is firstly presented. Particularly, a low-rank representation together with a Gaussian Markov process is adopted to describe the signals' time-correlated behavior. Next, we cast the graph learning problem as a joint low-rank component estimation and graph Laplacian inference problem. A Low-Rank and Spatiotemporal Smoothness-based graph learning method (GL-LRSS) is proposed, which novelly introduces spatiotemporal smooth prior to the field of time-vertex signal analysis. Through jointly exploiting the low-rank property of long-time observations and the smoothness of short-time observations, the overall performance is effectively improved. Experiments on both synthetic and real-world datasets demonstrate the significant improvement on learning accuracy of the proposed GL-LRSS over current state-of-the-art low-rank estimation and graph learning methods.

[1]  Santiago Segarra,et al.  Network Topology Inference from Spectral Templates , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[2]  Pascal Frossard,et al.  Learning time varying graphs , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Antonio Ortega,et al.  Graph Learning from Data under Structural and Laplacian Constraints , 2016, ArXiv.

[4]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[5]  Pascal Frossard,et al.  Learning Heat Diffusion Graphs , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[6]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[7]  A. R. McIntosh,et al.  Spatiotemporal analysis of event-related fMRI data using partial least squares , 2004, NeuroImage.

[8]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[9]  Alfred O. Hero,et al.  Learning sparse graphs under smoothness prior , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Junzhou Huang,et al.  A spatio-temporal low-rank total variation approach for denoising arterial spin labeling MRI data , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[11]  Michael G. Rabbat,et al.  Approximating signals supported on graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Ngai-Man Cheung,et al.  Simultaneous low-rank component and graph estimation for high-dimensional graph signals: Application to brain imaging , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  José M. F. Moura,et al.  Signal Processing on Graphs: Causal Modeling of Unstructured Data , 2015, IEEE Transactions on Signal Processing.

[14]  Yan Liu,et al.  EBM: an entropy-based model to infer social strength from spatiotemporal data , 2013, SIGMOD '13.

[15]  Jin Tang,et al.  Graph-Laplacian PCA: Closed-Form Solution and Robustness , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[17]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[18]  Nathanael Perraudin,et al.  Fast Robust PCA on Graphs , 2015, IEEE Journal of Selected Topics in Signal Processing.

[19]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[20]  Georgios B. Giannakis,et al.  Tracking Switched Dynamic Network Topologies From Information Cascades , 2016, IEEE Transactions on Signal Processing.

[21]  Yun Fu,et al.  Temporal Subspace Clustering for Human Motion Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Yuantao Gu,et al.  Time-Varying Graph Signal Reconstruction , 2017, IEEE Journal of Selected Topics in Signal Processing.

[23]  N. Eckert,et al.  A spatio-temporal modelling framework for assessing the fluctuations of avalanche occurrence resulting from climate change: application to 60 years of data in the northern French Alps , 2010 .

[24]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[25]  Yuantao Gu,et al.  Spatio-Temporal Signal Recovery Based on Low Rank and Differential Smoothness , 2018, IEEE Transactions on Signal Processing.

[26]  Santiago Segarra,et al.  Identifying Undirected Network Structure via Semidefinite Relaxation , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Joshua B. Tenenbaum,et al.  Discovering Structure by Learning Sparse Graphs , 2010 .

[28]  Michael G. Rabbat,et al.  Characterization and Inference of Graph Diffusion Processes From Observations of Stationary Signals , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[29]  José M. F. Moura,et al.  Discrete signal processing on graphs: Graph filters , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Antonio Ortega,et al.  Spectral anomaly detection using graph-based filtering for wireless sensor networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Andreas Loukas,et al.  A Time-Vertex Signal Processing Framework: Scalable Processing and Meaningful Representations for Time-Series on Graphs , 2017, IEEE Transactions on Signal Processing.

[32]  Michael G. Rabbat Inferring sparse graphs from smooth signals with theoretical guarantees , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Georgios B. Giannakis,et al.  Topology inference of directed graphs using nonlinear structural vector autoregressive models , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[35]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[36]  Xavier Bresson,et al.  Robust Principal Component Analysis on Graphs , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[38]  Trevor J. Hastie,et al.  Exact Covariance Thresholding into Connected Components for Large-Scale Graphical Lasso , 2011, J. Mach. Learn. Res..

[39]  Noel A Cressie,et al.  Statistics for Spatio-Temporal Data , 2011 .

[40]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[41]  Junbin Gao,et al.  Correlated Spatio-Temporal Data Collection in Wireless Sensor Networks Based on Low Rank Matrix Approximation and Optimized Node Sampling , 2014, Sensors.

[42]  Michael G. Strintzis,et al.  Spatiotemporal segmentation and tracking of objects for visualization of videoconference image sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[43]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[44]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[45]  Antonio Ortega,et al.  Time-varying Graph Learning Based on Sparseness of Temporal Variation , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Wenbo Wang,et al.  Graph Learning Based on Spatiotemporal Smoothness for Time-Varying Graph Signal , 2019, IEEE Access.