Piecewise Stationary Modeling of Random Processes Over Graphs With an Application to Traffic Prediction

Stationarity is a key assumption in many statistical models for random processes. With recent developments in the field of graph signal processing, the conventional notion of wide-sense stationarity has been extended to random processes defined on the vertices of graphs. It has been shown that well-known spectral graph kernel methods assume that the underlying random process over a graph is stationary. While many approaches have been proposed, both in machine learning and signal processing literature, to model stationary random processes over graphs, they are too restrictive to characterize real-world datasets as most of them are non-stationary processes. In this paper, to well-characterize a non-stationary process over graph, we propose a novel model and a computationally efficient algorithm that partitions a large graph into disjoint clusters such that the process is stationary on each of the clusters but independent across clusters. We evaluate our model for traffic prediction on a large-scale dataset of fine-grained highway travel times in the Dallas-Fort Worth area. The accuracy of our method is very close to the state-of-the-art graph based deep learning methods while the computational complexity of our model is substantially smaller.

[1]  R. Shumway,et al.  Detecting Abrupt Changes in a Piecewise Locally Stationary Time Series. , 2008, Journal of multivariate analysis.

[2]  Ulrich Appel,et al.  Adaptive sequential segmentation of piecewise stationary time series , 1983, Inf. Sci..

[3]  Andreas Loukas,et al.  Predicting the evolution of stationary graph signals , 2016, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[4]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .

[5]  Geert Leus,et al.  Filter Design for Autoregressive Moving Average Graph Filters , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[6]  I. S. Gradshteyn,et al.  MATRICES AND RELATED RESULTS , 1980 .

[7]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[8]  James Bailey,et al.  Time Series Forecasting Using Distribution Enhanced Linear Regression , 2013, PAKDD.

[9]  K. Chan,et al.  Testing for threshold autoregression , 1990 .

[10]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[11]  H. Tong,et al.  ON ESTIMATING THRESHOLDS IN AUTOREGRESSIVE MODELS , 1986 .

[12]  Charles R. Johnson,et al.  Characterization of supercommuting matrices , 1997 .

[13]  Richard A. Berk,et al.  Applied Time Series Analysis for the Social Sciences , 1980 .

[14]  B. Mallick,et al.  Analyzing Nonstationary Spatial Data Using Piecewise Gaussian Processes , 2005 .

[15]  Jérôme Kunegis,et al.  Learning spectral graph transformations for link prediction , 2009, ICML '09.

[16]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[17]  Zoubin Ghahramani,et al.  Nonparametric Transforms of Graph Kernels for Semi-Supervised Learning , 2004, NIPS.

[18]  José M. F. Moura,et al.  New York city taxi analysis with graph signal processing , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[19]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[20]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[21]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[22]  Huachun Tan,et al.  Short-term traffic flow forecasting with spatial-temporal correlation in a hybrid deep learning framework , 2016, ArXiv.

[23]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[24]  Pierre Vandergheynst,et al.  Stationary Signal Processing on Graphs , 2016, IEEE Transactions on Signal Processing.

[25]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[26]  Muhammad Tayyab Asif,et al.  Wavelets on graphs with application to transportation networks , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[27]  Daniel B. Fambro,et al.  Application of Subset Autoregressive Integrated Moving Average Model for Short-Term Freeway Traffic Volume Forecasting , 1999 .

[28]  Ugur Demiryurek,et al.  Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting , 2017, SDM.

[29]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[30]  Anthony K. H. Tung,et al.  SMiLer: A Semi-Lazy Time Series Prediction System for Sensors , 2015, SIGMOD Conference.

[31]  Peter Sollich,et al.  Learning curves for Gaussian process regression on random graphs , 2013 .

[32]  Konstantin Avrachenkov,et al.  Similarities on graphs: Kernels versus proximity measures , 2018, Eur. J. Comb..

[33]  Kung-Sik Chan,et al.  Models For Stationary Time Series , 2008 .

[34]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[35]  Santiago Segarra,et al.  Stationary Graph Processes and Spectral Estimation , 2016, IEEE Transactions on Signal Processing.

[36]  Ugur Demiryurek,et al.  Latent Space Model for Road Networks to Predict Time-Varying Traffic , 2016, KDD.

[37]  Inderjit S. Dhillon,et al.  Kernel k-means: spectral clustering and normalized cuts , 2004, KDD.

[38]  Pierre Vandergheynst,et al.  Towards stationary time-vertex signal processing , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[40]  Antonio Ortega,et al.  GRAPH VARIOGRAM: A NOVEL TOOL TO MEASURE SPATIAL STATIONARITY , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[41]  Wenjing Pu Analytic Relationships between Travel Time Reliability Measures , 2011 .

[42]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[43]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[44]  Paulo Gonçalves,et al.  Design of graph filters and filterbanks , 2017, ArXiv.

[45]  Andreas Loukas,et al.  Stationary time-vertex signal processing , 2016, EURASIP Journal on Advances in Signal Processing.

[46]  Shrikanth Narayanan,et al.  Local stationarity of graph signals: insights and experiments , 2017, Optical Engineering + Applications.

[47]  Neville Davies,et al.  A portmanteau test for self-exciting threshold autoregressive-type nonlinearity in time series , 1986 .

[48]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[49]  Robert B. Gramacy,et al.  Bayesian treed gaussian process models , 2005 .

[50]  José M. F. Moura,et al.  Discrete signal processing on graphs: Graph filters , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.