Graph Markov Network for Traffic Forecasting with Missing Data

Traffic forecasting is a classical task for traffic management and it plays an important role in intelligent transportation systems. However, since traffic data are mostly collected by traffic sensors or probe vehicles, sensor failures and the lack of probe vehicles will inevitably result in missing values in the collected raw data for some specific links in the traffic network. Although missing values can be imputed, existing data imputation methods normally need long-term historical traffic state data. As for short-term traffic forecasting, especially under edge computing and online prediction scenarios, traffic forecasting models with the capability of handling missing values are needed. In this study, we consider the traffic network as a graph and define the transition between network-wide traffic states at consecutive time steps as a graph Markov process. In this way, missing traffic states can be inferred step by step and the spatial-temporal relationships among the roadway links can be Incorporated. Based on the graph Markov process, we propose a new neural network architecture for spatial-temporal data forecasting, i.e. the graph Markov network (GMN). By incorporating the spectral graph convolution operation, we also propose a spectral graph Markov network (SGMN). The proposed models are compared with baseline models and tested on three real-world traffic state datasets with various missing rates. Experimental results show that the proposed GMN and SGMN can achieve superior prediction performance in terms of both accuracy and efficiency. Besides, the proposed models' parameters, weights, and predicted results are comprehensively analyzed and visualized.

[1]  D. T. Lee,et al.  Travel-time prediction with support vector regression , 2004, IEEE Transactions on Intelligent Transportation Systems.

[2]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[3]  Yinhai Wang,et al.  A hybrid approach to integrate fuzzy C-means based imputation method with genetic algorithm for missing traffic volume data estimation , 2015 .

[4]  Yinhai Wang,et al.  Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting , 2018, IEEE Transactions on Intelligent Transportation Systems.

[5]  Piet Van Mieghem,et al.  Orthogonal Eigenvector Matrix of the Laplacian , 2015, 2015 11th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[6]  Zhiyong Cui,et al.  High-Order Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting , 2018, ArXiv.

[7]  Shiliang Sun,et al.  A bayesian network approach to traffic flow forecasting , 2006, IEEE Transactions on Intelligent Transportation Systems.

[8]  Daniel B. Fambro,et al.  Application of Subset Autoregressive Integrated Moving Average Model for Short-Term Freeway Traffic Volume Forecasting , 1999 .

[9]  Yunpeng Wang,et al.  Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks , 2017, Sensors.

[10]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[11]  Yinhai Wang,et al.  Deep Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2017 .

[12]  Billy M. Williams,et al.  Comparison of parametric and nonparametric models for traffic flow forecasting , 2002 .

[13]  Yi Zhang,et al.  Traffic prediction, data compression, abnormal data detection and missing data imputation: An integrated study based on the decomposition of traffic time series , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[14]  Jignesh M. Patel,et al.  Big data and its technical challenges , 2014, CACM.

[15]  I Okutani,et al.  Dynamic prediction of traffic volume through Kalman Filtering , 1984 .

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Antoni Morell,et al.  Missing Data in Traffic Estimation: A Variational Autoencoder Imputation Method , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Biswajit Basu,et al.  Multivariate Short-Term Traffic Flow Forecasting Using Time-Series Analysis , 2009, IEEE Transactions on Intelligent Transportation Systems.

[19]  Billy M. Williams Multivariate Vehicular Traffic Flow Prediction: Evaluation of ARIMAX Modeling , 2001 .

[20]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[21]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[22]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[23]  Fei-Yue Wang,et al.  An efficient realization of deep learning for traffic data imputation , 2016 .

[24]  Mihaela van der Schaar,et al.  GAIN: Missing Data Imputation using Generative Adversarial Nets , 2018, ICML.

[25]  Bin Ran,et al.  Tensor based missing traffic data completion with spatial–temporal correlation , 2016 .

[26]  Xiaolei Ma,et al.  Forecasting Transportation Network Speed Using Deep Capsule Networks With Nested LSTM Models , 2018, IEEE Transactions on Intelligent Transportation Systems.

[27]  Yan Liu,et al.  Recurrent Neural Networks for Multivariate Time Series with Missing Values , 2016, Scientific Reports.

[28]  Traffic Prediction , 2017, Encyclopedia of GIS.

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Chao Zhang,et al.  Cell-Speed Prediction Neural Network (CPNN): A Deep Learning Approach for Trip-Based Speed Prediction , 2019 .

[31]  Yanru Zhang,et al.  A Comparative Study of Three Multivariate Short-Term Freeway Traffic Flow Forecasting Methods With Missing Data , 2016, J. Intell. Transp. Syst..

[32]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[33]  Xinyu Chen,et al.  Spatial-temporal traffic speed patterns discovery and incomplete data recovery via SVD-combined tensor decomposition , 2018 .

[34]  Bin Ran,et al.  Short-Term Traffic Prediction Based on Dynamic Tensor Completion , 2016, IEEE Transactions on Intelligent Transportation Systems.

[35]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[36]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[37]  Javier Del Ser,et al.  On the imputation of missing data for road traffic forecasting: New insights and novel techniques , 2018 .

[38]  Lijun Sun,et al.  A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation , 2019, Transportation Research Part C: Emerging Technologies.

[39]  Thambipillai Srikanthan,et al.  A clustering-based approach for data-driven imputation of missing traffic data , 2016, 2016 IEEE Forum on Integrated and Sustainable Transportation Systems (FISTS).

[40]  Yan Tian,et al.  LSTM-based traffic flow prediction with missing data , 2018, Neurocomputing.

[41]  Yu Tian,et al.  A Deep Generative Adversarial Architecture for Network-Wide Spatial-Temporal Traffic-State Estimation , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[42]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.