Heterogeneous Spatio-Temporal Graph Convolution Network for Traffic Forecasting with Missing Values

Accurate traffic prediction is indispensable for intelligent traffic management. The availability of large-scale road sensing data collected by connected wireless sensors and mobile devices have provided unrealized potential for traffic prediction. However, sensory data is often incomplete due to various factors in the process of data acquisition and transmission. The missingness of traffic data brings a key challenge to the traffic prediction task since the state-of-the-art ML-based traffic prediction models (e.g., Graph Convolutional Networks (GCN)) often rely on spatial and temporal completion of the data. Moreover, existing GCN-based methods usually build a static graph based on geographical distances and are limited in their ability to capture the time-evolving relationships amongst road segments. In this paper, we develop a heterogeneous spatio-temporal prediction framework for traffic prediction using incomplete historical data. In the framework, we build multiple graphs to explicitly model the dynamic correlations among road segments from both geographical and historical aspects, and employ recurrent neural networks to capture temporal correlations for each road segment. We impute missing values in a recurrent process, which is seamlessly embedded in the prediction framework so they can be jointly trained. The proposed framework is evaluated on a public dataset of static sensors and a private dataset collected by our roving sensor system. Experimental results show the effectiveness of the proposed framework compared to state-of-the-art methods, and indicate the potential to be deployed into real-world traffic prediction systems.

[1]  Min Chi,et al.  Temporal Belief Memory: Imputing Missing Data during RNN Training , 2018, IJCAI.

[2]  Xianfeng Tang,et al.  Joint Modeling of Local and Global Temporal Dynamics for Multivariate Time Series Forecasting with Missing Values , 2019, AAAI.

[3]  Cheng Wang,et al.  GMAN: A Graph Multi-Attention Network for Traffic Prediction , 2019, AAAI.

[4]  Anuj Karpatne,et al.  Spatial Context-Aware Networks for Mining Temporal Discriminative Period in Land Cover Detection , 2019, SDM.

[5]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[6]  W. Zame,et al.  Multi-directional Recurrent Neural Networks : A Novel Method for Estimating Missing Data , 2017 .

[7]  Man-Chun Tan,et al.  An Aggregation Approach to Short-Term Traffic Flow Prediction , 2009, IEEE Transactions on Intelligent Transportation Systems.

[8]  Zheng Wang,et al.  Multi-task Representation Learning for Travel Time Estimation , 2018, KDD.

[9]  Yi Zhang,et al.  PPCA-Based Missing Data Imputation for Traffic Flow Volume: A Systematical Approach , 2009, IEEE Transactions on Intelligent Transportation Systems.

[10]  Junbo Zhang,et al.  Urban Traffic Prediction from Spatio-Temporal Data Using Deep Meta Learning , 2019, KDD.

[11]  Kenli Li,et al.  Gated Residual Recurrent Graph Neural Networks for Traffic Prediction , 2019, AAAI.

[12]  Jieping Ye,et al.  Spatiotemporal Multi-Graph Convolution Network for Ride-Hailing Demand Forecasting , 2019, AAAI.

[13]  Pravin Varaiya,et al.  Freeway Performance Measurement System: Mining Loop Detector Data , 2001 .

[14]  Lei Chen,et al.  On The Marriage of Lp-norms and Edit Distance , 2004, VLDB.

[15]  Wei Cao,et al.  Multi-Range Attentive Bicomponent Graph Convolutional Network for Traffic Forecasting , 2019, AAAI.

[16]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[17]  Michael S. Steinbach,et al.  Physics-Guided Recurrent Graph Model for Predicting Flow and Temperature in River Networks , 2021, SDM.

[18]  Yingfeng Cai,et al.  Graph regularized local self-representation for missing value imputation with applications to on-road traffic sensor data , 2018, Neurocomputing.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations with Missing Data , 2010, SDM.

[21]  Markos Papageorgiou,et al.  A real-time freeway network traffic surveillance tool , 2006, IEEE Transactions on Control Systems Technology.

[22]  Gaofeng Meng,et al.  Spatio-Temporal Graph Structure Learning for Traffic Forecasting , 2020, AAAI.

[23]  Fenglong Ma,et al.  A Reliability-Aware Vehicular Crowdsensing System for Pothole Profiling , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[24]  A. Hudak,et al.  Nearest neighbor imputation of species-level, plot-scale forest structure attributes from LiDAR data , 2008 .

[25]  Qiuling Suo,et al.  Recurrent Imputation for Multivariate Time Series with Missing Values , 2019, 2019 IEEE International Conference on Healthcare Informatics (ICHI).

[26]  Yan Liu,et al.  Recurrent Neural Networks for Multivariate Time Series with Missing Values , 2016, Scientific Reports.

[27]  Ying Zhang,et al.  Multivariate Time Series Imputation with Generative Adversarial Networks , 2018, NeurIPS.

[28]  Tahar Zanouda,et al.  Learning Spatiotemporal Latent Factors of Traffic via a Regularized Tensor Factorization: Imputing Missing Values and Forecasting , 2018 .

[29]  Craig K. Enders,et al.  An introduction to modern missing data analyses. , 2010, Journal of school psychology.

[30]  Jing Jiang,et al.  Graph WaveNet for Deep Spatial-Temporal Graph Modeling , 2019, IJCAI.

[31]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[32]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[33]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[34]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[35]  Xianfeng Tang,et al.  Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction , 2018, AAAI.

[36]  Bin Ran,et al.  Traffic speed prediction for intelligent transportation system based on a deep feature fusion model , 2019, J. Intell. Transp. Syst..

[37]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[38]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[39]  Kian Hsiang Low,et al.  Gaussian Process Decentralized Data Fusion and Active Sensing for Spatiotemporal Traffic Modeling and Prediction in Mobility-on-Demand Systems , 2015, IEEE Transactions on Automation Science and Engineering.

[40]  Haitham Al-Deek,et al.  Predictions of Freeway Traffic Speeds and Volumes Using Vector Autoregressive Models , 2009, J. Intell. Transp. Syst..

[41]  Takashi Oguchi,et al.  Large-scale Traffic Data Imputation Using Matrix Completion on Graphs , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[42]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[43]  Jiayu Zhou,et al.  Imputing Structured Missing Values in Spatial Data with Clustered Adversarial Matrix Factorization , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[44]  Wei Cao,et al.  BRITS: Bidirectional Recurrent Imputation for Time Series , 2018, NeurIPS.

[45]  Yu Zheng,et al.  Travel time estimation of a path using sparse trajectories , 2014, KDD.

[46]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[47]  Dafang Zhang,et al.  Dynamic Spatial-Temporal Graph Convolutional Neural Networks for Traffic Forecasting , 2019, AAAI.