Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting

Traffic forecasting is a particularly challenging application of spatiotemporal forecasting, due to the time-varying traffic patterns and the complicated spatial dependencies on road networks. To address this challenge, we learn the traffic network as a graph and propose a novel deep learning framework, Traffic Graph Convolutional Long Short-Term Memory Neural Network (TGC-LSTM), to learn the interactions between roadways in the traffic network and forecast the network-wide traffic state. We define the traffic graph convolution based on the physical network topology. The relationship between the proposed traffic graph convolution and the spectral graph convolution is also discussed. An L1-norm on graph convolution weights and an L2-norm on graph convolution features are added to the model’s loss function to enhance the interpretability of the proposed model. Experimental results show that the proposed model outperforms baseline methods on two real-world traffic state datasets. The visualization of the graph convolution weights indicates that the proposed framework can recognize the most influential road segments in real-world traffic networks.

[1]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[2]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[3]  Yunpeng Wang,et al.  Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks , 2017, Sensors.

[4]  Xuan Song,et al.  DeepTransport: Prediction and Simulation of Human Mobility and Transportation Mode at a Citywide Level , 2016, IJCAI.

[5]  Qi Zhang,et al.  Kernel-Weighted Graph Convolutional Network: A Deep Learning Approach for Traffic Forecasting , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[6]  Xiaocheng Li,et al.  Graph Convolution: A High-Order and Adaptive Approach , 2017, 1706.09916.

[7]  Hashem R Al-Masaeid,et al.  Short-Term Prediction of Traffic Volume in Urban Arterials , 1995 .

[8]  Fei-Yue Wang,et al.  Travel time prediction with LSTM neural network , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[11]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.

[12]  Zhiyong Cui,et al.  Deep Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2018, ArXiv.

[13]  Mansur R. Kabuka,et al.  Combining Weather Condition Data to Predict Traffic Flow: A GRU Based Deep Learning Approach , 2017, 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[14]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[15]  Huijun Sun,et al.  Spatial distribution complexities of traffic congestion and bottlenecks in different network topologies , 2014 .

[16]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[17]  Zhanxing Zhu,et al.  3D Graph Convolutional Networks with Temporal Graphs: A Spatial Information Free Framework For Traffic Forecasting , 2019, ArXiv.

[18]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[19]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[20]  Yinhai Wang,et al.  Deep Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2017 .

[21]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[22]  Shing Chung Josh Wong,et al.  Urban traffic flow prediction using a fuzzy-neural approach , 2002 .

[23]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[24]  Srinivas Peeta,et al.  An Exact Graph Structure for Dynamic Traffic Assignment: Formulation, Properties, and Computational Experience , 2007 .

[25]  Xiaolei Ma,et al.  Forecasting Transportation Network Speed Using Deep Capsule Networks With Nested LSTM Models , 2018, IEEE Transactions on Intelligent Transportation Systems.

[26]  Wan Li,et al.  Two-Stream Multi-Channel Convolutional Neural Network for Multi-Lane Traffic Speed Prediction Considering Traffic Volume Impact , 2019, Transportation Research Record: Journal of the Transportation Research Board.

[27]  Houbing Song,et al.  Discovering time-dependent shortest path on traffic graph for drivers towards green driving , 2017, J. Netw. Comput. Appl..

[28]  Bin Yu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017 .

[29]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[30]  Kristina Lerman,et al.  MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing , 2019, ICML.

[31]  Yike Guo,et al.  Deep Sequence Learning with Auxiliary Information for Traffic Prediction , 2018, KDD.

[32]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[33]  Jieping Ye,et al.  Spatiotemporal Multi-Graph Convolution Network for Ride-Hailing Demand Forecasting , 2019, AAAI.

[34]  Ugur Demiryurek,et al.  Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting , 2017, SDM.

[35]  Nikos Komodakis,et al.  Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  S. P. Hoogendoorn,et al.  Freeway Travel Time Prediction with State-Space Neural Networks: Modeling State-Space Dynamics with Recurrent Neural Networks , 2002 .

[37]  Kenli Li,et al.  Exploiting Spatio-Temporal Correlations with Multiple 3D Convolutional Neural Networks for Citywide Vehicle Flow Prediction , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[38]  C. Daganzo THE CELL TRANSMISSION MODEL.. , 1994 .

[39]  Dongjoo Park,et al.  Forecasting Freeway Link Travel Times with a Multilayer Feedforward Neural Network , 1999 .

[40]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[41]  Shijie Li,et al.  Deep Spatial–Temporal 3D Convolutional Neural Networks for Traffic Data Forecasting , 2019, IEEE Transactions on Intelligent Transportation Systems.

[42]  Yu Tian,et al.  A Deep Generative Adversarial Architecture for Network-Wide Spatial-Temporal Traffic-State Estimation , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[43]  Jian Li,et al.  Short-term traffic flow prediction in smart multimedia system for Internet of Vehicles based on deep belief network , 2019, Future Gener. Comput. Syst..

[44]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[45]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[46]  Jian Li,et al.  Big data‐driven machine learning‐enabled traffic flow prediction , 2018, Trans. Emerg. Telecommun. Technol..

[47]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[48]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[49]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[50]  Huaiyu Wan,et al.  Spatio-Temporal Recurrent Convolutional Networks for Citywide Short-term Crowd Flows Prediction , 2018, ICCDA.

[51]  Paul Patras,et al.  Long-Term Mobile Traffic Forecasting Using Deep Spatio-Temporal Neural Networks , 2017, MobiHoc.

[52]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[53]  Li Li,et al.  Pattern Sensitive Prediction of Traffic Flow Based on Generative Adversarial Framework , 2019, IEEE Transactions on Intelligent Transportation Systems.