High-Order Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting

Traffic forecasting is a particularly challenging application of spatiotemporal forecasting, due to the time-varying traffic patterns and the complicated spatial dependencies on road networks. To address this challenge, we learn the traffic network as a graph and propose a novel deep learning framework, Traffic Graph Convolutional Long Short-Term Memory Neural Network (TGC-LSTM), to learn the interactions between roadways in the traffic network and forecast the network-wide traffic state. We define the traffic graph convolution based on the physical network topology. The relationship between the proposed traffic graph convolution and the spectral graph convolution is also discussed. An L1-norm on graph convolution weights and an L2-norm on graph convolution features are added to the model's loss function to enhance the interpretability of the proposed model. Experimental results show that the proposed model outperforms baseline methods on two real-world traffic state datasets. The visualization of the graph convolution weights indicates that the proposed framework can recognize the most influential road segments in real-world traffic networks.

[1]  Qi Zhang,et al.  Kernel-Weighted Graph Convolutional Network: A Deep Learning Approach for Traffic Forecasting , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[2]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.

[3]  Srinivas Peeta,et al.  An Exact Graph Structure for Dynamic Traffic Assignment: Formulation, Properties, and Computational Experience , 2007 .

[4]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[5]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[6]  Ardeshir Faghri,et al.  APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS TO INTELLIGENT VEHICLE-HIGHWAY SYSTEMS , 1994 .

[7]  Gang Chen,et al.  A Gentle Tutorial of Recurrent Neural Network with Error Backpropagation , 2016, ArXiv.

[8]  Cyrus Shahabi,et al.  Graph Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ArXiv.

[9]  Xiaolei Ma,et al.  Forecasting Transportation Network Speed Using Deep Capsule Networks With Nested LSTM Models , 2018, IEEE Transactions on Intelligent Transportation Systems.

[10]  Nikos Komodakis,et al.  Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Shijie Li,et al.  Deep Spatial–Temporal 3D Convolutional Neural Networks for Traffic Data Forecasting , 2019, IEEE Transactions on Intelligent Transportation Systems.

[12]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[13]  Huijun Sun,et al.  Spatial distribution complexities of traffic congestion and bottlenecks in different network topologies , 2014 .

[14]  Houbing Song,et al.  Discovering time-dependent shortest path on traffic graph for drivers towards green driving , 2017, J. Netw. Comput. Appl..

[15]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[16]  Bin Yu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017 .

[17]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[18]  Li Li,et al.  Pattern Sensitive Prediction of Traffic Flow Based on Generative Adversarial Framework , 2019, IEEE Transactions on Intelligent Transportation Systems.

[19]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[20]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[21]  C. Daganzo THE CELL TRANSMISSION MODEL.. , 1994 .

[22]  Kristina Lerman,et al.  MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing , 2019, ICML.

[23]  P J Webros BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[24]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[25]  Ronald J. Williams,et al.  Experimental Analysis of the Real-time Recurrent Learning Algorithm , 1989 .

[26]  Mansur R. Kabuka,et al.  Combining weather condition data to predict traffic flow: A GRU-based deep learning approach , 2018 .

[27]  Dongjoo Park,et al.  Forecasting Freeway Link Travel Times with a Multilayer Feedforward Neural Network , 1999 .

[28]  Shing Chung Josh Wong,et al.  Urban traffic flow prediction using a fuzzy-neural approach , 2002 .

[29]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[30]  Wan Li,et al.  Two-Stream Multi-Channel Convolutional Neural Network for Multi-Lane Traffic Speed Prediction Considering Traffic Volume Impact , 2019, Transportation Research Record: Journal of the Transportation Research Board.

[31]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[32]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[33]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[34]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[35]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[36]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[37]  Jian Li,et al.  Big data‐driven machine learning‐enabled traffic flow prediction , 2018, Trans. Emerg. Telecommun. Technol..

[38]  Paul Patras,et al.  Long-Term Mobile Traffic Forecasting Using Deep Spatio-Temporal Neural Networks , 2017, MobiHoc.

[39]  Yunpeng Wang,et al.  Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks , 2017, Sensors.

[40]  Wei Cao,et al.  When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks , 2018, AAAI.

[41]  Zhanxing Zhu,et al.  3D Graph Convolutional Networks with Temporal Graphs: A Spatial Information Free Framework For Traffic Forecasting , 2019, ArXiv.

[42]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[43]  Zhiyong Cui,et al.  Deep Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2018, ArXiv.

[44]  Yu Tian,et al.  A Deep Generative Adversarial Architecture for Network-Wide Spatial-Temporal Traffic-State Estimation , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[45]  Jian Li,et al.  Short-term traffic flow prediction in smart multimedia system for Internet of Vehicles based on deep belief network , 2019, Future Gener. Comput. Syst..

[46]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[47]  Hashem R Al-Masaeid,et al.  Short-Term Prediction of Traffic Volume in Urban Arterials , 1995 .

[48]  Paolo Frasconi,et al.  Short-Term Traffic Flow Forecasting: An Experimental Comparison of Time-Series Analysis and Supervised Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[49]  Fei-Yue Wang,et al.  Travel time prediction with LSTM neural network , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[50]  S. P. Hoogendoorn,et al.  Freeway Travel Time Prediction with State-Space Neural Networks: Modeling State-Space Dynamics with Recurrent Neural Networks , 2002 .

[51]  Jieping Ye,et al.  Spatiotemporal Multi-Graph Convolution Network for Ride-Hailing Demand Forecasting , 2019, AAAI.

[52]  Ugur Demiryurek,et al.  Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting , 2017, SDM.

[53]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[54]  Xuan Song,et al.  DeepTransport: Prediction and Simulation of Human Mobility and Transportation Mode at a Citywide Level , 2016, IJCAI.

[55]  Huaiyu Wan,et al.  Spatio-Temporal Recurrent Convolutional Networks for Citywide Short-term Crowd Flows Prediction , 2018, ICCDA.

[56]  Shuicheng Yan,et al.  Semantic Object Parsing with Graph LSTM , 2016, ECCV.