Deep Spatial–Temporal 3D Convolutional Neural Networks for Traffic Data Forecasting

Reliable traffic prediction is critical to improve safety, stability, and efficiency of intelligent transportation systems. However, traffic prediction is a very challenging problem because traffic data are a typical type of spatio-temporal data, which simultaneously shows correlation and heterogeneity both in space and time. Most existing works can only capture the partial properties of traffic data and even assume that the effect of correlation on traffic prediction is globally invariable, resulting in inadequate modeling and unsatisfactory prediction performance. In this paper, we propose a novel end-to-end deep learning model, called ST-3DNet, for traffic raster data prediction. ST-3DNet introduces 3D convolutions to automatically capture the correlations of traffic data in both spatial and temporal dimensions. A novel recalibration (Rc) block is proposed to explicitly quantify the difference of the contributions of the correlations in space. Considering two kinds of temporal properties of traffic data, i.e., local patterns and long-term patterns, ST-3DNet employs two components consisting of 3D convolutions and Rc blocks to, respectively, model the two kinds of patterns and then aggregates them together in a weighted way for the final prediction. The experiments on several real-world traffic datasets, viz., traffic congestion data and crowd flows data, demonstrate that our ST-3DNet outperforms the state-of-the-art baselines.

[1]  A. Karpatne,et al.  Spatio-Temporal Data Mining: A Survey of Problems and Methods , 2017, ArXiv.

[2]  Ramez Elmasri,et al.  Scalable deep traffic flow neural networks for urban traffic congestion prediction , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[3]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[4]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[7]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[8]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[9]  Jiaqiu Wang,et al.  STARIMA for journey time prediction in London , 2010 .

[10]  Tharam S. Dillon,et al.  Optimized Structure of the Traffic Flow Forecasting Model With a Deep Learning Approach , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[16]  Zuo Zhang,et al.  Urban traffic network modeling and short-term traffic flow forecasting based on GSTARIMA model , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[18]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[19]  Gary A. Davis,et al.  Nonparametric Regression and Short‐Term Freeway Traffic Forecasting , 1991 .

[20]  Jiaqiu Wang,et al.  Spatio-temporal autocorrelation of road network data , 2012, J. Geogr. Syst..

[21]  Shane G. Henderson,et al.  Travel time estimation for ambulances using Bayesian data augmentation , 2013, 1312.1873.

[22]  Tianrui Li,et al.  Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks , 2017, Artif. Intell..

[23]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[24]  Yi Zhang,et al.  Short-term traffic flow forecasting of urban network based on dynamic STARIMA model , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[25]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Xi Fu Wang,et al.  Forecasting Traffic Volume with Space-Time ARIMA Model , 2010 .

[27]  Casper J. Albers,et al.  Multivariate forecasting of road traffic flows in the presence of heteroscedasticity and measurement errors , 2013 .

[28]  Mascha C. van der Voort,et al.  Combining kohonen maps with arima time series models to forecast traffic flow , 1996 .

[29]  Billy M. Williams,et al.  Modeling and Forecasting Vehicular Traffic Flow as a Seasonal ARIMA Process: Theoretical Basis and Empirical Results , 2003, Journal of Transportation Engineering.

[30]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Yang Yue,et al.  Spatiotemporal Traffic-Flow Dependency and Short-Term Traffic Forecasting , 2008 .

[32]  Eleni I. Vlahogianni,et al.  Statistical methods versus neural networks in transportation research: Differences, similarities and some insights , 2011 .

[33]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[34]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[35]  Byoung-Jo Yoon,et al.  Dynamic near-term traffic flow prediction: system- oriented approach based on past experiences , 2012 .

[36]  Hashem R Al-Masaeid,et al.  Short-Term Prediction of Traffic Volume in Urban Arterials , 1995 .

[37]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[38]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.