Traffic Speed Prediction: An Attention-Based Method

Short-term traffic speed prediction has become one of the most important parts of intelligent transportation systems (ITSs). In recent years, deep learning methods have demonstrated their superiority both in accuracy and efficiency. However, most of them only consider the temporal information, overlooking the spatial or some environmental factors, especially the different correlations between the target road and the surrounding roads. This paper proposes a traffic speed prediction approach based on temporal clustering and hierarchical attention (TCHA) to address the above issues. We apply temporal clustering to the target road to distinguish the traffic environment. Traffic data in each cluster have a similar distribution, which can help improve the prediction accuracy. A hierarchical attention-based mechanism is then used to extract the features at each time step. The encoder measures the importance of spatial features, and the decoder measures the temporal ones. The proposed method is evaluated over the data of a certain area in Hangzhou, and experiments have shown that this method can outperform the state of the art for traffic speed prediction.

[1]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[2]  Yang Zhang,et al.  Traffic forecasting using least squares support vector machines , 2009 .

[3]  Laurence R. Rilett,et al.  Non-linear analysis of traffic flow , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[4]  Billy M. Williams,et al.  Modeling and Forecasting Vehicular Traffic Flow as a Seasonal ARIMA Process: Theoretical Basis and Empirical Results , 2003, Journal of Transportation Engineering.

[5]  Danyang Li,et al.  Traffic Flow Prediction during the Holidays Based on DFT and SVR , 2019, J. Sensors.

[6]  Wanli Min,et al.  Real-time road traffic prediction with spatio-temporal correlations , 2011 .

[7]  Mecit Cetin,et al.  Short-term traffic flow rate forecasting based on identifying similar traffic patterns , 2016 .

[8]  Mihaela van der Schaar,et al.  Mining the Situation: Spatiotemporal Traffic Prediction With Big Data , 2015, IEEE Journal of Selected Topics in Signal Processing.

[9]  Xun Gong,et al.  A Hybrid Method for Traffic Flow Forecasting Using Multimodal Deep Learning , 2018, Int. J. Comput. Intell. Syst..

[10]  Yunpeng Wang,et al.  Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks , 2017, Sensors.

[11]  Hao Chen,et al.  Real-time freeway traffic state prediction: A particle filter approach , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[12]  Roland Chrobok.  Theory and Application of Advanced Traffic Forecast Methods , 2005 .

[13]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[14]  Henk J. van Zuylen,et al.  Localized Extended Kalman Filter for Scalable Real-Time Traffic State Estimation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[15]  Jin Wang,et al.  Short-term traffic speed forecasting hybrid model based on Chaos–Wavelet Analysis-Support Vector Machine theory , 2013 .

[16]  Garrison W. Cottrell,et al.  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction , 2017, IJCAI.

[17]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[18]  Muhammad Tayyab Asif,et al.  Spatiotemporal Patterns in Large-Scale Traffic Speed Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[19]  Wenqi Lu,et al.  Short-term prediction of lane-level traffic speeds: A fusion deep learning model , 2019, Transportation Research Part C: Emerging Technologies.

[20]  Hengchao Li,et al.  A Multiplicative Seasonal ARIMA/GARCH Model in EVN Traffic Prediction , 2015 .

[21]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[22]  Haitham Al-Deek,et al.  Predictions of Freeway Traffic Speeds and Volumes Using Vector Autoregressive Models , 2009, J. Intell. Transp. Syst..

[23]  Xiaosi Zeng,et al.  Development of Recurrent Neural Network Considering Temporal‐Spatial Input Dynamics for Freeway Travel Time Modeling , 2013, Comput. Aided Civ. Infrastructure Eng..

[24]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[25]  Bin Ran,et al.  Day-ahead traffic flow forecasting based on a deep belief network optimized by the multi-objective particle swarm algorithm , 2019, Knowl. Based Syst..

[26]  Sherif Ishak,et al.  A Hidden Markov Model for short term prediction of traffic conditions on freeways , 2014 .

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Wenwu Zhu,et al.  Multi-modal Sequence to Sequence Learning with Content Attention for Hotspot Traffic Speed Prediction , 2018, PCM.

[29]  Chuang Lin,et al.  A Convolution Component-Based Method with Attention Mechanism for Travel-Time Prediction , 2019, Sensors.

[30]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[31]  Guojiang Shen,et al.  A New Combinatorial Characteristic Parameter for Clustering-Based Traffic Network Partitioning , 2019, IEEE Access.

[32]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[33]  Hwasoo Yeo,et al.  Short-term travel-time prediction on highway: A review on model-based approach , 2017, KSCE Journal of Civil Engineering.

[34]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[35]  Wei Deng,et al.  New Bayesian combination method for short-term traffic flow forecasting , 2014 .

[36]  Gary A. Davis,et al.  Nonparametric Regression and Short‐Term Freeway Traffic Forecasting , 1991 .

[37]  Saumya Bhaduri.  Evaluation of different techniques for detection of virulence in Yersinia enterocolitica. , 1990 .

[38]  Zhi Liu,et al.  Research on Traffic Speed Prediction by Temporal Clustering Analysis and Convolutional Neural Network With Deformable Kernels (May, 2018) , 2018, IEEE Access.

[39]  Eleni I. Vlahogianni,et al.  Statistical methods versus neural networks in transportation research: Differences, similarities and some insights , 2011 .

[40]  Hwasoo Yeo,et al.  Improvement of Search Strategy With K-Nearest Neighbors Approach for Traffic State Prediction , 2016, IEEE Transactions on Intelligent Transportation Systems.

[41]  Yong Zhao,et al.  Deep Autoencoder Neural Networks for Short-Term Traffic Congestion Prediction of Transportation Networks , 2019, Sensors.

[42]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[43]  Chung-Cheng Lu,et al.  A bayesian dynamic linear model approach for real-time short-term freeway travel time prediction , 2011 .

[44]  Li Li,et al.  Using LSTM and GRU neural network methods for traffic flow prediction , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[45]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..