Short-Term Traffic Congestion Forecasting Using Attention-Based Long Short-Term Memory Recurrent Neural Network

Traffic congestion seriously affect citizens’ life quality. Many researchers have paid much attention to the task of short-term traffic congestion forecasting. However, the performance of the traditional traffic congestion forecasting approaches is not satisfactory. Moreover, most neural network models cannot capture the features at different moments effectively. In this paper, we propose an Attention-based long short-term memory (LSTM) recurrent neural network. We evaluate the prediction architecture on a real-time traffic data from Gray-Chicago-Milwaukee (GCM) Transportation Corridor in Chicagoland. The experimental results demonstrate that our method outperforms the baselines for the task of congestion prediction.

[1]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[2]  Xuan Song,et al.  Learning Deep Representation from Big and Heterogeneous Data for Traffic Accident Inference , 2016, AAAI.

[3]  Wei Shi,et al.  Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification , 2016, ACL.

[4]  Mecit Cetin,et al.  Short-term traffic flow rate forecasting based on identifying similar traffic patterns , 2016 .

[5]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[6]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[7]  Li Pan,et al.  Predicting Short-Term Traffic Flow by Long Short-Term Memory Recurrent Neural Network , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[8]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[9]  Lee D. Han,et al.  Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions , 2009, Expert Syst. Appl..

[10]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[11]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  Li Li,et al.  Deep Bi-directional Long Short-Term Memory Model for Short-Term Traffic Flow Prediction , 2017, ICONIP.

[13]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[14]  Yinhai Wang,et al.  Deep Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2017 .

[15]  Eleni I. Vlahogianni,et al.  Optimized and meta-optimized neural networks for short-term traffic flow prediction: A genetic approach , 2005 .

[16]  Zili Zhang,et al.  A distributed spatial-temporal weighted model on MapReduce for short-term traffic flow forecasting , 2016, Neurocomputing.

[17]  Moshe Levin,et al.  ON FORECASTING FREEWAY OCCUPANCIES AND VOLUMES (ABRIDGMENT) , 1980 .

[18]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[19]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..