A parallel spatiotemporal deep learning network for highway traffic flow forecasting

Spatiotemporal features have a significant influence on traffic flow prediction. Due to the potentially internal relationship of adjacent roads, spatial information can, to some extent, affect traffic flow forecasting. Simultaneously, periodic information of traffic flow data can also be positively affected by temporal features. Considering these key points, this article proposes a parallel spatiotemporal deep learning network for short-term highway traffic flow forecasting, which learns features from the time and space dimensions. In the introduced model, the convolutional neural network is used to extract spatial features and long short-term memory is used to extract temporal features of traffic flow. The parallel-connected structure of convolutional neural network and long short-term memory reflects much powerful performance in traffic flow prediction. To apply the parallel spatiotemporal deep learning network in large dataset prediction, a dataset of Shanghai inner ring elevated road is used to predict 591 sensors in 6 months. Experimental results confirm that the overall performance of our parallel spatiotemporal deep learning network surpasses those of other state-of-the-art methods.

[1]  Gaetano Fusco,et al.  The Use of Artificial Neural Networks in Advanced Traveler Information and Traffic Management Systems , 1996 .

[2]  Said M. Easa,et al.  Supervised Weighting-Online Learning Algorithm for Short-Term Traffic Flow Prediction , 2013, IEEE Transactions on Intelligent Transportation Systems.

[3]  Wenhao Huang,et al.  Dynamic boosting in deep learning using reconstruction error , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[4]  Mehryar Mohri,et al.  Multi-Class Deep Boosting , 2014, NIPS.

[5]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[7]  Tharam S. Dillon,et al.  Optimized Structure of the Traffic Flow Forecasting Model With a Deep Learning Approach , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Surya Ganguli,et al.  Identifying and attacking the saddle point problem in high-dimensional non-convex optimization , 2014, NIPS.

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Li Li,et al.  Efficient missing data imputing for traffic flow by considering temporal and spatial dependence , 2013 .

[11]  Forrest N. Iandola,et al.  FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Wei Shen,et al.  Real-time road traffic forecasting using regime-switching space-time models and adaptive LASSO , 2012 .

[13]  Shi-Jinn Horng,et al.  Deep Air Quality Forecasting Using Hybrid Deep Learning Framework , 2018, IEEE Transactions on Knowledge and Data Engineering.

[14]  Agachai Sumalee,et al.  Short-Term Traffic State Prediction Based on Temporal–Spatial Correlation , 2013, IEEE Transactions on Intelligent Transportation Systems.

[15]  Su Yang,et al.  Spatiotemporal Context Awareness for Urban Traffic Modeling and Prediction: Sparse Representation Based Variable Selection , 2015, PloS one.

[16]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[17]  Xun Gong,et al.  A Hybrid Method for Traffic Flow Forecasting Using Multimodal Deep Learning , 2018, Int. J. Comput. Intell. Syst..

[18]  Francisco Javier Díaz Pernas,et al.  Wavelet‐Based Denoising for Traffic Volume Time Series Forecasting with Self‐Organizing Neural Networks , 2010, Comput. Aided Civ. Infrastructure Eng..

[19]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[20]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[21]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[22]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Silvia Crivelli,et al.  A Spatial Mapping Algorithm with Applications in Deep Learning-Based Structure Classification , 2018, ArXiv.

[25]  Paolo Frasconi,et al.  Short-Term Traffic Flow Forecasting: An Experimental Comparison of Time-Series Analysis and Supervised Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[26]  Qiang Zhang,et al.  Improving Medical Short Text Classification with Semantic Expansion Using Word-Cluster Embedding , 2018, ICISA.

[27]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[29]  Meiyappan Nagappan,et al.  Supervised Sentiment Classification with CNNs for Diverse SE Datasets , 2018, ArXiv.

[30]  Henk J. van Zuylen,et al.  Localized Extended Kalman Filter for Scalable Real-Time Traffic State Estimation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[31]  Andrew Y. Ng,et al.  Convolutional-Recursive Deep Learning for 3D Object Classification , 2012, NIPS.

[32]  Zhirui Ye,et al.  Short‐Term Traffic Volume Forecasting Using Kalman Filter with Discrete Wavelet Decomposition , 2007, Comput. Aided Civ. Infrastructure Eng..

[33]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[34]  Anuj Sharma,et al.  Stochastic trust region inexact Newton method for large-scale machine learning , 2018, Int. J. Mach. Learn. Cybern..

[35]  Dorin Comaniciu,et al.  Deep Decision Network for Multi-class Image Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Chunyan Miao,et al.  Online multimodal deep similarity learning with application to image retrieval , 2013, ACM Multimedia.

[37]  Shiliang Sun,et al.  High-Order Gaussian Process Dynamical Models for Traffic Flow Prediction , 2016, IEEE Transactions on Intelligent Transportation Systems.

[38]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[39]  Benjamin Letham,et al.  Forecasting at Scale , 2018, PeerJ Prepr..

[40]  Yann LeCun,et al.  The Loss Surface of Multilayer Networks , 2014, ArXiv.

[41]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[42]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Biswajit Basu,et al.  Real-Time Traffic Flow Forecasting Using Spectral Analysis , 2012, IEEE Transactions on Intelligent Transportation Systems.