A Multitask Learning Model for Traffic Flow and Speed Forecasting

Intelligent Transportation Systems (ITS) research and applications benefit from accurate short-term traffic state forecasting. To improve the forecasting accuracy, this paper proposes a deep learning based multitask learning Gated Recurrent Units (MTL-GRU) with residual mappings. To enhance the performance of the MTL-GRU, feature engineering is introduced to select the most informative features for the forecasting. Then, based on real-world datasets, numerical results show that the MTL-GRU can well estimate traffic flow and speed simultaneously, and performs better than other counterparts. Experiments also show that the deep learning based MTL-GRU model can overpower the bottleneck caused by enlarging training datasets and continue to gain benefits. The results suggest the proposed MTL-GRU model with residual mappings is promising to forecast short-term traffic state.

[1]  Helai Huang,et al.  Support vector machine in crash prediction at the level of traffic analysis zones: Assessing the spatial proximity effects. , 2015, Accident; analysis and prevention.

[2]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[3]  Tharam S. Dillon,et al.  Neural-Network-Based Models for Short-Term Traffic Flow Forecasting Using a Hybrid Exponential Smoothing and Levenberg–Marquardt Algorithm , 2012, IEEE Transactions on Intelligent Transportation Systems.

[4]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[5]  Antony Stathopoulos,et al.  Adaptive hybrid fuzzy rule-based system approach for modeling and predicting urban traffic flow , 2008 .

[6]  Wojciech Czarnecki,et al.  Multi-task Deep Reinforcement Learning with PopArt , 2018, AAAI.

[7]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[8]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  Bo Peng,et al.  Short‐term traffic flow prediction with linear conditional Gaussian Bayesian network , 2016 .

[10]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[11]  Ugur Demiryurek,et al.  Situation Aware Multi-task Learning for Traffic Prediction , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[12]  Der-Horng Lee,et al.  Short-term freeway traffic flow prediction : Bayesian combined neural network approach , 2006 .

[13]  Zijian Liu,et al.  A novel generative adversarial network for estimation of trip travel time distribution with trajectory data , 2019, Transportation Research Part C: Emerging Technologies.

[14]  Jürgen Schmidhuber,et al.  LSTM can Solve Hard Long Time Lag Problems , 1996, NIPS.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[17]  Yanyan Chen,et al.  Network-wide identification of turn-level intersection congestion using only low-frequency probe vehicle data , 2019, Transportation Research Part C: Emerging Technologies.

[18]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[19]  Mascha C. van der Voort,et al.  Combining kohonen maps with arima time series models to forecast traffic flow , 1996 .

[20]  A. R. Cook,et al.  ANALYSIS OF FREEWAY TRAFFIC TIME-SERIES DATA BY USING BOX-JENKINS TECHNIQUES , 1979 .

[21]  Helai Huang,et al.  Feature selection-based approach for urban short-term travel speed prediction , 2018 .

[22]  Dong Xu,et al.  Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey , 2018, IEEE Signal Processing Magazine.

[23]  Yunpeng Wang,et al.  A spatiotemporal correlative k-nearest neighbor model for short-term traffic multistep forecasting , 2016 .

[24]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[25]  Zijian Liu,et al.  Short-Term Prediction of Passenger Demand in Multi-Zone Level: Temporal Convolutional Neural Network With Multi-Task Learning , 2020, IEEE Transactions on Intelligent Transportation Systems.

[26]  Zijian Liu,et al.  A deep learning based multitask model for network-wide traffic speed prediction , 2020, Neurocomputing.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Shiliang Sun,et al.  Neural network multitask learning for traffic flow forecasting , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[29]  Shih-Fu Chang,et al.  Exploiting Feature and Class Relationships in Video Categorization with Regularized Deep Neural Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Paolo Frasconi,et al.  Short-Term Traffic Flow Forecasting: An Experimental Comparison of Time-Series Analysis and Supervised Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[31]  Billy M. Williams,et al.  Modeling and Forecasting Vehicular Traffic Flow as a Seasonal ARIMA Process: Theoretical Basis and Empirical Results , 2003, Journal of Transportation Engineering.

[32]  Said M. Easa,et al.  Supervised Weighting-Online Learning Algorithm for Short-Term Traffic Flow Prediction , 2013, IEEE Transactions on Intelligent Transportation Systems.

[33]  Daeho Kim,et al.  Cooperative Traffic Signal Control with Traffic Flow Prediction in Multi-Intersection , 2019, Sensors.

[34]  Mecit Cetin,et al.  Short-Term Traffic Flow Prediction with Regime Switching Models , 2006 .

[35]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[36]  Liang Zheng,et al.  A tensor-based K-nearest neighbors method for traffic speed prediction under data missing , 2020 .

[37]  Rama Chellappa,et al.  HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.