Deep Learning to Scale up Time Series Traffic Prediction

The transport literature is dense regarding short-term traffic predictions, up to the scale of 1 hour, yet less dense for long-term traffic predictions. The transport literature is also sparse when it comes to city-scale traffic predictions, mainly because of low data availability. The main question we try to answer in this work is to which extent the approaches used for short-term prediction at a link level can be scaled up for long-term prediction at a city scale. We investigate a city-scale traffic dataset with 14 weeks of speed observations collected every 15 minutes over 1098 segments in the hypercenter of Los Angeles, California. We look at a variety of state-of-the-art machine learning and deep learning predictors for link-based predictions, and investigate ways to make such predictors scale up for larger areas, with brute force, clustering, and model design approaches. In particular we propose a novel deep learning spatio-temporal predictor inspired from recent works on recommender systems. We discuss the potential of including spatio-temporal features into the predictors, and conclude that modelling such features can be helpful for long-term predictions, while simpler predictors achieve very satisfactory performance for link-based and short-term forecasting. The trade-off is discussed not only in terms of prediction accuracy vs prediction horizon but also in terms of training time and model sizing.

[1]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  K. P. Soman,et al.  Applying deep learning approaches for network traffic prediction , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[4]  Xiqun Chen,et al.  Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach , 2017, ArXiv.

[5]  Haitham Al-Deek,et al.  Predictions of Freeway Traffic Speeds and Volumes Using Vector Autoregressive Models , 2009, J. Intell. Transp. Syst..

[6]  Li Li,et al.  Robust causal dependence mining in big data network and its application to traffic flow predictions , 2015 .

[7]  Martin Treiber,et al.  Traffic Flow Dynamics , 2013 .

[8]  Katsuhiro Nishinari,et al.  Traffic Flow Dynamics: Data, Models and Simulation , 2014 .

[9]  Guy Leshem,et al.  Traffic Flow Prediction using Adaboost Algorithm with Random Forests as a Weak Learner , 2007 .

[10]  Dimitrios Mavroeidis,et al.  Spatiotemporal Clustering of Urban Networks , 2015 .

[11]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[12]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[13]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[15]  I. Zurbenko The spectral analysis of time series , 1986 .

[16]  Kevin Heaslip,et al.  Inferring transportation modes from GPS trajectories using a convolutional neural network , 2018, ArXiv.

[17]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[18]  Anthony L Bertapelle Spectral Analysis of Time Series. , 1979 .

[19]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[20]  Anestis Antoniadis,et al.  Clustering Functional Data using Wavelets , 2010, Int. J. Wavelets Multiresolution Inf. Process..

[21]  Yanru Zhang,et al.  A gradient boosting method to improve travel time prediction , 2015 .

[22]  Xiaolin Hu,et al.  Recurrent convolutional neural network for object recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  A. Bayen,et al.  A traffic model for velocity data assimilation , 2010 .

[24]  Jin Wang,et al.  Short-term traffic speed forecasting hybrid model based on Chaos–Wavelet Analysis-Support Vector Machine theory , 2013 .

[25]  Lelitha Vanajakshi,et al.  Short-term traffic flow prediction using seasonal ARIMA model with limited input data , 2015, European Transport Research Review.

[26]  Petros A. Ioannou,et al.  Traffic Flow Prediction for Road Transportation Networks With Limited Traffic Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[28]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[29]  Alexandre M. Bayen,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Learning the Dynamics of Arterial Traffic From Probe , 2022 .

[30]  D. T. Lee,et al.  Travel-time prediction with support vector regression , 2004, IEEE Transactions on Intelligent Transportation Systems.

[31]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[33]  Billy M. Williams,et al.  Comparison of parametric and nonparametric models for traffic flow forecasting , 2002 .

[34]  Loo Hay Lee,et al.  Enhancing transportation systems via deep learning: A survey , 2019, Transportation Research Part C: Emerging Technologies.

[35]  Na Zhang,et al.  Wavelet-HST: A Wavelet-Based Higher-Order Spatio-Temporal Framework for Urban Traffic Speed Prediction , 2019, IEEE Access.

[36]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[37]  Chong-Ho Choi,et al.  Input feature selection for classification problems , 2002, IEEE Trans. Neural Networks.

[38]  Albert-László Barabási,et al.  Limits of Predictability in Human Mobility , 2010, Science.

[39]  Ludovic Leclercq,et al.  Revealing the day-to-day regularity of urban congestion patterns with 3D speed maps , 2017, Scientific Reports.

[40]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[41]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[42]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[43]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[44]  Li Li,et al.  Mining for Similarities in Urban Traffic Flow Using Wavelets , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[45]  Eric Bouillet,et al.  Predicting arrival times of buses using real-time GPS measurements , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[46]  Yunxiang Liu,et al.  Prediction of Road Traffic Congestion Based on Random Forest , 2017, 2017 10th International Symposium on Computational Intelligence and Design (ISCID).

[47]  Matthew G. Karlaftis,et al.  A multivariate state space approach for urban traffic flow modeling and prediction , 2003 .

[48]  Jian Wang,et al.  Construction of traffic state vector using mutual information for short-term traffic flow prediction , 2018, Transportation Research Part C: Emerging Technologies.

[49]  Carlos Alzate,et al.  Improved Electricity Load Forecasting via Kernel Spectral Clustering of Smart Meters , 2013, 2013 IEEE 13th International Conference on Data Mining.

[50]  Hai Le Vu,et al.  An effective spatial-temporal attention based neural network for traffic flow prediction , 2019, Transportation Research Part C: Emerging Technologies.

[51]  Biswajit Basu,et al.  Multivariate Short-Term Traffic Flow Forecasting Using Time-Series Analysis , 2009, IEEE Transactions on Intelligent Transportation Systems.

[52]  F. Dominici,et al.  On the use of generalized additive models in time-series studies of air pollution and health. , 2002, American journal of epidemiology.

[53]  Andrea Simonetto,et al.  Real-time city-scale ridesharing via linear assignment problems , 2019, Transportation Research Part C: Emerging Technologies.

[54]  Y. Kamarianakis,et al.  Forecasting Traffic Flow Conditions in an Urban Network: Comparison of Multivariate and Univariate Approaches , 2003 .

[55]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[56]  Jürgen Schmidhuber,et al.  Applying LSTM to Time Series Predictable through Time-Window Approaches , 2000, ICANN.

[57]  Wanli Min,et al.  Real-time road traffic prediction with spatio-temporal correlations , 2011 .

[58]  Tao Tang,et al.  Big Data Analytics in Intelligent Transportation Systems: A Survey , 2019, IEEE Transactions on Intelligent Transportation Systems.