Modeling Spatial-Temporal Dynamics for Traffic Prediction

Spatial-temporal prediction has many applications such as climate forecasting and urban planning. In particular, traffic prediction has drawn increasing attention in data mining research field for the growing traffic related datasets and for its impacts in real-world applications. For example, an accurate taxi demand prediction can assist taxi companies to pre-allocate taxis to meet with commuting demands. The key challenge of traffic prediction lies in how to model the complex spatial and temporal dependencies. In this paper, we make two important observations which have not been considered by previous studies: (1) the spatial dependency between locations are dynamic; and (2) the temporal dependency follows strong periodicity but is not strictly periodic for its dynamic temporal shifting. Based on these two observations, we propose a novel Spatial-Temporal Dynamic Network (STDN) framework. In this framework, we propose a flow gating mechanism to learn the dynamic similarity between locations via traffic flow. A periodically shifted attention mechanism is designed to handle long-term periodic dependency and periodic temporal shifting. Furthermore, we extend our framework from region-based traffic prediction to traffic prediction for road intersections by using graph convolutional structure. We conduct extensive experiments on several large-scale real traffic datasets and demonstrate the effectiveness of our approach over state-of-the-art methods.

[1]  Zhaohui Wu,et al.  Prediction of urban human mobility using large-scale taxi traces and its applications , 2012, Frontiers of Computer Science.

[2]  Jie Wang,et al.  Taxi Call Prediction for Online Taxicab Platforms , 2017, APWeb/WAIM Workshops.

[3]  Xiqun Chen,et al.  Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach , 2017, ArXiv.

[4]  Paolo Frasconi,et al.  Short-Term Traffic Flow Forecasting: An Experimental Comparison of Time-Series Analysis and Supervised Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[7]  Hao Ma,et al.  GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs , 2018, UAI.

[8]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[9]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[10]  Yinhai Wang,et al.  Deep Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2017 .

[11]  Xiuwen Yi,et al.  DNN-based prediction model for spatio-temporal data , 2016, SIGSPATIAL/GIS.

[12]  Wei Cao,et al.  DeepSD: Supply-Demand Prediction for Online Car-Hailing Services Using Deep Neural Networks , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[13]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[14]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[15]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Masashi Sugiyama,et al.  Trajectory Regression on Road Networks , 2011, AAAI.

[19]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[20]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[22]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[23]  Ugur Demiryurek,et al.  Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting , 2017, SDM.

[24]  Billy M. Williams,et al.  Adaptive Seasonal Time Series Models for Forecasting Short-Term Traffic Flow , 2007 .

[25]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[26]  Jie Xu,et al.  ZEST: A Hybrid Model on Predicting Passenger Demand for Chauffeured Car Service , 2016, CIKM.

[27]  Wei Xu,et al.  DeepTransport: Learning Spatial-Temporal Dependency for Traffic Condition Forecasting , 2017, 2018 International Joint Conference on Neural Networks (IJCNN).

[28]  Fei Wu,et al.  Interpreting traffic dynamics using ubiquitous urban data , 2016, SIGSPATIAL/GIS.

[29]  João Gama,et al.  Predicting Taxi–Passenger Demand Using Streaming Data , 2013, IEEE Transactions on Intelligent Transportation Systems.

[30]  Linpeng Huang,et al.  Predicting Multi-step Citywide Passenger Demands Using Attention-based Neural Networks , 2018, WSDM.

[31]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[32]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[33]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[34]  Jieping Ye,et al.  The Simpler The Better: A Unified Approach to Predicting Original Taxi Demands based on Large-Scale Online Platforms , 2017, KDD.

[35]  Ugur Demiryurek,et al.  Utilizing Real-World Transportation Data for Accurate Traffic Prediction , 2012, 2012 IEEE 12th International Conference on Data Mining.

[36]  Lionel M. Ni,et al.  Time-Dependent Trajectory Regression on Road Networks via Multi-Task Learning , 2013, AAAI.

[37]  Bin Yu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017 .

[38]  Ugur Demiryurek,et al.  Latent Space Model for Road Networks to Predict Time-Varying Traffic , 2016, KDD.

[39]  Gao Cong,et al.  Periodic-CRN: A Convolutional Recurrent Model for Crowd Density Prediction with Recurring Periodic Patterns , 2018, IJCAI.