Spatial-Temporal Convolutional Graph Attention Networks for Citywide Traffic Flow Forecasting

Traffic flow prediction plays an important role in many spatial-temporal data applications, e.g., traffic management and urban planning. Various deep learning techniques are developed to model the traffic dynamic patterns with different neural network architectures, such as attention mechanism, recurrent neural network. However, two important challenges have yet to be well addressed: (i) Most of these methods solely focus on local spatial dependencies and ignore the global inter-region dependencies in terms of traffic distributions; (ii) It is important to capture channel-aware semantics when performing spatial-temporal information aggregation. To address these challenges, we propose a new traffic prediction framework--Spatial-Temporal Convolutional Graph Attention Network (ST-CGA), to enable the traffic prediction with the modeling of region dependencies, from locally to globally in a comprehensive manner. In our ST-CGA framework, we first develop a hierarchical attention networks with a graph-based neural architecture, to capture both the multi-level temporal relations and cross-region traffic dependencies. Furthermore, a region-wise spatial relation encoder is proposed to supercharge ST-CGA mapping spatial and temporal signals into different representation subspaces, with channel-aware recalibration residual network. Extensive experiments on four real-world datasets demonstrate that ST-CGA achieve substantial gains over many state-of-the-art baselines. Source codes are available at: https://github.com/shurexiyue/ST-CGA.

[1]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Nitesh V. Chawla,et al.  MiST: A Multiview and Multimodal Spatial-Temporal Learning Framework for Citywide Abnormal Event Forecasting , 2019, WWW.

[4]  Daqing Zhang,et al.  PrivCheck: privacy-preserving check-in data publishing for personalized location based services , 2016, UbiComp.

[5]  Junbo Zhang,et al.  Urban Traffic Prediction from Spatio-Temporal Data Using Deep Meta Learning , 2019, KDD.

[6]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[7]  Nitesh V. Chawla,et al.  DeepCrime: Attentive Hierarchical Recurrent Networks for Crime Prediction , 2018, CIKM.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Ugur Demiryurek,et al.  Utilizing Real-World Transportation Data for Accurate Traffic Prediction , 2012, 2012 IEEE 12th International Conference on Data Mining.

[10]  Chao Huang,et al.  Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network , 2020, SIGIR.

[11]  Nitesh V. Chawla,et al.  RESTFul: Resolution-Aware Forecasting of Behavioral Time Series Data , 2018, CIKM.

[12]  Ling Feng,et al.  A Context-aware Collaborative Filtering Approach for Urban Black Holes Detection , 2016, CIKM.

[13]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[14]  Tianbao Yang,et al.  Hetero-ConvLSTM: A Deep Learning Approach to Traffic Accident Prediction on Heterogeneous Spatio-Temporal Data , 2018, KDD.

[15]  Zhaohui Wu,et al.  Dynamic cluster-based over-demand prediction in bike sharing systems , 2016, UbiComp.

[16]  Nitesh V. Chawla,et al.  Online Purchase Prediction via Multi-Scale Modeling of Behavior Dynamics , 2019, KDD.

[17]  Lidia S. Chao,et al.  Leveraging Local and Global Patterns for Self-Attention Networks , 2019, ACL.

[18]  Gerd Kortuem,et al.  Reimagining the role of citizens in smart city projects , 2015, UbiComp/ISWC Adjunct.

[19]  Dipti Srinivasan,et al.  Computational intelligence-based congestion prediction for a dynamic urban street network , 2009, Neurocomputing.

[20]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Nicholas Jing Yuan,et al.  Sensing the Pulse of Urban Refueling Behavior , 2015, ACM Trans. Intell. Syst. Technol..

[22]  Ning Feng,et al.  Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting , 2019, AAAI.

[23]  Chao Huang,et al.  Where are you from: Home location profiling of crowd sensors from noisy and sparse crowdsourcing data , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[24]  Jieping Ye,et al.  Spatiotemporal Multi-Graph Convolution Network for Ride-Hailing Demand Forecasting , 2019, AAAI.

[25]  Ugur Demiryurek,et al.  Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting , 2017, SDM.

[26]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[27]  Xiuwen Yi,et al.  DNN-based prediction model for spatio-temporal data , 2016, SIGSPATIAL/GIS.

[28]  Yujie Wang,et al.  Time Interval Aware Self-Attention for Sequential Recommendation , 2020, WSDM.

[29]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[30]  David S. Rosenblum,et al.  UrbanFM: Inferring Fine-Grained Urban Flows , 2019, KDD.

[31]  Xing Wang,et al.  Context-Aware Self-Attention Networks , 2019, AAAI.

[32]  Xing Xie,et al.  Restaurant Survival Analysis with Heterogeneous Information , 2017, WWW.

[33]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[34]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[35]  Xianfeng Tang,et al.  Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction , 2018, AAAI.