Incorporating Graph Attention and Recurrent Architectures for City-Wide Taxi Demand Prediction

Taxi demand prediction is one of the key factors in making online taxi hailing services more successful and more popular. Accurate taxi demand prediction can bring various advantages including, but not limited to, enhancing user experience, increasing taxi utilization, and optimizing traffic efficiency. However, the task is challenging because of complex spatial and temporal dependencies of taxi demand. In addition, relationships between non-adjacent regions are also critical for accurate taxi demand prediction, whereas they are largely ignored by existing approaches. To this end, we propose a novel graph and time-series learning model for city-wide taxi demand prediction in this paper. It has two main building blocks, the first one utilize a graph network with attention mechanism to effectively learn spatial dependencies of taxi demand in a broader perspective of the entire city, and the output at each time interval is then transferred to the second block. In the graph network, the edge is defined by an Origin–Destination relation to capture non-adjacent impacts. The second one uses a neural network which is adept with processing sequence data to capture the temporal correlations of city-wide taxi demand. Using a large, real-world dataset and three metrics, we conduct an extensive experimental study and find that our model outperforms state-of-the-art baselines by 9.3% in terms of the root-mean-square error.

[1]  Huanxin Zou,et al.  Toward Fast and Accurate Vehicle Detection in Aerial Images Using Coupled Region-Based Convolutional Neural Networks , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Xiqun Chen,et al.  Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach , 2017, ArXiv.

[3]  Ugur Demiryurek,et al.  Latent Space Model for Road Networks to Predict Time-Varying Traffic , 2016, KDD.

[4]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[5]  Naoto Mukai,et al.  Taxi Demand Forecasting Based on Taxi Probe Data by Neural Network , 2012, IIMSS.

[6]  Kai Zhao,et al.  Predicting taxi demand at high spatial resolution: Approaching the limit of predictability , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[7]  Kai Zhang,et al.  A Framework for Passengers Demand Prediction and Recommendation , 2016, 2016 IEEE International Conference on Services Computing (SCC).

[8]  Francisco C. Pereira,et al.  Combining time-series and textual data for taxi demand prediction in event areas: a deep learning approach , 2018, Inf. Fusion.

[9]  Zijian Liu,et al.  Short-Term Prediction of Passenger Demand in Multi-Zone Level: Temporal Convolutional Neural Network With Multi-Task Learning , 2020, IEEE Transactions on Intelligent Transportation Systems.

[10]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[11]  Jun Xu,et al.  Real-Time Prediction of Taxi Demand Using Recurrent Neural Networks , 2018, IEEE Transactions on Intelligent Transportation Systems.

[12]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[13]  K. W. Cattermole The Fourier Transform and its Applications , 1965 .

[14]  Jieping Ye,et al.  The Simpler The Better: A Unified Approach to Predicting Original Taxi Demands based on Large-Scale Online Platforms , 2017, KDD.

[15]  Hao Wang,et al.  Rethinking Knowledge Graph Propagation for Zero-Shot Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Krishna P. Jagannathan,et al.  A multi-level clustering approach for forecasting taxi travel demand , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[17]  Emilio Frazzoli,et al.  Toward a Systematic Approach to the Design and Evaluation of Automated Mobility-on-Demand Systems: A Case Study in Singapore , 2014 .

[18]  Zhaohui Wu,et al.  Prediction of urban human mobility using large-scale taxi traces and its applications , 2012, Frontiers of Computer Science.

[19]  Farid Javanshour,et al.  Exploring System Characteristics of Autonomous Mobility On-Demand Systems Under Varying Travel Demand Patterns , 2019 .

[20]  M. W Gardner,et al.  Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences , 1998 .

[21]  Xinwu Qian,et al.  Forecasting short-term taxi demand using boosting-GCRF , 2017 .

[22]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[23]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[24]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[25]  Shilin Zhou,et al.  Learning Deep Ship Detector in SAR Images From Scratch , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[26]  João Gama,et al.  Predicting Taxi–Passenger Demand Using Streaming Data , 2013, IEEE Transactions on Intelligent Transportation Systems.

[27]  Emilio Frazzoli,et al.  Robotic load balancing for mobility-on-demand systems , 2012, Int. J. Robotics Res..

[28]  P. Santi,et al.  Addressing the minimum fleet problem in on-demand urban mobility , 2018, Nature.

[29]  Hao Ma,et al.  GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs , 2018, UAI.

[30]  Cao Xiao,et al.  FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling , 2018, ICLR.

[31]  Krishna P. Jagannathan,et al.  Grids versus Graphs: Partitioning Space for Improved Taxi Demand-Supply Forecasts , 2019, ArXiv.

[32]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[33]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[34]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[35]  S. Ukkusuri,et al.  Spatial variation of the urban taxi ridership using GPS data , 2015 .

[36]  Ee-Peng Lim,et al.  Where are the passengers?: a grid-based gaussian mixture model for taxi bookings , 2015, SIGSPATIAL/GIS.

[37]  Le Song,et al.  Stochastic Training of Graph Convolutional Networks with Variance Reduction , 2017, ICML.

[38]  P. Vandergheynst,et al.  Accelerated filtering on graphs using Lanczos method , 2015, 1509.04537.

[39]  Rung-Ching Chen,et al.  A novel passenger flow prediction model using deep learning methods , 2017 .

[40]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[41]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[42]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[43]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[44]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[45]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[46]  G. Duncan,et al.  Exploring the performance of autonomous mobility on-demand systems under demand uncertainty , 2018, Transportmetrica A: Transport Science.

[47]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[48]  James M. Lucas,et al.  Exponentially weighted moving average control schemes: Properties and enhancements , 1990 .

[49]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[50]  Yu Zheng,et al.  Citywide Bike Usage Prediction in a Bike-Sharing System , 2020, IEEE Transactions on Knowledge and Data Engineering.

[51]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[52]  Liang Lin,et al.  Contextualized Spatial–Temporal Network for Taxi Origin-Destination Demand Prediction , 2019, IEEE Transactions on Intelligent Transportation Systems.

[53]  S. W. Roberts Control chart tests based on geometric moving averages , 2000 .

[54]  Jimeng Sun,et al.  Querying about the past, the present, and the future in spatio-temporal databases , 2004, Proceedings. 20th International Conference on Data Engineering.

[55]  Junzhou Huang,et al.  Adaptive Sampling Towards Fast Graph Representation Learning , 2018, NeurIPS.

[56]  Wei Chen,et al.  A deep learning approach on short-term spatiotemporal distribution forecasting of dockless bike-sharing system , 2018, Neural Computing and Applications.

[57]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[58]  Mohsen Ramezani,et al.  Revealing latent characteristics of mobility networks with coarse-graining , 2019, Scientific Reports.

[59]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[60]  Wei Cao,et al.  DeepSD: Supply-Demand Prediction for Online Car-Hailing Services Using Deep Neural Networks , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[61]  Linpeng Huang,et al.  Predicting Multi-step Citywide Passenger Demands Using Attention-based Neural Networks , 2018, WSDM.

[62]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[63]  知秀 柴田 5分で分かる!? 有名論文ナナメ読み:Jacob Devlin et al. : BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding , 2020 .