Deep spatio-temporal residual neural networks for road-network-based data modeling

ABSTRACT Recently, researchers have introduced deep learning methods such as convolutional neural networks (CNN) to model spatio-temporal data and achieved better results than those with conventional methods. However, these CNN-based models employ a grid map to represent spatial data, which is unsuitable for road-network-based data. To address this problem, we propose a deep spatio-temporal residual neural network for road-network-based data modeling (DSTR-RNet). The proposed model constructs locally-connected neural network layers (LCNR) to model road network topology and integrates residual learning to model the spatio-temporal dependency. We test the DSTR-RNet by predicting the traffic flow of Didi cab service, in an 8-km2 region with 2,616 road segments in Chengdu, China. The results demonstrate that the DSTR-RNet maintains the spatial precision and topology of the road network as well as improves the prediction accuracy. We discuss the prediction errors and compare the prediction results to those of grid-based CNN models. We also explore the sensitivity of the model to its parameters; this will aid the application of this model to network-based data modeling.

[1]  Bin Jiang,et al.  Ranking spaces for predicting human movement in an urban environment , 2006, Int. J. Geogr. Inf. Sci..

[2]  Xia Li,et al.  Nonlinear Integration of Spatial and Temporal Forecasting by Support Vector Machines , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[3]  Xiang Li,et al.  T-DesP: Destination Prediction Based on Big Trajectory Data , 2016, IEEE Transactions on Intelligent Transportation Systems.

[4]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[5]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[6]  Geoff Boeing,et al.  OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networks , 2016, Comput. Environ. Urban Syst..

[7]  Diansheng Guo,et al.  Mapping Large Spatial Flow Data with Hierarchical Clustering , 2014, Trans. GIS.

[8]  David R. B. Stockwell,et al.  The GARP modelling system: problems and solutions to automated spatial prediction , 1999, Int. J. Geogr. Inf. Sci..

[9]  Jiaqiu Wang,et al.  A Dynamic Spatial Weight Matrix and Localized Space–Time Autoregressive Integrated Moving Average for Network Modeling , 2014 .

[10]  Tianrui Li,et al.  Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks , 2017, Artif. Intell..

[11]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[12]  Hao Wang,et al.  Static Memory Deduplication for Performance Optimization in Cloud Computing , 2017, Sensors.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[16]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[17]  Bin Jiang,et al.  Street‐based topological representations and analyses for predicting traffic flow in GIS , 2007, Int. J. Geogr. Inf. Sci..

[18]  Jiaqiu Wang,et al.  A space-time delay neural network model for travel time prediction , 2016, Eng. Appl. Artif. Intell..

[19]  Shane D. Johnson,et al.  Predictive Crime Mapping: Arbitrary Grids or Street Networks? , 2016, Journal of Quantitative Criminology.

[20]  John Krumm,et al.  Hidden Markov map matching through noise and sparseness , 2009, GIS.

[21]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[22]  Wei Huang,et al.  Predicting human mobility with activity changes , 2015, Int. J. Geogr. Inf. Sci..

[23]  Rich Caruana,et al.  Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping , 2000, NIPS.

[24]  Jiaqiu Wang,et al.  Accommodating spatial associations in DRNN for space-time analysis , 2009, Comput. Environ. Urban Syst..

[25]  Xiqun Chen,et al.  Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach , 2017, ArXiv.

[26]  Yang Zhang,et al.  A Deep Learning Approach to Infer Employment Status of Passengers by Using Smart Card Data , 2020, IEEE Transactions on Intelligent Transportation Systems.

[27]  Ambuj K. Singh,et al.  FCCF: forecasting citywide crowd flows based on big data , 2016, SIGSPATIAL/GIS.

[28]  Jiaqiu Wang,et al.  STARIMA for journey time prediction in London , 2010 .

[29]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[30]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[31]  Yunpeng Wang,et al.  Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks , 2017, Sensors.

[32]  Xinyue Ye,et al.  Editorial: human dynamics in the mobile and big data era , 2016, Int. J. Geogr. Inf. Sci..

[33]  Medha Tare,et al.  Free ‘Mini’ Groin Flap for Digital Resurfacing , 2009, The Journal of hand surgery, European volume.

[34]  Jiaqiu Wang,et al.  Spatio-temporal autocorrelation of road network data , 2012, J. Geogr. Syst..

[35]  Geoffrey E. Hinton Reducing the Dimensionality of Data with Neural , 2008 .

[36]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Zhenliang Ma,et al.  Predicting short-term bus passenger demand using a pattern hybrid approach , 2014 .

[39]  Jiaqiu Wang,et al.  Local online kernel ridge regression for forecasting of urban travel times , 2014 .

[40]  Xiuwen Yi,et al.  DNN-based prediction model for spatio-temporal data , 2016, SIGSPATIAL/GIS.

[41]  Tao Pei,et al.  Fine-grained prediction of urban population using mobile phone location data , 2018, Int. J. Geogr. Inf. Sci..

[42]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[43]  Jiaqiu Wang,et al.  Integrated Spatio‐temporal Data Mining for Forest Fire Prediction , 2008, Trans. GIS.