A Deep Spatial-Temporal Network for Vehicle Trajectory Prediction

To plan travel routes reasonably and alleviate traffic congestion effectively, trajectory prediction of vehicles plays an important and necessary role in intelligent transportation. This paper presents a deep spatial-temporal network for long-term trajectory prediction of vehicles. Our network mainly includes the spatial layer, the temporal layer and local-global estimation layer. The spatial layer uses dilated convolution to build a long distance location convolution that functions as calculating the spatial features of trajectories. In the temporal layer, temporal prediction employs the Temporal Convolutional Network (TCN) for the first time to calculate deep spatial-temporal features in the process of prediction. The traditional linear method is replaced by special global-local estimation layer in order to improve accuracy of prediction. The NGSIM US-101 and GeoLife data sets are used for training and evaluation of experiments which contain 17,621 trajectories with a total distance of more than 1.2 million km. As results show, compared with other existing prediction network models, our network can produce almost the same short-term prediction results and has higher accuracy in long-term trajectory prediction.

[1]  Sang-Sun Lee,et al.  Long-term prediction of vehicle trajectory based on a deep neural network , 2017, 2017 International Conference on Information and Communication Technology Convergence (ICTC).

[2]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[3]  Keisuke Nemoto,et al.  Effective Use of Dilated Convolutions for Segmenting Small Object Instances in Remote Sensing Imagery , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Yu Zheng,et al.  Trajectory Data Mining , 2015, ACM Trans. Intell. Syst. Technol..

[5]  Lars Ruthotto,et al.  Layer-Parallel Training of Deep Residual Neural Networks , 2018, SIAM J. Math. Data Sci..

[6]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[7]  Christoph Hermes,et al.  Long-term vehicle motion prediction , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[8]  Gregory D. Hager,et al.  Temporal Convolutional Networks for Action Segmentation and Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  Mohan M. Trivedi,et al.  How Would Surround Vehicles Move? A Unified Framework for Maneuver Classification and Motion Prediction , 2018, IEEE Transactions on Intelligent Vehicles.

[11]  Xing Xie,et al.  GeoLife: A Collaborative Social Networking Service among User, Location and Trajectory , 2010, IEEE Data Eng. Bull..

[12]  Véronique Berge-Cherfaoui,et al.  Vehicle trajectory prediction based on motion model and maneuver recognition , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Lin Chang,et al.  Trajectory Prediction of Vehicles Based on Deep Learning , 2019, 2019 4th International Conference on Intelligent Transportation Engineering (ICITE).

[14]  Chung Choo Chung,et al.  Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecture , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[15]  Mohan M. Trivedi,et al.  Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[16]  Yuhao Wang,et al.  A deep learning algorithm using a fully connected sparse autoencoder neural network for landslide susceptibility prediction , 2019, Landslides.

[17]  Shanjun Li,et al.  The Marginal Cost of Traffic Congestion and Road Pricing: Evidence from a Natural Experiment in Beijing , 2020 .

[18]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[19]  Jia Wu,et al.  Vehicle trajectory prediction algorithm in vehicular network , 2019, Wirel. Networks.

[20]  Max Mulder,et al.  A Machine Learning Approach to Trajectory Prediction , 2013 .

[21]  Wolfgang Maass,et al.  Classifying Images with Few Spikes per Neuron , 2020, ArXiv.

[22]  Wei Cao,et al.  When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks , 2018, AAAI.

[23]  James Bremer,et al.  Fast algorithms for the multi-dimensional Jacobi polynomial transform , 2019, Applied and Computational Harmonic Analysis.

[24]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[25]  Atsushi Yamashita,et al.  Lane-Change Detection Based on Vehicle-Trajectory Prediction , 2017, IEEE Robotics and Automation Letters.

[26]  Chung Choo Chung,et al.  Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[27]  Zhiheng Li,et al.  Modeling Vehicle Interactions via Modified LSTM Models for Trajectory Prediction , 2019, IEEE Access.