Multi-Scale and Multi-Scope Convolutional Neural Networks for Destination Prediction of Trajectories

Precise destination prediction from partial trajectories have a huge potential impact on intelligent location-based approaches. Traditional prediction approaches, which treat trajectories as one-dimensional sequences and process them in a single scale, fail to capture diverse and rich two-dimensional patterns of trajectories in different spatial scales. Meanwhile, most models treat each portion of a trajectory equally in terms of contributing to final destination prediction. This is in conflict with our observation that there exists some albeit small local areas playing much more important roles for destination prediction than the others. To address these problems, we propose a novel prediction algorithm T-CONV, which models trajectories as two-dimensional images, and then feed them into a convolutional neural network (CNN) architecture to extract multi-scale patterns for precise destination prediction. Furthermore, we propose a method to extract regions with different relevance for final output of T-CONV, and further explore the local patterns of important regions by integrating multi-scope local-enhancement areas based on attention mechanism. The comprehensive experiments based on two large-scale real taxi trajectory datasets show that T-CONV can achieve higher accuracy than the state-of-the-art methods, demonstrating the strength of the multi-scale and multi-scope feature extraction mechanisms in trajectory mining.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  Ling Chen,et al.  A system for destination and future route prediction based on trajectory mining , 2010, Pervasive Mob. Comput..

[3]  Xiang Li,et al.  T-DesP: Destination Prediction Based on Big Trajectory Data , 2016, IEEE Transactions on Intelligent Transportation Systems.

[4]  Xing Xie,et al.  T-drive: driving directions based on taxi trajectories , 2010, GIS '10.

[5]  Anind K. Dey,et al.  Navigate like a cabbie: probabilistic reasoning from observed context-aware behavior , 2008, UbiComp.

[6]  Xiaohui Yu,et al.  Predicting Next Locations with Object Clustering and Trajectory Clustering , 2015, PAKDD.

[7]  Jiebo Luo,et al.  Image Captioning with Semantic Attention , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xing Xie,et al.  Solving the data sparsity problem in destination prediction , 2015, The VLDB Journal.

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Eric Horvitz,et al.  Predestination: Inferring Destinations from Partial Trajectories , 2006, UbiComp.

[11]  Guangzhong Sun,et al.  Driving with knowledge from the physical world , 2011, KDD.

[12]  Philippe C. Besse,et al.  Destination Prediction by Trajectory Distribution-Based Model , 2016, IEEE Transactions on Intelligent Transportation Systems.

[13]  Luis González Abril,et al.  Trip destination prediction based on past GPS log using a Hidden Markov Model , 2010, Expert Syst. Appl..

[14]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[15]  Jong-Dae Kim,et al.  Path Prediction of Moving Objects on Road Networks Through Analyzing Past Trajectories , 2007, KES.

[16]  Yoshua Bengio,et al.  Describing Multimedia Content Using Attention-Based Encoder-Decoder Networks , 2015, IEEE Transactions on Multimedia.

[17]  Pascal Vincent,et al.  Artificial Neural Networks Applied to Taxi Destination Prediction , 2015, DC@PKDD/ECML.

[18]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[19]  Xing Xie,et al.  Destination prediction by sub-trajectory synthesis and privacy protection against such prediction , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[20]  Lei Zhang,et al.  Multi-features taxi destination prediction with frequency domain processing , 2018, PloS one.

[21]  Qing Li,et al.  T-CONV: A Convolutional Neural Network for Multi-scale Taxi Trajectory Prediction , 2016, 2018 IEEE International Conference on Big Data and Smart Computing (BigComp).

[22]  Jian Xu,et al.  Predicting next location using a variable order Markov model , 2014, IWGS.

[23]  Yu Zheng,et al.  Constructing popular routes from uncertain trajectories , 2012, KDD.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.