LSI-LSTM: An attention-aware LSTM for real-time driving destination prediction by considering location semantics and location importance of trajectory points

Abstract Individual driving final destination prediction supports location-based services such as personalized service recommendations, traffic navigation, and public transport dispatching. However, real-time destination prediction is challenging due to the complexity of temporal dependencies, and the strong influence of travel spatiotemporal semantics and spatial correlations. Besides temporal context, the nearby urban functionalities of traveling zones and departure regions, and the crucial positions on the road network where trajectory points located would reflect the travel intentions of drivers. However, these spatial factors are rarely considered in existing studies. To fill this gap, we propose a real-time individual driving destination prediction model LSI-LSTM based on an attention-aware Long Short-Term Memory (LSTM) by taking Location Semantics and Location Importance of trajectory points into account. More specifically, a trajectory location semantics extraction method (t-LSE) enriches feature description with prior knowledge for implicit travel intentions learning. t-LSE represents urban functionality through Points of Interest (POIs) using Term Frequency-Inverse Document Frequency (TF-IDF). Meanwhile, a novel trajectory spatial attention mechanism (t-SAM) captures the trajectory points that strongly correlate to candidate destinations based on the location importance inferred from the driving status, i.e., turning angle, driving speed, and traveled distance. Comparative experiments with three baseline methods, i.e., Hidden Markov Model, Random Forest, and LSTM, demonstrate significant prediction accuracy improvements of LSI-LSTM on four individual trajectory datasets. Further analyses validate the effectiveness of the proposed semantic extraction method and attention mechanism, and also discuss the factors that may affect the prediction results.

[1]  Raja Sengupta,et al.  Predicting driver destination using machine learning techniques , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[2]  Yi Zhao,et al.  Semantic trajectory compression via multi-resolution synchronization-based clustering , 2019, Knowl. Based Syst..

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Yandong Wang,et al.  Using Spatial Semantics and Interactions to Identify Urban Functional Regions , 2018, ISPRS Int. J. Geo Inf..

[5]  Luis González Abril,et al.  Trip destination prediction based on past GPS log using a Hidden Markov Model , 2010, Expert Syst. Appl..

[6]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[7]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[8]  Yajie Zou,et al.  A space–time diurnal method for short-term freeway travel time prediction , 2014 .

[9]  I. Maqsood,et al.  Random Forests and Decision Trees , 2012 .

[10]  Xing Xie,et al.  Inferring social ties between users with human location history , 2014, J. Ambient Intell. Humaniz. Comput..

[11]  Thad Starner,et al.  Using GPS to learn significant locations and predict movement across multiple users , 2003, Personal and Ubiquitous Computing.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Feng Zhu,et al.  On Prediction of User Destination by Sub-Trajectory Understanding: A Deep Learning based Approach , 2018, CIKM.

[14]  Vania Bogorny,et al.  Multidimensional Similarity Measuring for Semantic Trajectories , 2016, Trans. GIS.

[15]  Wang-Chien Lee,et al.  Semantic trajectory mining for location prediction , 2011, GIS.

[16]  Xing Xie,et al.  Destination prediction by sub-trajectory synthesis and privacy protection against such prediction , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[17]  Qing Li,et al.  T-CONV: A Convolutional Neural Network for Multi-scale Taxi Trajectory Prediction , 2016, 2018 IEEE International Conference on Big Data and Smart Computing (BigComp).

[18]  Liu Yang,et al.  Inferring demographics from human trajectories and geographical context , 2019, Comput. Environ. Urban Syst..

[19]  Ge Cui,et al.  Anomalous Urban Mobility Pattern Detection Based on GPS Trajectories and POI Data , 2019, ISPRS Int. J. Geo Inf..

[20]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[21]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[22]  Ling Chen,et al.  The discovery of personally semantic places based on trajectory data mining , 2016, Neurocomputing.

[23]  Haris N. Koutsopoulos,et al.  Measuring Regularity of Individual Travel Patterns , 2018, IEEE Transactions on Intelligent Transportation Systems.

[24]  Han Su,et al.  CrowdPlanner: A Crowd-Based Route Recommendation System , 2013, ArXiv.

[25]  Chao Zhang,et al.  SERM: A Recurrent Model for Next Location Prediction in Semantic Trajectories , 2017, CIKM.

[26]  Xing Xie,et al.  Solving the data sparsity problem in destination prediction , 2015, The VLDB Journal.

[27]  Satish V. Ukkusuri,et al.  Understanding urban human activity and mobility patterns using large-scale location-based data from online social media , 2013, UrbComp '13.

[28]  Robert Shorten,et al.  A hidden Markov model for route and destination prediction , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[29]  Pascal Vincent,et al.  Artificial Neural Networks Applied to Taxi Destination Prediction , 2015, DC@PKDD/ECML.

[30]  Xiang Li,et al.  T-DesP: Destination Prediction Based on Big Trajectory Data , 2016, IEEE Transactions on Intelligent Transportation Systems.

[31]  Tian Lan,et al.  Zooming into individuals to understand the collective: A review of trajectory-based travel behaviour studies , 2014 .

[32]  Tsutomu Terada,et al.  A destination prediction method using driving contexts and trajectory for car navigation systems , 2009, SAC '09.

[33]  Jinyan Li,et al.  Prediction of Taxi Destinations Using a Novel Data Embedding Method and Ensemble Learning , 2020, IEEE Transactions on Intelligent Transportation Systems.

[34]  Philippe C. Besse,et al.  Destination Prediction by Trajectory Distribution-Based Model , 2016, IEEE Transactions on Intelligent Transportation Systems.

[35]  Yi Long,et al.  Vehicle trajectory modelling with consideration of distant neighbouring dependencies for destination prediction , 2019, Int. J. Geogr. Inf. Sci..

[36]  Zhiguang Zhou,et al.  Visual Abstraction of Large Scale Geospatial Origin-Destination Movement Data , 2019, IEEE Transactions on Visualization and Computer Graphics.

[37]  Jin Fan,et al.  A Destination Prediction Network Based on Spatiotemporal Data for Bike-Sharing , 2019, Complex..

[38]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[39]  Yuanyuan Yang,et al.  When Urban Safety Index Inference Meets Location-Based Data , 2019, IEEE Transactions on Mobile Computing.

[40]  Wei Cao,et al.  When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks , 2018, AAAI.

[41]  Jianya Gong,et al.  A hierarchical temporal attention-based LSTM encoder-decoder model for individual mobility prediction , 2020, Neurocomputing.

[42]  Sunav Choudhary,et al.  An LSTM Based System for Prediction of Human Activities with Durations , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[43]  Francisco Dantas Nobre Neto,et al.  Combining Markov model and Prediction by Partial Matching compression technique for route and destination prediction , 2018, Knowl. Based Syst..

[44]  Jie Shao,et al.  Destination prediction using deep echo state network , 2020, Neurocomputing.

[45]  Robert Shorten,et al.  Bayesian classifier for Route prediction with Markov chains , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[46]  Zoubin Ghahramani,et al.  A Theoretically Grounded Application of Dropout in Recurrent Neural Networks , 2015, NIPS.