DAPred: Dynamic Attention Location Prediction with Long-Short Term Movement Regularity

Predicting users’ future locations has become an important task in various aspects, such as ride-sharing, tourism recommendation and urban planning. However, existing methods disregard that users’ interest over next location is dynamic. The dynamic preference over next location involves two aspects: First, preference over distance is dynamic when users move; Second, preference over related terms vary on different target times. Hence, directly predicting next location with static network would result in unsatisfactory accuracies. Dynamic attention location prediction problem is still open now. We propose a multilayer recurrent attention model DAPred to solve the problem. The effectiveness of DAPred is underpinned by the following reasons: (1) An embedding recurrent module to map history movements into latent place, which helps build the attention module for the following layers; (2) A historical attention module that detects multiple distance preference from dynamic movement history; (3) A prediction module for learning different weights on different time gaps. Compared to the state-of-art baselines, DAPred reaches 49.8% improvement in hitting ratio accuracy, and 18.5% improvement in average distance predictor error on three real-

[1]  Chao Zhang,et al.  SERM: A Recurrent Model for Next Location Prediction in Semantic Trajectories , 2017, CIKM.

[2]  Wei Zhang,et al.  PRED: Periodic Region Detection for Mobility Modeling of Social Media Users , 2017, WSDM.

[3]  Shaohan Hu,et al.  DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing , 2016, WWW.

[4]  Zhe Zhu,et al.  What's Your Next Move: User Activity Prediction in Location-based Social Networks , 2013, SDM.

[5]  Cecilia Mascolo,et al.  Mining User Mobility Features for Next Place Prediction in Location-Based Services , 2012, 2012 IEEE 12th International Conference on Data Mining.

[6]  Philippe C. Besse,et al.  Destination Prediction by Trajectory Distribution-Based Model , 2016, IEEE Transactions on Intelligent Transportation Systems.

[7]  Marc-Olivier Killijian,et al.  Next place prediction using mobility Markov chains , 2012, MPM '12.

[8]  Xiaohui Yu,et al.  NLPMM: A Next Location Predictor with Markov Modeling , 2014, PAKDD.

[9]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.

[10]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[11]  Nicholas Jing Yuan,et al.  CEPR: A Collaborative Exploration and Periodically Returning Model for Location Prediction , 2015 .

[12]  Lidan Shou,et al.  Splitter: Mining Fine-Grained Sequential Patterns in Semantic Trajectories , 2014, Proc. VLDB Endow..

[13]  Anna Monreale,et al.  WhereNext: a location predictor on trajectory pattern mining , 2009, KDD.

[14]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[15]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[16]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[17]  Martial Hebert,et al.  Learning and Predicting Moving Object Trajectory: A Piecewise Trajectory Segment Approach , 2006 .

[18]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[19]  Liang Wang,et al.  Context-Aware Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[20]  Bruno Martins,et al.  Predicting future locations with hidden Markov models , 2012, UbiComp.

[21]  Luming Zhang,et al.  GMove: Group-Level Mobility Modeling Using Geo-Tagged Social Media , 2016, KDD.

[22]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[23]  Zhiyuan Liu,et al.  A Neural Network Approach to Joint Modeling Social Networks and Mobile Trajectories , 2016, ArXiv.

[24]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[25]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[26]  Nadia Magnenat-Thalmann,et al.  Who, where, when and what: discover spatio-temporal topics for twitter users , 2013, KDD.

[27]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.