Geography-Aware Sequential Location Recommendation

Sequential location recommendation plays an important role in many applications such as mobility prediction, route planning and location-based advertisements. In spite of evolving from tensor factorization to RNN-based neural networks, existing methods did not make effective use of geographical information and suffered from the sparsity issue. To this end, we propose a Geography-aware sequential recommender based on the Self-Attention Network (GeoSAN for short) for location recommendation. On the one hand, we propose a new loss function based on importance sampling for optimization, to address the sparsity issue by emphasizing the use of informative negative samples. On the other hand, to make better use of geographical information, GeoSAN represents the hierarchical gridding of each GPS point with a self-attention based geography encoder. Moreover, we put forward geography-aware negative samplers to promote the informativeness of negative samples. We evaluate the proposed algorithm with three real-world LBSN datasets, and show that GeoSAN outperforms the state-of-the-art sequential location recommenders by 34.9%. The experimental results further verify significant effectiveness of the new loss function, geography encoder, and geography-aware negative samplers.

[1]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.

[2]  Michael R. Lyu,et al.  Fused Matrix Factorization with Geographical and Social Influence in Location-Based Social Networks , 2012, AAAI.

[3]  Xing Xie,et al.  GeoMF++: Scalable Location Recommendation via Joint Geographical Modeling and Matrix Factorization , 2018, TOIS.

[4]  Enhong Chen,et al.  Personalized Ranking with Importance Sampling , 2020, WWW.

[5]  Yujie Wang,et al.  Time Interval Aware Self-Attention for Sequential Recommendation , 2020, WSDM.

[6]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[7]  Alexander J. Smola,et al.  Maximum Margin Matrix Factorization for Collaborative Ranking , 2007 .

[8]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[9]  Lina Yao,et al.  Next Item Recommendation with Self-Attention , 2018, ArXiv.

[10]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.

[11]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[12]  Enhong Chen,et al.  Graph Convolutional Networks on User Mobility Heterogeneous Graphs for Social Relationship Inference , 2019, IJCAI.

[13]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[14]  Hui Xiong,et al.  Learning geographical preferences for point-of-interest recommendation , 2013, KDD.

[15]  Liang Wang,et al.  Distance2Pre: Personalized Spatial Preference for Next Point-of-Interest Prediction , 2019, PAKDD.

[16]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[17]  Bo An,et al.  POI2Vec: Geographical Latent Representation for Predicting Future Visitors , 2017, AAAI.

[18]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[19]  Zhiyuan Liu,et al.  A Neural Network Approach to Joint Modeling Social Networks and Mobile Trajectories , 2016, ArXiv.

[20]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[21]  Fuzhen Zhuang,et al.  Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation , 2019, AAAI.

[22]  Chi-Yin Chow,et al.  iGeoRec: A Personalized and Efficient Geographical Location Recommendation Framework , 2015, IEEE Transactions on Services Computing.

[23]  Chi-Yin Chow,et al.  iGSLR: personalized geo-social location recommendation: a kernel density estimation approach , 2013, SIGSPATIAL/GIS.

[24]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[25]  Xing Xie,et al.  Collaborative filtering meets next check-in location prediction , 2013, WWW.

[26]  Chaoming Song,et al.  Modelling the scaling properties of human mobility , 2010, 1010.0436.

[27]  Albert-László Barabási,et al.  Understanding individual human mobility patterns , 2008, Nature.

[28]  Albert-László Barabási,et al.  Limits of Predictability in Human Mobility , 2010, Science.

[29]  Xing Xie,et al.  Analyzing Location Predictability on Location-Based Social Networks , 2014, PAKDD.

[30]  Quan Z. Sheng,et al.  A Survey on Session-based Recommender Systems , 2019, ArXiv.

[31]  Yanmin Zhu,et al.  Next Point-of-Interest Recommendation with Temporal and Multi-level Context Attention , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[32]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[33]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[34]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[35]  Yifeng Zeng,et al.  Personalized Ranking Metric Embedding for Next New POI Recommendation , 2015, IJCAI.

[36]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[37]  Nicholas Jing Yuan,et al.  Scalable Content-Aware Collaborative Filtering for Location Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[38]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[39]  Xing Xie,et al.  GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation , 2014, KDD.

[40]  Philippe Cudré-Mauroux,et al.  Revisiting User Mobility and Social Relationships in LBSNs: A Hypergraph Embedding Approach , 2019, WWW.