Learning Hierarchical Spatial Tasks with Visiting Relations for Next POI Recommendation

Sparsity is an established problem for the next Point-of-Interest (POI) recommendation task, where it hinders effective learning of user preferences from the User-POI matrix. However, learning multiple hierarchically related spatial tasks, and visiting relations between users and POIs, can help to alleviate this sparsity problem. In this paper, we propose our Hierarchical Multi-Task Graph Recurrent Network (HMT-GRN) approach, which alleviates the sparsity problem by learning different User-Region matrices of lower sparsities in a multi-task setting. We then perform a Hierarchical Beam Search (HBS) on the different region and POI distributions to hierarchically reduce the search space with increasing spatial granularity and predict the next POI. Our HBS provides efficiency gains by reducing the search space, resulting in speedups of 5 to 7 times over an exhaustive approach. In addition, we propose a selectivity layer to predict if the next POI has been visited before by the user to balance between personalization and exploration. Further, we propose a novel Joint Triplet Loss Learning (JTLL) module to learn visited and unvisited relations between users and POIs for the recommendation task. Experimental results on two real-world Location-Based Social Network (LBSN) datasets show that our proposed approach significantly outperforms baseline and the state-of-the-art methods. This work is an extension of “Hierarchical Multi-Task Graph Recurrent Network for Next POI Recommendation” [33], published at SIGIR ’22. In this work, we propose a novel Joint Triplet Loss Learning (JTLL) module to further alleviate the sparsity problem for improved performance.

[1]  Xiangwu Meng,et al.  Exploiting Category-Level Multiple Characteristics for POI Recommendation , 2023, IEEE Transactions on Knowledge and Data Engineering.

[2]  Yong Liang Goh,et al.  Hierarchical Multi-Task Graph Recurrent Network for Next POI Recommendation , 2022, SIGIR.

[3]  Yanmin Zhu,et al.  Learning Graph-based Disentangled Representations for Next POI Recommendation , 2022, SIGIR.

[4]  Xueming Qian,et al.  Personalized Long- and Short-term Preference Learning for Next POI Recommendation , 2022, IEEE Transactions on Knowledge and Data Engineering.

[5]  Ke Deng,et al.  SNPR: A Serendipity-Oriented Next POI Recommendation Model , 2021, CIKM.

[6]  Dongjin Yu,et al.  Attentive sequential model based on graph neural network for next poi recommendation , 2021, World Wide Web.

[7]  Yongjian Yang,et al.  Real-time POI recommendation via modeling long- and short-term user preferences , 2021, Neurocomputing.

[8]  Yi-Shu Lu,et al.  SPENT+: A Category- and Region-aware Successive POI Recommendation Model , 2021, 2021 22nd Asia-Pacific Network Operations and Management Symposium (APNOMS).

[9]  Li Li,et al.  Time-aware User Modeling with Check-in Time Prediction for Next POI Recommendation , 2021, 2021 IEEE International Conference on Web Services (ICWS).

[10]  Yudong Chen,et al.  Curriculum Meta-Learning for Next POI Recommendation , 2021, KDD.

[11]  Noseong Park,et al.  LightMove: A Lightweight Next-POI Recommendation forTaxicab Rooftop Advertising , 2021, CIKM.

[12]  Jiajie Xu,et al.  MFNP: A Meta-optimized Model for Few-shot Next POI Recommendation , 2021, IJCAI.

[13]  Daren Zha,et al.  Hierarchical and Multi-Resolution Preference Modeling for Next POI Recommendation , 2021, 2021 International Joint Conference on Neural Networks (IJCNN).

[14]  Hongzhi Yin,et al.  Discovering Collaborative Signals for Next POI Recommendation with Iterative Seq2Graph Augmentation , 2021, IJCAI.

[15]  Ling Chen,et al.  A multi-task embedding based personalized POI recommendation method , 2021, CCF Transactions on Pervasive Computing and Interaction.

[16]  Jiajie Xu,et al.  HOPE: a hybrid deep neural model for out-of-town next POI recommendation , 2021, World Wide Web.

[17]  Xuyun Zhang,et al.  An attention‐based category‐aware GRU model for the next POI recommendation , 2021, Int. J. Intell. Syst..

[18]  Yi Shen,et al.  A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis , 2021, AAAI.

[19]  Yong Liang Goh,et al.  Origin-Aware Next Destination Recommendation with Personalized Preference Attention , 2020, WSDM.

[20]  Jagannadan Varadarajan,et al.  STP-UDGAT: Spatial-Temporal-Preference User Dimensional Graph Attention Network for Next POI Recommendation , 2020, CIKM.

[21]  Bin Xia,et al.  MTPR: A Multi-Task Learning Based POI Recommendation Considering Temporal Check-Ins and Geographical Locations , 2020 .

[22]  Xing Xie,et al.  Geography-Aware Sequential Location Recommendation , 2020, KDD.

[23]  Gao Cong,et al.  HME: A Hyperbolic Metric Embedding Approach for Next-POI Recommendation , 2020, SIGIR.

[24]  Wei Guo,et al.  A Category-Aware Deep Model for Successive POI Recommendation on Sparse Check-in Data , 2020, WWW.

[25]  Quoc Viet Hung Nguyen,et al.  Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest Recommendation , 2020, AAAI.

[26]  Felix Klanner,et al.  Modeling hierarchical category transition for next POI recommendation with uncertain check-ins , 2020, Inf. Sci..

[27]  Bin Zhou,et al.  How Far are We from Effective Context Modeling ? An Exploratory Study on Semantic Parsing in Context , 2020, IJCAI.

[28]  Srinivasan Parthasarathy,et al.  EndCold: An End-to-End Framework for Cold Question Routing in Community Question Answering Services , 2019, IJCAI.

[29]  Xueming Qian,et al.  Long- and Short-term Preference Learning for Next POI Recommendation , 2019, CIKM.

[30]  Lishan Li,et al.  Multi-modal Representation Learning for Successive POI Recommendation , 2019, ACML.

[31]  Jing He,et al.  Next and Next New POI Recommendation via Latent Behavior Pattern Inference , 2019, ACM Trans. Inf. Syst..

[32]  Hui Xiong,et al.  Adversarial Substructured Representation Learning for Mobile User Profiling , 2019, KDD.

[33]  Yanjie Fu,et al.  Unifying Inter-region Autocorrelation and Intra-region Structures for Spatial Embedding via Collective Adversarial Learning , 2019, KDD.

[34]  Fuzhen Zhuang,et al.  Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation , 2019, AAAI.

[35]  Yutao Ma,et al.  An Attention-Based Spatiotemporal LSTM Network for Next POI Recommendation , 2019, IEEE Transactions on Services Computing.

[36]  Donghyeon Park,et al.  Content-Aware Hierarchical Point-of-Interest Embedding Model for Successive POI Recommendation , 2018, IJCAI.

[37]  Fei Wu,et al.  HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction , 2018, IJCAI.

[38]  Jing Li,et al.  Predicting Activity and Location with Multi-task Context Aware Recurrent Neural Network , 2018, IJCAI.

[39]  Razvan Pascanu,et al.  Hyperbolic Attention Networks , 2018, ICLR.

[40]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[41]  Kun Gai,et al.  Learning Tree-based Deep Model for Recommender Systems , 2018, KDD.

[42]  Chao Zhang,et al.  SERM: A Recurrent Model for Next Location Prediction in Semantic Trajectories , 2017, CIKM.

[43]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[44]  Lejian Liao,et al.  Category-aware Next Point-of-Interest Recommendation via Listwise Bayesian Personalized Ranking , 2017, IJCAI.

[45]  Xiangyang Luo,et al.  NEXT: a neural network framework for next POI recommendation , 2017, Frontiers of Computer Science.

[46]  Weitong Chen,et al.  Learning Graph-based POI Embedding for Location-based Recommendation , 2016, CIKM.

[47]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[48]  Lejian Liao,et al.  Inferring a Personalized Next Point-of-Interest Recommendation Model with Latent Behavior Patterns , 2016, AAAI.

[49]  Daqing Zhang,et al.  NationTelescope: Monitoring and visualizing large-scale collective behavior in LBSNs , 2015, J. Netw. Comput. Appl..

[50]  Yifeng Zeng,et al.  Personalized Ranking Metric Embedding for Next New POI Recommendation , 2015, IJCAI.

[51]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[53]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[54]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[55]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.

[56]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[57]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[58]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[59]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[60]  LiXin,et al.  CHA: Categorical Hierarchy-based Attention for Next POI Recommendation , 2021, ACM Trans. Inf. Syst..

[61]  Yu Wang,et al.  ADQ-GNN: Next POI Recommendation by Fusing GNN and Area Division with Quadtree , 2021, WISE.

[62]  Yue Cui Sequential-knowledge-aware Next POI Recommendation: A Meta-learning Approach , 2021 .

[63]  Junyu Dong,et al.  Personalized POI Recommendation: Spatio-Temporal Representation Learning with Social Tie , 2021, DASFAA.

[64]  Derong Shen,et al.  Next point-of-interest recommendation by sequential feature mining and public preference awareness , 2021, J. Intell. Fuzzy Syst..

[65]  Yingyuan Xiao,et al.  Exploring Temporal and Spatial Features for Next POI Recommendation in LBSNs , 2021, IEEE Access.

[66]  Lishan Li Hierarchical POI Attention Model for Successive POI Recommendation , 2021, Advances in Data Science and Information Engineering.

[67]  Kwan Hui Lim,et al.  Transformer-Based Multi-task Learning for Queuing Time Aware Next POI Recommendation , 2021, PAKDD.

[68]  Fuzhen Zhuang,et al.  Tell Me Where to Go Next: Improving POI Recommendation via Conversation , 2021, DASFAA.

[69]  Yanchi Liu,et al.  MGSAN: A Multi-granularity Self-attention Network for Next POI Recommendation , 2021, WISE.

[70]  Jiun-Long Huang,et al.  GLR: A graph-based latent representation model for successive POI recommendation , 2020, Future Gener. Comput. Syst..

[71]  D. Fisman,et al.  Disentangling Direct and Indirect Interactions in Polytomous Item Response Theory Models , 2020 .

[72]  Weiping Wang,et al.  From When to Where: A Multi-task Learning Approach for Next Point-of-Interest Recommendation , 2020, WASA.

[73]  Charu C. Aggarwal,et al.  Ensemble-Spotting: Ranking Urban Vibrancy via POI Embedding with Multi-view Spatial Graphs , 2018, SDM.

[74]  A. Ungar,et al.  Analytic Hyperbolic Geometry: Mathematical Foundations And Applications , 2005 .