STAN: Spatio-Temporal Attention Network for Next Location Recommendation

The next location recommendation is at the core of various location-based applications. Current state-of-the-art models have attempted to solve spatial sparsity with hierarchical gridding and model temporal relation with explicit time intervals, while some vital questions remain unsolved. Non-adjacent locations and non-consecutive visits provide non-trivial correlations for understanding a user’s behavior but were rarely considered. To aggregate all relevant visits from user trajectory and recall the most plausible candidates from weighted representations, here we propose a Spatio-Temporal Attention Network (STAN) for location recommendation. STAN explicitly exploits relative spatiotemporal information of all the check-ins with self-attention layers along the trajectory. This improvement allows a point-to-point interaction between non-adjacent locations and non-consecutive check-ins with explicit spatio-temporal effect. STAN uses a bi-layer attention architecture that firstly aggregates spatiotemporal correlation within user trajectory and then recalls the target with consideration of personalized item frequency (PIF). By visualization, we show that STAN is in line with the above intuition. Experimental results unequivocally show that our model outperforms the existing state-of-the-art methods by 9-17%.

[1]  Francesco Ricci,et al.  Harnessing a generalised user behaviour model for next-POI recommendation , 2018, RecSys.

[2]  Huan Liu,et al.  Exploring temporal effects for location recommendation on location-based social networks , 2013, RecSys.

[3]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[4]  Qiang Liu,et al.  An Empirical Study on Feature Discretization , 2020, ArXiv.

[5]  Zheng Qin,et al.  Time Matters: Sequential Recommendation with Complex Temporal Information , 2020, SIGIR.

[6]  M. de Rijke,et al.  RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendation , 2018, AAAI.

[7]  Yujie Wang,et al.  Time Interval Aware Self-Attention for Sequential Recommendation , 2020, WSDM.

[8]  Fuzhen Zhuang,et al.  Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation , 2019, AAAI.

[9]  Qiang Liu,et al.  Towards Accurate and Interpretable Sequential Prediction: A CNN & Attention-Based Feature Extractor , 2019, CIKM.

[10]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[11]  Joemon M. Jose,et al.  A Simple Convolutional Generative Network for Next Item Recommendation , 2018, WSDM.

[12]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[13]  Chunyan Miao,et al.  Exploiting Geographical Neighborhood Characteristics for Location Recommendation , 2014, CIKM.

[14]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[15]  Liang Wang,et al.  Multi-Behavioral Sequential Prediction with Recurrent Log-Bilinear Model , 2016, IEEE Transactions on Knowledge and Data Engineering.

[16]  Chunxiao Xing,et al.  Discovering Subsequence Patterns for Next POI Recommendation , 2020, IJCAI.

[17]  Quoc Viet Hung Nguyen,et al.  Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest Recommendation , 2020, AAAI.

[18]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[19]  Gao Cong,et al.  Context-aware Deep Model for Joint Mobility and Time Prediction , 2020, WSDM.

[20]  Deng Cai,et al.  What to Do Next: Modeling User Behaviors by Time-LSTM , 2017, IJCAI.

[21]  Yong Liu,et al.  Contextualized Point-of-Interest Recommendation , 2020, IJCAI.

[22]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[23]  Tieniu Tan,et al.  SAPE: A System for Situation-Aware Public Security Evaluation , 2016, AAAI.

[24]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[25]  Gao Cong,et al.  HME: A Hyperbolic Metric Embedding Approach for Next-POI Recommendation , 2020, SIGIR.

[26]  Yiqun Liu,et al.  Modeling Item-Specific Temporal Dynamics of Repeat Consumption for Recommender Systems , 2019, WWW.

[27]  Chao Zhang,et al.  SERM: A Recurrent Model for Next Location Prediction in Semantic Trajectories , 2017, CIKM.

[28]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[29]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[30]  Qiang Liu,et al.  TAGNN: Target Attentive Graph Neural Networks for Session-based Recommendation , 2020, SIGIR.

[31]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[32]  Yifeng Zeng,et al.  Personalized Ranking Metric Embedding for Next New POI Recommendation , 2015, IJCAI.

[33]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[34]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[35]  Qing Guo,et al.  An Attentional Recurrent Neural Network for Personalized Next Location Recommendation , 2020, AAAI.

[36]  Paolo Rosso,et al.  Location Prediction over Sparse User Mobility Traces Using RNNs: Flashback in Hidden States! , 2020, IJCAI.

[37]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[38]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[39]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[40]  Xing Xie,et al.  Geography-Aware Sequential Location Recommendation , 2020, KDD.

[41]  Xiangnan He,et al.  Modeling Personalized Item Frequency Information for Next-basket Recommendation , 2020, SIGIR.

[42]  Xiangyang Luo,et al.  NEXT: a neural network framework for next POI recommendation , 2017, Frontiers of Computer Science.

[43]  Yutao Ma,et al.  An Attention-Based Spatiotemporal LSTM Network for Next POI Recommendation , 2019, IEEE Transactions on Services Computing.

[44]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.