HME: A Hyperbolic Metric Embedding Approach for Next-POI Recommendation

With the increasing popularity of location-aware social media services, next-Point-of-Interest (POI) recommendation has gained significant research interest. The key challenge of next-POI recommendation is to precisely learn users' sequential movements from sparse check-in data. To this end, various embedding methods have been proposed to learn the representations of check-in data in the Euclidean space. However, their ability to learn complex patterns, especially hierarchical structures, is limited by the dimensionality of the Euclidean space. To this end, we propose a new research direction that aims to learn the representations of check-in activities in a hyperbolic space, which yields two advantages. First, it can effectively capture the underlying hierarchical structures, which are implied by the power-law distributions of user movements. Second, it provides high representative strength and enables the check-in data to be effectively represented in a low-dimensional space. Specifically, to solve the next-POI recommendation task, we propose a novel hyperbolic metric embedding (HME) model, which projects the check-in data into a hyperbolic space. The HME jointly captures sequential transition, user preference, category and region information in a unified approach by learning embeddings in a shared hyperbolic space. To the best of our knowledge, this is the first study to explore a non-Euclidean embedding model for next-POI recommendation. We conduct extensive experiments on three check-in datasets to demonstrate the superiority of our hyperbolic embedding approach over the state-of-the-art next-POI recommendation algorithms. Moreover, we conduct experiments on another four online transaction datasets for next-item recommendation to further demonstrate the generality of our proposed model.

[1]  Amin Vahdat,et al.  Hyperbolic Geometry of Complex Networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[3]  Jing He,et al.  Next and Next New POI Recommendation via Latent Behavior Pattern Inference , 2019, ACM Trans. Inf. Syst..

[4]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[5]  Edward Y. Chang,et al.  A time-aware trajectory embedding model for next-location recommendation , 2017, Knowledge and Information Systems.

[6]  Gao Cong,et al.  Graph-based Point-of-interest Recommendation with Geographical and Temporal Influences , 2014, CIKM.

[7]  Michael R. Lyu,et al.  Fused Matrix Factorization with Geographical and Social Influence in Location-Based Social Networks , 2012, AAAI.

[8]  Daqing Zhang,et al.  Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[10]  Jiun-Long Huang,et al.  GLR: A graph-based latent representation model for successive POI recommendation , 2020, Future Gener. Comput. Syst..

[11]  Lejian Liao,et al.  Category-aware Next Point-of-Interest Recommendation via Listwise Bayesian Personalized Ranking , 2017, IJCAI.

[12]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.

[13]  Chi-Yin Chow,et al.  LORE: exploiting sequential influence for location recommendations , 2014, SIGSPATIAL/GIS.

[14]  Gao Cong,et al.  An Experimental Evaluation of Point-of-interest Recommendation in Location-based Social Networks , 2017, Proc. VLDB Endow..

[15]  Richang Hong,et al.  Point-of-Interest Recommendations: Learning Potential Check-ins from Friends , 2016, KDD.

[16]  Christopher De Sa,et al.  Representation Tradeoffs for Hyperbolic Embeddings , 2018, ICML.

[17]  Donghyeon Park,et al.  Content-Aware Hierarchical Point-of-Interest Embedding Model for Successive POI Recommendation , 2018, IJCAI.

[18]  Blair D. Sullivan,et al.  Tree-Like Structure in Large Social and Information Networks , 2013, 2013 IEEE 13th International Conference on Data Mining.

[19]  A. Ungar,et al.  Analytic Hyperbolic Geometry: Mathematical Foundations And Applications , 2005 .

[20]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[21]  Yanmin Zhu,et al.  Next Point-of-Interest Recommendation with Temporal and Multi-level Context Attention , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[22]  Nadia Magnenat-Thalmann,et al.  Time-aware point-of-interest recommendation , 2013, SIGIR.

[23]  Hao Wang,et al.  Exploiting POI-Specific Geographical Influence for Point-of-Interest Recommendation , 2018, IJCAI.

[24]  Douwe Kiela,et al.  Poincaré Embeddings for Learning Hierarchical Representations , 2017, NIPS.

[25]  Chunyan Miao,et al.  Personalized point-of-interest recommendation by mining users' preference transition , 2013, CIKM.

[26]  Douwe Kiela,et al.  Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry , 2018, ICML.

[27]  Weitong Chen,et al.  Learning Graph-based POI Embedding for Location-based Recommendation , 2016, CIKM.

[28]  Bo An,et al.  POI2Vec: Geographical Latent Representation for Predicting Future Visitors , 2017, AAAI.

[29]  Pengfei Wang,et al.  Learning Hierarchical Representation Model for NextBasket Recommendation , 2015, SIGIR.

[30]  Fabio Daolio,et al.  Scalable Hyperbolic Recommender Systems , 2019, ArXiv.

[31]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[32]  Yanchi Liu,et al.  Where to Go Next: A Spatio-temporal LSTM model for Next POI Recommendation , 2018, ArXiv.

[33]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Fuzhen Zhuang,et al.  Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation , 2019, AAAI.

[35]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[36]  Lu Yu,et al.  Spatio-Temporal Attention based Recurrent Neural Network for Next Location Prediction , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[37]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[38]  Zhe Zhu,et al.  What's Your Next Move: User Activity Prediction in Location-based Social Networks , 2013, SDM.

[39]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[40]  Hui Xiong,et al.  Time-aware metric embedding with asymmetric projection for successive POI recommendation , 2018, World Wide Web.

[41]  Michael R. Lyu,et al.  Geo-Teaser: Geo-Temporal Sequential Embedding Rank for Point-of-interest Recommendation , 2016, WWW.

[42]  Michael R. Lyu,et al.  STELLAR: Spatial-Temporal Latent Ranking for Successive Point-of-Interest Recommendation , 2016, AAAI.

[43]  Gao Cong,et al.  HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems , 2018, WSDM.

[44]  Douwe Kiela,et al.  Hyperbolic Graph Neural Networks , 2019, NeurIPS.

[45]  Hechan Tian,et al.  Heterogeneous graph-based joint representation learning for users and POIs in location-based social network , 2020, Inf. Process. Manag..

[46]  Xiao Wang,et al.  Hyperbolic Heterogeneous Information Network Embedding , 2019, AAAI.

[47]  Xin Liu,et al.  Exploring the Context of Locations for Personalized Location Recommendations , 2016, IJCAI.

[48]  Thomas Hofmann,et al.  Hyperbolic Neural Networks , 2018, NeurIPS.

[49]  Xing Xie,et al.  GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation , 2014, KDD.