Efficient point-of-interest recommendation with hierarchical attention mechanism

Abstract Personalized Point-of-Interest (POI) Recommendation is very important for application platforms based on Location Based Social Networks (LBSNs). It can assist users in making decisions to alleviate the problem of information overload, and can also improve the user experience of these platforms and advance platform operators achieve personalized and accurate advertising. However, there exist some problems of data sparseness and cold start for a single user, and it is also difficult to mine valuable long-tailed POIs, although the size of the check-in data is large. Therefore, in order to address the above problems, we propose a personalized POI Recommendation approach based on Hierarchical Attention Mechanism (HAM-POIRec) which can effectively increase data utilization. Firstly, we define the concepts of explicit features and implicit features, which pave the ideas of selecting data and computational models for POI recommendation based on machine learning. Secondly, we propose a hierarchical attention mechanism with the structure of local-to-global, which extracts contributions and mines more hidden information from individual features, combination features, and overall features. Finally, we present the Natural Language Processing (NLP)-based “User-POI” matching mechanism for the first time in the field of POI recommendation to improve the recommendation accuracy by fine-tuning the POIs predicted by the recommendation system. Extensive experiments are conducted for demonstrating that the HAM-POIRec method outperforms state-of-the-art DeepPIM method and the other comparison methods (SAE-NAD, MGMPFM and LRT), especially in predicting sequence POIs and solving cold start problem.

[1]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[2]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.

[3]  Daojing He,et al.  Dynamic Control of Fraud Information Spreading in Mobile Social Networks , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Jing Li,et al.  A personalized point-of-interest recommendation model via fusion of geo-social information , 2018, Neurocomputing.

[5]  Xin He,et al.  A Point-of-Interest recommendation method using user similarity , 2018, Web Intell..

[6]  Jiehang Xie,et al.  An eye-tracking attention based model for abstractive text headline , 2019, Cognitive Systems Research.

[7]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[8]  Gayoung Lee,et al.  ELD-Net: An Efficient Deep Learning Architecture for Accurate Saliency Detection , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[10]  Yingjie Wang,et al.  An Optimization and Auction-Based Incentive Mechanism to Maximize Social Welfare for Mobile Crowdsourcing , 2019, IEEE Transactions on Computational Social Systems.

[11]  Feng Zheng,et al.  Improved Deep Belief Network for Short-Term Load Forecasting Considering Demand-Side Management , 2020, IEEE Transactions on Power Systems.

[12]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[13]  Michael R. Lyu,et al.  Fused Matrix Factorization with Geographical and Social Influence in Location-Based Social Networks , 2012, AAAI.

[14]  Xing Xie,et al.  GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation , 2014, KDD.

[15]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[17]  Jiehang Xie,et al.  ACNN-FM: A novel recommender with attention-based convolutional neural network and factorization machines , 2019, Knowl. Based Syst..

[18]  Craig MacDonald,et al.  A Contextual Attention Recurrent Architecture for Context-Aware Venue Recommendation , 2018, SIGIR.

[19]  Wenyuan Liu,et al.  CTF-ARA: An adaptive method for POI recommendation based on check-in and temporal features , 2017, Knowl. Based Syst..

[20]  Xiaoming Wang,et al.  Incentive Mechanisms for Crowdblocking Rumors in Mobile Social Networks , 2019, IEEE Transactions on Vehicular Technology.

[21]  Xue Liu,et al.  Point-of-Interest Recommendation: Exploiting Self-Attentive Autoencoders with Neighbor-Aware Influence , 2018, CIKM.

[22]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[23]  Guisheng Yin,et al.  A trust-based probabilistic recommendation model for social networks , 2015, J. Netw. Comput. Appl..

[24]  Rong Gao,et al.  Exploiting geo-social correlations to improve pairwise ranking for point-of-interest recommendation , 2018, China Communications.

[25]  Shuai Li,et al.  An Efficient Approach to Generating Location-Sensitive Recommendations in Ad-hoc Social Network Environments , 2015, IEEE Transactions on Services Computing.

[26]  Gao Cong,et al.  An Experimental Evaluation of Point-of-interest Recommendation in Location-based Social Networks , 2017, Proc. VLDB Endow..

[27]  Bin Guo,et al.  Personalized Travel Package With Multi-Point-of-Interest Recommendation Based on Crowdsourced User Footprints , 2016, IEEE Transactions on Human-Machine Systems.

[28]  Jakob Grue Simonsen,et al.  A Hierarchical Recurrent Encoder-Decoder for Generative Context-Aware Query Suggestion , 2015, CIKM.

[29]  Qi Li,et al.  Large-scale point-of-interest category prediction using natural language processing models , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[30]  Chung Choo Chung,et al.  Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecture , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[31]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[32]  Seongsoon Kim,et al.  DeepPIM: A deep neural point-of-interest imputation model , 2018, Inf. Sci..

[33]  Fei Hao,et al.  Efficient Coupling Diffusion of Positive and Negative Information in Online Social Networks , 2019, IEEE Transactions on Network and Service Management.

[34]  Michael R. Lyu,et al.  A Survey of Point-of-interest Recommendation in Location-based Social Networks , 2016, ArXiv.

[35]  Xiaoli Li,et al.  Where you Instagram?: Associating Your Instagram Photos with Points of Interest , 2015, CIKM.

[36]  Lejian Liao,et al.  Inferring a Personalized Next Point-of-Interest Recommendation Model with Latent Behavior Patterns , 2016, AAAI.

[37]  Son N. Tran,et al.  Deep Logic Networks: Inserting and Extracting Knowledge From Deep Belief Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Bo An,et al.  POI2Vec: Geographical Latent Representation for Predicting Future Visitors , 2017, AAAI.

[39]  Licheng Jiao,et al.  CNN-Based Multilayer Spatial–Spectral Feature Fusion and Sample Augmentation With Local and Nonlocal Constraints for Hyperspectral Image Classification , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Xiaoli Li,et al.  Rank-GeoFM: A Ranking based Geographical Factorization Method for Point of Interest Recommendation , 2015, SIGIR.

[41]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[42]  Yang Gao,et al.  Truthful incentive mechanism with location privacy-preserving for mobile crowdsourcing systems , 2018, Comput. Networks.

[43]  Richang Hong,et al.  Point-of-Interest Recommendations: Learning Potential Check-ins from Friends , 2016, KDD.

[44]  Fei Hao,et al.  Mobile cloud services recommendation: a soft set-based approach , 2018, J. Ambient Intell. Humaniz. Comput..

[45]  Huan Liu,et al.  Exploring temporal effects for location recommendation on location-based social networks , 2013, RecSys.

[46]  Onn Shehory,et al.  Comments Mining With TF-IDF: The Inherent Bias and Its Removal , 2019, IEEE Transactions on Knowledge and Data Engineering.

[47]  Zhipeng Cai,et al.  A Private and Efficient Mechanism for Data Uploading in Smart Cyber-Physical Systems , 2020, IEEE Transactions on Network Science and Engineering.