Practical Privacy Preserving POI Recommendation

Point-of-Interest (POI) recommendation has been extensively studied and successfully applied in industry recently. However, most existing approaches build centralized models on the basis of collecting users’ data. Both private data and models are held by the recommender, which causes serious privacy concerns. In this article, we propose a novel Privacy preserving POI Recommendation (PriRec) framework. First, to protect data privacy, users’ private data (features and actions) are kept on their own side, e.g., Cellphone or Pad. Meanwhile, the public data that need to be accessed by all the users are kept by the recommender to reduce the storage costs of users’ devices. Those public data include: (1) static data only related to the status of POI, such as POI categories, and (2) dynamic data dependent on user-POI actions such as visited counts. The dynamic data could be sensitive, and we develop local differential privacy techniques to release such data to the public with privacy guarantees. Second, PriRec follows the representations of Factorization Machine (FM) that consists of a linear model and the feature interaction model. To protect the model privacy, the linear models are saved on the users’ side, and we propose a secure decentralized gradient descent protocol for users to learn it collaboratively. The feature interaction model is kept by the recommender since there is no privacy risk, and we adopt a secure aggregation strategy in a federated learning paradigm to learn it. To this end, PriRec keeps users’ private raw data and models in users’ own hands, and protects user privacy to a large extent. We apply PriRec in real-world datasets, and comprehensive experiments demonstrate that, compared with FM, PriRec achieves comparable or even better recommendation accuracy.

[1]  Chih-Jen Lin,et al.  Field-aware Factorization Machines for CTR Prediction , 2016, RecSys.

[2]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[3]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[4]  Weiwei Deng,et al.  Model Ensemble for Click Prediction in Bing Search Ads , 2017, WWW.

[5]  Martine De Cock,et al.  Fast, Privacy Preserving Linear Regression over Distributed Datasets based on Pre-Distributed Data , 2015, AISec@CCS.

[6]  Kevin Chen-Chuan Chang,et al.  Semi-supervised Learning Meets Factorization: Learning to Recommend with Chain Graph Model , 2020, ArXiv.

[7]  Craig Gentry,et al.  A fully homomorphic encryption scheme , 2009 .

[8]  Payman Mohassel,et al.  SecureML: A System for Scalable Privacy-Preserving Machine Learning , 2017, 2017 IEEE Symposium on Security and Privacy (SP).

[9]  Alexander J. Smola,et al.  Scaling Distributed Machine Learning with the Parameter Server , 2014, OSDI.

[10]  David Vallet,et al.  Matrix Factorization without User Data Retention , 2014, PAKDD.

[11]  Janardhan Kulkarni,et al.  Collecting Telemetry Data Privately , 2017, NIPS.

[12]  Xiaoli Li,et al.  Rank-GeoFM: A Ranking based Geographical Factorization Method for Point of Interest Recommendation , 2015, SIGIR.

[13]  Hongxia Jin,et al.  EpicRec: Towards Practical Differentially Private Framework for Personalized Recommendation , 2016, CCS.

[14]  Tsvi Kuflik,et al.  Enhancing privacy and preserving accuracy of a distributed collaborative filtering , 2007, RecSys '07.

[15]  Jiawei Han,et al.  Bridging Collaborative Filtering and Semi-Supervised Learning: A Neural Approach for POI Recommendation , 2017, KDD.

[16]  Wenliang Du,et al.  Privacy-Preserving Collaborative Filtering , 2005, Int. J. Electron. Commer..

[17]  Cynthia Dwork,et al.  Differential Privacy: A Survey of Results , 2008, TAMC.

[18]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[19]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[20]  Úlfar Erlingsson,et al.  RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response , 2014, CCS.

[21]  Deepak Agarwal,et al.  Regression-based latent factor models , 2009, KDD.

[22]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[23]  Wenliang Du,et al.  Privacy-preserving collaborative filtering using randomized perturbation techniques , 2003, Third IEEE International Conference on Data Mining.

[24]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[25]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[26]  Ninghui Li,et al.  Privacy at Scale: Local Dierential Privacy in Practice , 2018 .

[27]  Xing Xie,et al.  GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation , 2014, KDD.

[28]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[29]  Li Wang,et al.  Large scale app recommendation in Ant Financial , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[30]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[31]  Claudio Bettini,et al.  Private context-aware recommendation of points of interest: An initial investigation , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications Workshops.

[32]  Pramod Viswanath,et al.  Extremal Mechanisms for Local Differential Privacy , 2014, J. Mach. Learn. Res..

[33]  John Riedl,et al.  Do You Trust Your Recommendations? An Exploration of Security and Privacy Issues in Recommender Systems , 2006, ETRICS.

[34]  Lior Rokach,et al.  Recommender Systems: Introduction and Challenges , 2015, Recommender Systems Handbook.

[35]  Jun Wang,et al.  Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction , 2016, ECIR.

[36]  Feng Zhu,et al.  A Deep Framework for Cross-Domain and Cross-System Recommendations , 2018, IJCAI.

[37]  Jun Zhou,et al.  Privacy Preserving Point-of-Interest Recommendation Using Decentralized Matrix Factorization , 2018, AAAI.

[38]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[39]  Zekeriya Erkin,et al.  Privacy enhanced recommender system , 2010 .

[40]  Ilya Mironov,et al.  Differentially private recommender systems: building privacy into the net , 2009, KDD.

[41]  John F. Canny,et al.  Collaborative filtering with privacy , 2002, Proceedings 2002 IEEE Symposium on Security and Privacy.

[42]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[43]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[44]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[45]  Dik Lun Lee,et al.  Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba , 2018, KDD.

[46]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.

[47]  Daqing Zhang,et al.  PrivCheck: privacy-preserving check-in data publishing for personalized location based services , 2016, UbiComp.

[48]  Jun Zhou,et al.  Distributed Collaborative Hashing and Its Applications in Ant Financial , 2018, KDD.

[49]  Stratis Ioannidis,et al.  Privacy-preserving matrix factorization , 2013, CCS.

[50]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[51]  BrassardGilles,et al.  Alambic: a privacy-preserving recommender system for electronic commerce , 2008 .

[52]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[53]  Qing Ling,et al.  On the Convergence of Decentralized Gradient Descent , 2013, SIAM J. Optim..

[54]  Xiaokui Xiao,et al.  Privacy Enhanced Matrix Factorization for Recommendation with Local Differential Privacy , 2018, IEEE Transactions on Knowledge and Data Engineering.

[55]  Raef Bassily,et al.  Local, Private, Efficient Protocols for Succinct Histograms , 2015, STOC.

[56]  Jingyu Hua,et al.  Differentially Private Matrix Factorization , 2015, IJCAI.

[57]  Adi Shamir,et al.  How to share a secret , 1979, CACM.

[58]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[59]  A. Yao,et al.  Fair exchange with a semi-trusted third party (extended abstract) , 1997, CCS '97.

[60]  B. Barak Fully Homomorphic Encryption and Post Quantum Cryptography , 2010 .

[61]  Zhu Wang,et al.  A sentiment-enhanced personalized location recommendation system , 2013, HT.

[62]  Liang Li,et al.  Secure Social Recommendation based on Secret Sharing , 2020, ECAI.

[63]  Michael R. Lyu,et al.  Fused Matrix Factorization with Geographical and Social Influence in Location-Based Social Networks , 2012, AAAI.

[64]  Michael R. Lyu,et al.  A Survey of Point-of-interest Recommendation in Location-based Social Networks , 2016, ArXiv.

[65]  Kamalika Chaudhuri,et al.  Privacy-preserving logistic regression , 2008, NIPS.

[66]  Sarvar Patel,et al.  Practical Secure Aggregation for Privacy-Preserving Machine Learning , 2017, IACR Cryptol. ePrint Arch..