Gaussian Process Latent Variable Model Factorization for Context-aware Recommender Systems

Context-aware recommender systems (CARS) have gained increasing attention due to their ability to utilize contextual information. Compared to traditional recommender systems, CARS are, in general, able to generate more accurate recommendations. Latent factors approach accounts for a large proportion of CARS. Recently, a non-linear Gaussian Process (GP) based factorization method was proven to outperform the state-of-the-art methods in CARS. Despite its effectiveness, GP model-based methods can suffer from over-fitting and may not be able to determine the impact of each context automatically. In order to address such shortcomings, we propose a Gaussian Process Latent Variable Model Factorization (GPLVMF) method, where we apply an appropriate prior to the original GP model. Our work is primarily inspired by the Gaussian Process Latent Variable Model (GPLVM), which was a non-linear dimensionality reduction method. As a result, we improve the performance on the real datasets significantly as well as capturing the importance of each context. In addition to the general advantages, our method provides two main contributions regarding recommender system settings: (1) addressing the influence of bias by setting a non-zero mean function, and (2) utilizing real-valued contexts by fixing the latent space with real values.

[1]  N. Andrei.  Nonlinear Conjugate Gradient Methods for Unconstrained Optimization , 2020, Springer Optimization and Its Applications.

[2]  Balázs Hidasi,et al.  Fast ALS-based tensor factorization for context-aware recommendation from implicit feedback , 2012, ECML/PKDD.

[3]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[4]  Jian-Ping Li,et al.  Leverage side information for top‐N recommendation with latent Gaussian process , 2019, Concurr. Comput. Pract. Exp..

[5]  Zoubin Ghahramani,et al.  Collaborative Gaussian Processes for Preference Learning , 2012, NIPS.

[6]  Toshihiro Kamishima,et al.  Nantonac collaborative filtering: recommendation based on order responses , 2003, KDD '03.

[7]  Naonori Ueda,et al.  Higher-Order Factorization Machines , 2016, NIPS.

[8]  Neil D. Lawrence,et al.  Bayesian Gaussian Process Latent Variable Model , 2010, AISTATS.

[9]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[10]  Bernd Ludwig,et al.  Matrix factorization techniques for context aware recommendation , 2011, RecSys '11.

[11]  Jing Li,et al.  Adversarial tensor factorization for context-aware recommendation , 2019, RecSys.

[12]  Adel Alti,et al.  Ontology-based Context-aware Recommendation Approach For Dynamic Situations Enrichment , 2018, 2018 13th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP).

[13]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[14]  Mario García Valdez,et al.  Post-Filtering for a Restaurant Context-Aware Recommender System , 2014, Recent Advances on Hybrid Approaches for Designing Intelligent Systems.

[15]  Andreas Krause,et al.  Explore-exploit in top-N recommender systems via Gaussian processes , 2014, RecSys '14.

[16]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[17]  Neil D. Lawrence,et al.  Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data , 2003, NIPS.

[18]  Alexandros Karatzoglou,et al.  Gaussian process factorization machines for context-aware recommendations , 2014, SIGIR.

[19]  Andreas C. Damianou,et al.  Deep Gaussian processes and variational propagation of uncertainty , 2015 .

[20]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[21]  Yasuhiro Takishima,et al.  Context-Aware Preference Model Based on a Study of Difference between Real and Supposed Situation Data , 2009, UMAP.

[22]  Martha Larson,et al.  TFMAP: optimizing MAP for top-n context-aware recommendation , 2012, SIGIR '12.

[23]  Martha Larson,et al.  Cross-Domain Collaborative Filtering with Factorization Machines , 2014, ECIR.

[24]  Xiangnan He,et al.  CFM: Convolutional Factorization Machines for Context-Aware Recommendation , 2019, IJCAI.

[25]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[26]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[27]  Amir H. Gandomi,et al.  Resolving data sparsity and cold start problem in collaborative filtering recommender system using Linked Open Data , 2020, Expert Syst. Appl..

[28]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[29]  Saurabh Kulkarni,et al.  Context Aware Recommendation Systems: A review of the state of the art techniques , 2020, Comput. Sci. Rev..

[30]  Meina Song,et al.  CMPTF: Contextual Modeling Probabilistic Tensor Factorization for recommender systems , 2016, Neurocomputing.

[31]  Yi-Hsuan Yang,et al.  Low-Rank Matrix Completion over Finite Abelian Group Algebras for Context-Aware Recommendation , 2017, CIKM.

[32]  Iadh Ounis,et al.  Variational Bayesian Context-aware Representation for Grocery Recommendation , 2019, ArXiv.

[33]  Neil D. Lawrence,et al.  Gaussian Processes for Big Data , 2013, UAI.

[34]  Marko Tkalcic,et al.  Database for contextual personalization , 2011 .

[35]  Neil D. Lawrence,et al.  Non-linear matrix factorization with Gaussian processes , 2009, ICML '09.

[36]  Wei Wu,et al.  Learning Context-aware Latent Representations for Context-aware Collaborative Filtering , 2015, SIGIR.

[37]  Abayomi Moradeyo Otebolaku,et al.  Context-aware media recommendations for smart devices , 2014, J. Ambient Intell. Humaniz. Comput..

[38]  Liang Wang,et al.  COT: Contextual Operating Tensor for Context-Aware Recommender Systems , 2015, AAAI.