Collaborative Filtering Based on a Variational Gaussian Mixture Model

Collaborative filtering (CF) is a widely used method in recommendation systems. Linear models are still the mainstream of collaborative filtering research methods, but non-linear probabilistic models are beyond the limit of linear model capacity. For example, variational autoencoders (VAEs) have been extensively used in CF, and have achieved excellent results. Aiming at the problem of the prior distribution for the latent codes of VAEs in traditional CF is too simple, which makes the implicit variable representations of users and items too poor. This paper proposes a variational autoencoder that uses a Gaussian mixture model for latent factors distribution for CF, GVAE-CF. On this basis, an optimization function suitable for GVAE-CF is proposed. In our experimental evaluation, we show that the recommendation performance of GVAE-CF outperforms the previously proposed VAE-based models on several popular benchmark datasets in terms of recall and normalized discounted cumulative gain (NDCG), thus proving the effectiveness of the algorithm.

[1]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[2]  Michael J. Pazzani,et al.  Learning Collaborative Information Filters , 1998, ICML.

[3]  Amirali Salehi-Abari,et al.  Joint Variational Autoencoders for Recommendation with Implicit Feedback , 2020, ArXiv.

[4]  David M. Blei,et al.  Scalable Recommendation with Hierarchical Poisson Factorization , 2015, UAI.

[5]  David M. Blei,et al.  Factorization Meets the Item Embedding: Regularizing Matrix Factorization with Item Co-occurrence , 2016, RecSys.

[6]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[7]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[8]  R. Salakhutdinov,et al.  Bayesian Probabilistic Matrix Factorization: A User Frequency Analysis , 2014, 1407.7840.

[9]  Mohammad R. Moosavi,et al.  An Adaptive Similarity Measure to Tune Trust Influence in Memory-Based Collaborative Filtering , 2019, ArXiv.

[10]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[11]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[12]  Kyungwoo Song,et al.  Augmented Variational Autoencoders for Collaborative Filtering with Auxiliary Information , 2017, CIKM.

[13]  James Bennett,et al.  The Netflix Prize , 2007 .

[14]  Liang Zhang,et al.  Beyond Similarity: Relation Embedding with Dual Attentions for Item-based Recommendation , 2019, ArXiv.

[15]  Xavier Thomas Content-Based Personalized Recommender System Using Entity Embeddings , 2020, ArXiv.

[16]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[17]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[18]  N. Chopin,et al.  Bayesian matrix completion: prior specification , 2014, 1406.1440.

[19]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.