Variational autoencoder Bayesian matrix factorization (VABMF) for collaborative filtering

Probabilistic matrix factorization (PMF) is the most popular method among low-rank matrix approximation approaches that address the sparsity problem in collaborative filtering for recommender systems. PMF depends on the classical maximum a posteriori estimator for estimating model parameters; however, these approaches are vulnerable to overfitting because of the nature of a single point estimation that is pursued by these models. An alternative approach to PMF is a Bayesian PMF model that suggests the Markov chain Monte Carlo algorithm as a full estimation for approximate intractable posterior over model parameters. However, despite its success in increasing prediction, it has a high computational cost. To this end, we proposed a novel Bayesian deep learning-based model treatment, namely, variational autoencoder Bayesian matrix factorization (VABMF). The proposed model uses stochastic gradient variational Bayes to estimate intractable posteriors and expectation–maximization-style estimators to learn model parameters. The model was evaluated on the basis of three MovieLens datasets, namely, Ml-100k, Ml-1M, and Ml-10M. Experimental results showed that our proposed VABMF model significantly outperforms state-of-the-art RS.

[1]  WangWei,et al.  Recommender system application developments , 2015 .

[2]  Daniel M. Roy,et al.  Neural Network Matrix Factorization , 2015, ArXiv.

[3]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[4]  Olga Veksler,et al.  Markov random fields with efficient approximations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[5]  Mohsen Afsharchi,et al.  An effective social recommendation method based on user reputation model and rating profile enhancement , 2018, J. Inf. Sci..

[6]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[7]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[8]  Hong Shen,et al.  Neural variational matrix factorization for collaborative filtering in recommendation systems , 2019, Applied Intelligence.

[9]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[10]  Matthew D. Hoffman,et al.  Variational Autoencoders for Collaborative Filtering , 2018, WWW.

[11]  Max Welling,et al.  Austerity in MCMC Land: Cutting the Metropolis-Hastings Budget , 2013, ICML 2014.

[12]  Chong Wang,et al.  Stochastic variational inference , 2012, J. Mach. Learn. Res..

[13]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[14]  Vikram Pudi,et al.  Sequential Variational Autoencoders for Collaborative Filtering , 2018, WSDM.

[15]  Samy Bengio,et al.  Generating Sentences from a Continuous Space , 2015, CoNLL.

[16]  Jie Yuan,et al.  Item Recommendation with Variational Autoencoders and Heterogeneous Priors , 2018, DLRS@RecSys.

[17]  Matthew J. Beal Variational algorithms for approximate Bayesian inference , 2003 .

[18]  Linpeng Huang,et al.  CluCF: a clustering CF algorithm to address data sparsity problem , 2017, Service Oriented Computing and Applications.

[19]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[20]  Onno Kampman,et al.  Variational inference for neural network matrix factorization and its application to stochastic blockmodeling , 2019, ArXiv.

[21]  Dacheng Tao,et al.  On the Performance of Manhattan Nonnegative Matrix Factorization , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Ezgi Yildirim,et al.  Neural Hybrid Recommender: Recommendation needs collaboration , 2019, NFMCP@PKDD/ECML.

[23]  Xindong Wu,et al.  Hybrid Collaborative Recommendation via Dual-Autoencoder , 2020, IEEE Access.

[24]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[25]  Monika Singh,et al.  Scalability and sparsity issues in recommender datasets: a survey , 2018, Knowledge and Information Systems.

[26]  SongJie Gong,et al.  Combining Memory-Based and Model-Based Collaborative Filtering in Recommender System , 2009, 2009 Pacific-Asia Conference on Circuits, Communications and Systems.

[27]  Mohsen Afsharchi,et al.  A social recommendation method based on an adaptive neighbor selection mechanism , 2017, Inf. Process. Manag..

[28]  Huan Liu,et al.  Exploring Hierarchical Structures for Recommender Systems , 2018, IEEE Transactions on Knowledge and Data Engineering.

[29]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[30]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[31]  Zhiqiang Wang,et al.  A fusion collaborative filtering method for sparse data in recommender systems , 2020, Inf. Sci..

[32]  Mohsen Afsharchi,et al.  A Temporal Clustering Approach for Social Recommender Systems , 2018, 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[33]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[34]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[35]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[36]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[37]  Mohsen Afsharchi,et al.  A social recommender system based on reliable implicit relationships , 2020, Knowl. Based Syst..

[38]  Mohsen Afsharchi,et al.  Incorporating reliable virtual ratings into social recommendation systems , 2018, Applied Intelligence.

[39]  Richard S. Zemel,et al.  The multiple multiplicative factor model for collaborative filtering , 2004, ICML.

[40]  Parham Moradi,et al.  A trust-aware recommender algorithm based on users overlapping community structure , 2016, 2016 Sixteenth International Conference on Advances in ICT for Emerging Regions (ICTer).

[41]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[42]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[43]  M. Jalili,et al.  Evaluating Collaborative Filtering Recommender Algorithms: A Survey , 2018, IEEE Access.

[44]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[45]  Parham Moradi,et al.  An improved model of trust-aware recommender systems using reliability measurements , 2014, 2014 6th Conference on Information and Knowledge Technology (IKT).

[46]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[47]  Mohsen Afsharchi,et al.  A novel approach based on multi-view reliability measures to alleviate data sparsity in recommender systems , 2019, Multimedia Tools and Applications.

[48]  Aanchal Mongia,et al.  Deep Latent Factor Model for Collaborative Filtering , 2019, Signal Process..