Deep Probabilistic Matrix Factorization Framework for Online Collaborative Filtering

As living data growing and evolving rapidly, traditional machine learning algorithms are hard to update models when dealing with new training data. When new data arrives, traditional collaborative filtering methods have to train their model from scratch. It is expensive for them to retrain a model and update their parameters. Compared with traditional collaborative filtering, the online collaborative filtering is effective to update the models instantly when new data arrives. But the cold start and data sparsity remain major problems for online collaborative filtering. In this paper, we try to utilize the convolutional neural network to extract user/item features from user/item side information to address these problems. First, we proposed a deep bias probabilistic matrix factorization (DBPMF) model by utilizing the convolutional neural network to extract latent user/item features and adding the bias into probabilistic matrix factorization to track user rating behavior and item popularity. Second, we constrain user-specific and item-specific feature vectors to further improve the performance of the DBPMF. Third, we update two models by an online learning algorithm. The extensive experiments for three datasets (MovieLens100K, MovieLens1M, and HetRec2011) show that our methods have a better performance than baseline approaches.

[1]  Jie Liu,et al.  PHD: A Probabilistic Model of Hybrid Deep Collaborative Filtering for Recommender Systems , 2017, ACML.

[2]  Bo Wang,et al.  A Survey of Collaborative Filtering-Based Recommender Systems: From Traditional Methods to Hybrid Methods Based on Social Networks , 2018, IEEE Access.

[3]  Steven C. H. Hoi,et al.  Second Order Online Collaborative Filtering , 2013, ACML.

[4]  Ruihui Mu,et al.  A Survey of Recommender Systems Based on Deep Learning , 2018, IEEE Access.

[5]  Steven C. H. Hoi,et al.  Online Learning: A Comprehensive Survey , 2018, Neurocomputing.

[6]  Lina Yao,et al.  AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders , 2017, SIGIR.

[7]  Tao Jin,et al.  Collaborative topic regression for online recommender systems: an online and Bayesian approach , 2017, Machine Learning.

[8]  Jiming Liu,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Social Collaborative Filtering by Trust , 2022 .

[9]  Pasquale Lops,et al.  Learning Word Embeddings from Wikipedia for Content-Based Recommender Systems , 2016, ECIR.

[10]  Mamata Jenamani,et al.  Kernelized probabilistic matrix factorization for collaborative filtering: exploiting projected user and item graph , 2018, RecSys.

[11]  Steven C. H. Hoi,et al.  Online multi-task collaborative filtering for on-the-fly recommender systems , 2013, RecSys.

[12]  Donghyun Kim,et al.  Convolutional Matrix Factorization for Document Context-Aware Recommendation , 2016, RecSys.

[13]  Ramesh C. Jain,et al.  Collaborative Online Multitask Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[14]  Ramesh C. Jain,et al.  Collaborative online learning of user generated content , 2011, CIKM '11.

[15]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[16]  Fernando Ortega,et al.  Hybrid Collaborative Filtering Based on Users Rating Behavior , 2018, IEEE Access.

[17]  Surya Kant,et al.  Merging user and item based collaborative filtering to alleviate data sparsity , 2018, Int. J. Syst. Assur. Eng. Manag..

[18]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..

[19]  Yuanxiang Li,et al.  Accelerated Online Learning for Collaborative Filtering and Recommender Systems , 2014, 2014 IEEE International Conference on Data Mining Workshop.

[20]  Steven C. H. Hoi,et al.  Exact Soft Confidence-Weighted Learning , 2012, ICML.

[21]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[22]  Ramesh C. Jain,et al.  Micro-blogging Sentiment Detection by Collaborative Online Learning , 2010, 2010 IEEE International Conference on Data Mining.

[23]  Katrien Verbert,et al.  Effects of personal characteristics on music recommender systems with different levels of controllability , 2018, RecSys.

[24]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[25]  Beizhan Wang,et al.  Confidence-weighted bias model for online collaborative filtering , 2017, Appl. Soft Comput..

[26]  Chunyan Miao,et al.  Second-Order Online Active Learning and Its Applications , 2018, IEEE Transactions on Knowledge and Data Engineering.

[27]  Qi Zhang,et al.  Hashtag Recommendation Using Attention-Based Convolutional Neural Network , 2016, IJCAI.

[28]  Fan Lin,et al.  Sparse Online Learning for Collaborative Filtering , 2016, Int. J. Comput. Commun. Control.

[29]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.