Exploiting Cluster Structure in Probabilistic Matrix Factorization

Low-rank matrix factorization is a basic model for collaborative filtering. The low-rank matrix approximation model is equivalent to represent users and items by latent factors, and rating is obtained by calculating the inner product of factors. Most low-rank matrix approximation models assume the latent factors come from a common Gaussian distribution. However, users with similar preferences or items of the same type tend to have similar factors, thus there exists cluster structure underlying user factors and item factors. In this paper, we exploit the cluster structure in the low-rank matrix factorization model to improve prediction accuracy. Experimental results on MovieLens-1m and MovieLens-10m datasets demonstrate the effectiveness of the proposed methods.

[1]  Yiqun Liu,et al.  Improve collaborative filtering through bordered block diagonal form matrices , 2013, SIGIR.

[2]  Richard S. Zemel,et al.  The multiple multiplicative factor model for collaborative filtering , 2004, ICML.

[3]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[5]  Samy Bengio,et al.  Local collaborative ranking , 2014, WWW.

[6]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[7]  Samy Bengio,et al.  LLORMA: Local Low-Rank Matrix Approximation , 2016, J. Mach. Learn. Res..

[8]  Alexander J. Smola,et al.  ACCAMS: Additive Co-Clustering to Approximate Matrices Succinctly , 2014, WWW.

[9]  Chun Chen,et al.  An exploration of improving collaborative recommender systems via user-item subgroups , 2012, WWW.

[10]  Li Shang,et al.  WEMAREC: Accurate and Scalable Recommendation through Weighted and Ensemble Matrix Approximation , 2015, SIGIR.

[11]  Arindam Banerjee,et al.  Generalized Probabilistic Matrix Factorizations for Collaborative Filtering , 2010, 2010 IEEE International Conference on Data Mining.

[12]  Wei Liu,et al.  Mixture-Rank Matrix Approximation for Collaborative Filtering , 2017, NIPS.

[13]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[14]  Thomas Hofmann,et al.  Probabilistic Latent Semantic Analysis , 1999, UAI.

[15]  Ameet Talwalkar,et al.  Divide-and-Conquer Matrix Factorization , 2011, NIPS.

[16]  Xiaoling Wang,et al.  Bayesian Probabilistic Multi-Topic Matrix Factorization for Rating Prediction , 2016, IJCAI.

[17]  Benjamin M. Marlin,et al.  Modeling User Rating Profiles For Collaborative Filtering , 2003, NIPS.