Incremental Learning for Dynamic Collaborative Filtering

Collaborative Filtering (CF) is one of the widely used methods for recommendation problem. The key idea is to predict further the interests of a user (ratings) based on the available rating information from many users. Recently, matrix factorization (MF) based approaches, one branch of collaborative filtering, have proven successful for the rating prediction issues. However, most of the state-of-the-art MF models share the same drawback that the established models are static. They are only capable of handling CF systems with static settings, but never practical for a real-world system, which involves dynamic scenarios like new user signing in, new item being added and new rating being given now and then. For conventional MF models, they have to conduct repetitive learning every time dynamic scenario occurs. It is computational expensive and hard to meet the real-time demand. Therefore, an incremental learning framework based on Weighted NMF is proposed. To reduce the computational cost, it utilizes partially the optimization information from the original system, and stores some corresponding information for the subsequent incremental model. Our empirical studies show that the IWNMF scheme for different dynamic scenarios greatly lower the computational cost without degrading the prediction accuracy.

[1]  Michael R. Lyu,et al.  Effective missing data prediction for collaborative filtering , 2007, SIGIR.

[2]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[3]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[4]  Shuli Han,et al.  PPNMF: Improving Weighted Nonnegative Matrix Factorization with Prior Information , 2010 .

[5]  Tommi S. Jaakkola,et al.  Maximum-Margin Matrix Factorization , 2004, NIPS.

[6]  Tommi S. Jaakkola,et al.  Weighted Low-Rank Approximations , 2003, ICML.

[7]  Chris H. Q. Ding,et al.  Collaborative Filtering: Weighted Nonnegative Matrix Factorization Incorporating User and Item Graphs , 2010, SDM.

[8]  Paul Lamere,et al.  If you like the beatles you might like...: a tutorial on music recommendation , 2008, ACM Multimedia.

[9]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[10]  G. Karypis,et al.  Incremental Singular Value Decomposition Algorithms for Highly Scalable Recommender Systems , 2002 .

[11]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[12]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[13]  Serhat Selcuk Bucak,et al.  Incremental Non-negative Matrix Factorization for Dynamic Background Modelling , 2007, PRIS.

[14]  Serhat Selcuk Bucak,et al.  Incremental subspace learning via non-negative matrix factorization , 2009, Pattern Recognit..

[15]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[16]  James Bennett,et al.  The Netflix Prize , 2007 .

[17]  M. Wu,et al.  Collaborative Filtering via Ensembles of Matrix Factorizations , 2007, KDD 2007.

[18]  Fillia Makedon,et al.  Learning from Incomplete Ratings Using Non-negative Matrix Factorization , 2006, SDM.

[19]  Dean P. Foster,et al.  Clustering Methods for Collaborative Filtering , 1998, AAAI 1998.

[20]  Benjamin M. Marlin,et al.  Modeling User Rating Profiles For Collaborative Filtering , 2003, NIPS.

[21]  Seungjin Choi,et al.  Weighted Nonnegative Matrix Co-Tri-Factorization for Collaborative Prediction , 2009, ACML.

[22]  Matthew Brand,et al.  Fast Online SVD Revisions for Lightweight Recommender Systems , 2003, SDM.

[23]  Bin Fang,et al.  Incremental Nonnegative Matrix Factorization for Face Recognition , 2008 .

[24]  Gang Chen,et al.  Collaborative Filtering Using Orthogonal Nonnegative Matrix Tri-factorization , 2007, Seventh IEEE International Conference on Data Mining Workshops (ICDMW 2007).

[25]  Thomas Hofmann,et al.  Latent semantic models for collaborative filtering , 2004, TOIS.

[26]  Luo Si,et al.  Flexible Mixture Model for Collaborative Filtering , 2003, ICML.

[27]  Mingrui Wu Collaborative Filtering via Ensembles of Matrix , 2007 .