Forgetting methods for incremental matrix factorization in recommender systems

Numerous stream mining algorithms are equipped with forgetting mechanisms, such as sliding windows or fading factors, to make them adaptive to changes. In recommender systems those techniques have not been investigated thoroughly despite the very volatile nature of users' preferences that they deal with. We developed five new forgetting techniques for incremental matrix factorization in recommender systems. We show on eight datasets that our techniques improve the predictive power of recommender systems. Experiments with both explicit rating feedback and positive-only feedback confirm our findings showing that forgetting information is beneficial despite the extreme data sparsity that recommender systems struggle with. Improvement through forgetting also proves that users' preferences are subject to concept drift.

[1]  Domonkos Tikk,et al.  Scalable Collaborative Filtering Approaches for Large Recommender Systems , 2009, J. Mach. Learn. Res..

[2]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[3]  Dimitris Plexousakis,et al.  Incremental Collaborative Filtering for Highly-Scalable Recommendation Algorithms , 2005, ISMIS.

[4]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[5]  P. Massa,et al.  Trust-aware Bootstrapping of Recommender Systems , 2006 .

[6]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[7]  Xue Li,et al.  Time weight collaborative filtering , 2005, CIKM '05.

[8]  Alípio Mário Jorge,et al.  Forgetting mechanisms for scalable collaborative filtering , 2012, Journal of the Brazilian Computer Society.

[9]  Òscar Celma,et al.  Music recommendation and discovery in the long tail , 2008 .

[10]  João Gama,et al.  Issues in evaluation of stream learning algorithms , 2009, KDD.

[11]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[12]  Catarina Miranda,et al.  Incremental Collaborative Filtering for Binary Ratings , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[13]  Michael R. Lyu,et al.  Online learning for collaborative filtering , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[14]  Myra Spiliopoulou,et al.  Selective Forgetting for Incremental Matrix Factorization in Recommender Systems , 2014, Discovery Science.

[15]  João Gama,et al.  Fast Incremental Matrix Factorization for Recommendation with Positive-Only Feedback , 2014, UMAP.

[16]  Yi Ding,et al.  Collaborative filtering on streaming data with interest-drifting , 2007, Intell. Data Anal..

[17]  Òscar Celma,et al.  Music Recommendation and Discovery - The Long Tail, Long Fail, and Long Play in the Digital Music Space , 2010 .

[18]  Paolo Avesani,et al.  Trust-aware recommender systems , 2007, RecSys '07.