Hybrid Real-Time Matrix Factorization for Implicit Feedback Recommendation Systems

In this paper, we present a hybrid real-time incremental stochastic gradient descent (RI-SGD) updating technique for implicit feedback matrix factorization (MF) recommendation systems. Compared with explicit feedback evaluation scores, implicit feedback data are easier to obtain but pose challenges to MF recommendation systems because of the transformation procedures from raw data to user preference scores. Another challenge for MF recommendation systems is the accuracy issue when the speed of the new input data increases. The proposed RI-SGD is designed for computationally-efficient and accurate time-variant implicit feedback MF recommendation system, which consists of alternating least squares with weight regularization in the training phase and stochastic gradient descent in the updating phase. To demonstrate the advantages of the RI-SGD updating technique in terms of computational efficiency and accuracy, we implement the proposed updating techniques in a real-time music recommendation system. Compared with the method of retraining the entire model, our numerical results show that RI-SGD approach can achieve almost the same recommendation accuracy, but requires only about 0.02% of the retraining time.

[1]  Xiaoling Wang,et al.  Local Weighted Matrix Factorization for Top-n Recommendation with Implicit Feedback , 2017, Data Science and Engineering.

[2]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[3]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[4]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[5]  Enhong Chen,et al.  Matrix Factorization with Scale-Invariant Parameters , 2015, IJCAI.

[6]  Yehuda Koren,et al.  Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[7]  Myra Spiliopoulou,et al.  Selective Forgetting for Incremental Matrix Factorization in Recommender Systems , 2014, Discovery Science.

[8]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[9]  Paul Zikopoulos,et al.  Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data , 2011 .

[10]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[11]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[12]  Lars Schmidt-Thieme,et al.  Online-updating regularized kernel matrix factorization models for large-scale recommender systems , 2008, RecSys '08.

[13]  George Karypis,et al.  Evaluation of Item-Based Top-N Recommendation Algorithms , 2001, CIKM '01.

[14]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[15]  Li Shang,et al.  MPMA: Mixture Probabilistic Matrix Approximation for Collaborative Filtering , 2016, IJCAI.

[16]  Li-Chun Wang,et al.  Reconstruct Dynamic Systems from Large-Scale Open Data , 2014, GLOBECOM 2014.

[17]  Myra Spiliopoulou,et al.  Forgetting methods for incremental matrix factorization in recommender systems , 2015, SAC.

[18]  Ole J. Mengshoel,et al.  Incremental learning for matrix factorization in recommender systems , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[19]  Junping Du,et al.  Modeling the Evolution of Users’ Preferences and Social Links in Social Networking Services , 2017, IEEE Transactions on Knowledge and Data Engineering.

[20]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[21]  Michael R. Lyu,et al.  Online learning for collaborative filtering , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[22]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[23]  Padhraic Smyth,et al.  KDD Cup and Workshop 2007 , 2007, KDD '07.

[24]  João Gama,et al.  Fast Incremental Matrix Factorization for Recommendation with Positive-Only Feedback , 2014, UMAP.

[25]  Òscar Celma Herrada.  Music recommendation and discovery in the long tail , 2009 .

[26]  Yijun Wang,et al.  Incremental Matrix Factorization: A Linear Feature Transformation Perspective , 2017, IJCAI.