SVD-based incremental approaches for recommender systems

Abstract Due to the serious information overload problem on the Internet, recommender systems have emerged as an important tool for recommending more useful information to users by providing personalized services for individual users. However, in the “big data” era, recommender systems face significant challenges, such as how to process massive data efficiently and accurately. In this paper we propose an incremental algorithm based on singular value decomposition (SVD) with good scalability, which combines the Incremental SVD algorithm with the Approximating the Singular Value Decomposition (ApproSVD) algorithm, called the Incremental ApproSVD. Furthermore, strict error analysis demonstrates the effectiveness of the performance of our Incremental ApproSVD algorithm. We then present an empirical study to compare the prediction accuracy and running time between our Incremental ApproSVD algorithm and the Incremental SVD algorithm on the MovieLens dataset and Flixster dataset. The experimental results demonstrate that our proposed method outperforms its counterparts.

[1]  Gang Chen,et al.  Collaborative Filtering Using Orthogonal Nonnegative Matrix Tri-factorization , 2007, Seventh IEEE International Conference on Data Mining Workshops (ICDMW 2007).

[2]  Matthew Brand,et al.  Incremental Singular Value Decomposition of Uncertain Data with Missing Values , 2002, ECCV.

[3]  B. S. Manjunath,et al.  An Eigenspace Update Algorithm for Image Analysis , 1997, CVGIP Graph. Model. Image Process..

[4]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[5]  Fillia Makedon,et al.  Learning from Incomplete Ratings Using Non-negative Matrix Factorization , 2006, SDM.

[6]  Yanchun Zhang,et al.  A Personalized Recommendation Algorithm Based on Approximating the Singular Value Decomposition (ApproSVD) , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[7]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[8]  Genevera I. Allen,et al.  Journal of the American Statistical Association a Generalized Least-square Matrix Decomposition a Generalized Least-square Matrix Decomposition , 2022 .

[9]  Hirotaka Nakayama,et al.  Incremental Learning and Forgetting in RBF Networks and SVMs with Applications to Financial Problems , 2003, KES.

[10]  Michael W. Berry,et al.  Large-Scale Sparse Singular Value Computations , 1992 .

[11]  Qiang Yang,et al.  Scalable collaborative filtering using cluster-based smoothing , 2005, SIGIR '05.

[12]  Hongyuan Zha,et al.  On Updating Problems in Latent Semantic Indexing , 1997, SIAM J. Sci. Comput..

[13]  Benjamin M. Marlin,et al.  Collaborative Filtering: A Machine Learning Perspective , 2004 .

[14]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[15]  Paul Van Dooren,et al.  Low-rank incremental methods for computing dominant singular subspaces☆ , 2012 .

[16]  G. Karypis,et al.  Incremental Singular Value Decomposition Algorithms for Highly Scalable Recommender Systems , 2002 .

[17]  Gerard Salton,et al.  Research and Development in Information Retrieval , 1982, Lecture Notes in Computer Science.

[18]  Gene H. Golub,et al.  Matrix computations , 1983 .

[19]  Qinghua Zheng,et al.  Incremental Projection Vector Machine: A One-Stage Learning Algorithm for High-Dimension Large-Sample Dataset , 2010, Australasian Conference on Artificial Intelligence.

[20]  A. Sima Etaner-Uyar,et al.  Graph-based sequence clustering through multiobjective evolutionary algorithms for web recommender systems , 2007, GECCO '07.

[21]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[22]  Achiya Dax,et al.  From Eigenvalues to Singular Values: A Review , 2013 .

[23]  George M. Church,et al.  Biclustering of Expression Data , 2000, ISMB.

[24]  Arindam Banerjee,et al.  Bayesian Co-clustering , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[25]  Michael Lindenbaum,et al.  Sequential Karhunen-Loeve basis extraction and its application to images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[26]  Adam Prügel-Bennett,et al.  The Advantage of Careful Imputation Sources in Sparse Data-Environment of Recommender Systems: Generating Improved SVD-based Recommendations , 2013, Informatica.

[27]  Wenliang Du,et al.  SVD-based collaborative filtering with privacy , 2005, SAC '05.

[28]  Partha Sarathi Chakraborty,et al.  A Scalable Collaborative Filtering Based Recommender System Using Incremental Clustering , 2009, 2009 IEEE International Advance Computing Conference.

[29]  Dao-Qing Dai,et al.  Incremental learning of bidirectional principal components for face recognition , 2010, Pattern Recognit..