EIGENREC: An Efficient and Scalable Latent Factor Family for Top-N Recommendation

Sparsity presents one of the major challenges of Collaborative Filtering. Graph-based methods are known to alleviate its effects, however their use is often computationally prohibitive; Latent-Factor methods, on the other hand, present a reasonable and viable alternative. In this paper, we introduce EigenRec; a versatile and efficient Latent-Factor framework for Top-N Recommendations, that generalizes the well-known PureSVD algorithm (a) providing intuition about its inner structure, (b) paving the path towards improving its efficacy and, at the same time, (c) reducing its complexity. One of our central goals in this work is to ensure the applicability of our method in realistic big-data scenarios. To this end, we propose building our model using a computationally efficient Lanczos-based procedure, we discuss its Parallel Implementation in distributed computing environments, and we verify its favourable performance using real-world datasets. Furthermore, from a qualitative point of view, a comprehensive set of experiments on the MovieLens and the Yahoo!R2Music datasets based on widely applied performance metrics, indicate that EigenRec outperforms several state-of-the-art algorithms, in terms of Standard and Long-Tail recommendation accuracy, exhibiting low susceptibility to sparsity, even in its most extreme manifestations -- the Cold-Start problems.

[1]  Ruimin Shen,et al.  A collaborative filtering framework based on both local user similarity and global user similarity , 2008, Machine Learning.

[2]  M. Hitt The Long Tail: Why the Future of Business Is Selling Less of More , 2007 .

[3]  Junjie Yao,et al.  Challenging the Long Tail Recommendation , 2012, Proc. VLDB Endow..

[4]  Hsinchun Chen,et al.  Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering , 2004, TOIS.

[5]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[6]  Jack Dongarra,et al.  Templates for the Solution of Algebraic Eigenvalue Problems , 2000, Software, environments, tools.

[7]  François Fouss,et al.  Random-Walk Computation of Similarities between Nodes of a Graph with Application to Collaborative Recommendation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[8]  John D. Garofalakis,et al.  NCDREC: A Decomposability Inspired Framework for Top-N Recommendation , 2014, 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[9]  A. M. Madni,et al.  Recommender systems in e-commerce , 2014, 2014 World Automation Congress (WAC).

[10]  Marco Gori,et al.  Scalable pseudo-likelihood estimation in hybrid random fields , 2009, KDD.

[11]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[12]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[13]  John D. Garofalakis,et al.  On the Use of Lanczos Vectors for Efficient Latent Factor-Based Top-N Recommendation , 2014, WIMS '14.

[14]  Lars Schmidt-Thieme,et al.  Learning Attribute-to-Feature Mappings for Cold-Start Recommendations , 2010, 2010 IEEE International Conference on Data Mining.

[15]  Ram D. Gopal,et al.  Empirical Analysis of the Impact of Recommender Systems on Sales , 2010, J. Manag. Inf. Syst..

[16]  John D. Garofalakis,et al.  Top-N recommendations in the presence of sparsity: An NCD-based approach , 2015, Web Intell..

[17]  Oliver Hinz,et al.  The Impact of Search and Recommendation Systems on Sales in Electronic Commerce , 2010, Bus. Inf. Syst. Eng..

[18]  Liyan Zhang,et al.  A Novel Recommending Algorithm Based on Topical PageRank , 2008, Australasian Conference on Artificial Intelligence.

[19]  Suhrid Balakrishnan,et al.  Collaborative ranking , 2012, WSDM '12.

[20]  Leo Katz,et al.  A new status index derived from sociometric analysis , 1953 .

[21]  Domonkos Tikk,et al.  Scalable Collaborative Filtering Approaches for Large Recommender Systems , 2009, J. Mach. Learn. Res..

[22]  François Fouss,et al.  An experimental investigation of kernels on graphs for collaborative recommendation and semisupervised classification , 2012, Neural Networks.

[23]  John D. Garofalakis,et al.  Hierarchical Itemspace Rank: Exploiting hierarchy to alleviate sparsity in ranking-based recommendation , 2015, Neurocomputing.

[24]  Hui Xiong,et al.  Enhancing Collaborative Filtering by User Interest Expansion via Personalized Ranking , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[26]  Lixin Gao,et al.  The impact of YouTube recommendation system on video views , 2010, IMC '10.

[27]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[28]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[29]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[30]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[31]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[32]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[33]  Thorsten Joachims,et al.  Unbiased Learning-to-Rank with Biased Feedback , 2016, WSDM.

[34]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[35]  Axel Ruhe,et al.  A Krylov Subspace Method for Information Retrieval , 2005, SIAM J. Matrix Anal. Appl..

[36]  Jack Dongarra,et al.  MPI - The Complete Reference: Volume 1, The MPI Core , 1998 .

[37]  Marco Gori,et al.  ItemRank: A Random-Walk Based Scoring Algorithm for Recommender Engines , 2007, IJCAI.

[38]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[39]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[40]  Pavel Yu. Chebotarev,et al.  The Matrix-Forest Theorem and Measuring Relations in Small Social Groups , 2006, ArXiv.

[41]  C. V. Ramamoorthy,et al.  Knowledge and Data Engineering , 1989, IEEE Trans. Knowl. Data Eng..

[42]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[43]  Yousef Saad,et al.  Lanczos Vectors versus Singular Vectors for Effective Dimension Reduction , 2009, IEEE Transactions on Knowledge and Data Engineering.

[44]  Priscilla S. Markwood,et al.  The Long Tail: Why the Future of Business is Selling Less of More , 2006 .

[45]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[47]  Ed Anderson,et al.  LAPACK Users' Guide , 1995 .

[48]  Eloy Romero,et al.  PRIMME_SVDS: A High-Performance Preconditioned SVD Solver for Accurate Large-Scale Computations , 2016, SIAM J. Sci. Comput..

[49]  George Karypis,et al.  A Comprehensive Survey of Neighborhood-based Recommendation Methods , 2011, Recommender Systems Handbook.

[50]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[51]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[52]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[53]  Mohit Sharma,et al.  Feature-based factorized Bilinear Similarity Model for Cold-Start Top-n Item Recommendation , 2019, SDM.

[54]  Yehuda Koren,et al.  OrdRec: an ordinal model for predicting personalized item rating distributions , 2011, RecSys '11.

[55]  George Karypis,et al.  User-Specific Feature-Based Similarity Models for Top-n Recommendation of New Items , 2015, ACM Trans. Intell. Syst. Technol..

[56]  J. Demmel,et al.  Sun Microsystems , 1996 .

[57]  James Bennett,et al.  The Netflix Prize , 2007 .