Collaborative Filtering via Concept Decomposition on the Netflix Dataset

Collaborative filtering recommender systems make automatic predictions about the interests of a user by collectin g information from many users (collaborating). Most recommendation algorithms are based in finding sets of customers or items whose ra tings overlap in order to create a model for inferring future ratin gs or items that might be of interest for a particular user. Traditional collaborative filtering techniques such as k-Nearest Neighbours and S i gular Value Decomposition (SVD) usually provide good accuracy bu t are computationally very expensive. The Netflix Prize is a colla borative filtering problem whose dataset is much larger than the previ ously known benchmark sets and thus traditional methods are stres sed to their limits when challenged with a dataset of that size. In t his paper we present experimental results that show how the concept decomposition method performs on the movie rating prediction task over the Netflix dataset and we show that it is able to achieve a well bal anced performance between computational complexity and predict ion accuracy.

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[2]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[3]  Yehuda Koren,et al.  Lessons from the Netflix prize challenge , 2007, SKDD.

[4]  GoldbergDavid,et al.  Using collaborative filtering to weave an information tapestry , 1992 .

[5]  James Bennett,et al.  The Netflix Prize , 2007 .

[6]  Bradley N. Miller,et al.  MovieLens unplugged: experiences with an occasionally connected recommender system , 2003, IUI '03.

[7]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[8]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[9]  Boi Faltings,et al.  Using hierarchical clustering for learning theontologies used in recommendation systems , 2007, KDD '07.

[10]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[11]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[12]  G. Karypis,et al.  Incremental Singular Value Decomposition Algorithms for Highly Scalable Recommender Systems , 2002 .

[13]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[14]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[15]  Nathan Srebro,et al.  Fast maximum margin matrix factorization for collaborative prediction , 2005, ICML.

[16]  A. B. Gil,et al.  Recommender Systems in E-Commerce , 2006 .

[17]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[18]  Paul Resnick,et al.  Recommender Systems - Introduction to the Special Section , 1997, Commun. ACM.

[19]  Inderjit S. Dhillon,et al.  Concept Decompositions for Large Sparse Text Data Using Clustering , 2004, Machine Learning.

[20]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[21]  Bradley N. Miller,et al.  GroupLens: applying collaborative filtering to Usenet news , 1997, CACM.

[22]  Cherié L. Weible,et al.  The Internet Movie Database , 2001 .