Distributed collaborative filtering with domain specialization

User data scarcity has always been indicated among the major problems of collaborative filtering recommender systems. That is, if two users do not share sufficiently large set of items for whom their ratings are known, then the user-to-user similarity computation is not reliable and a rating prediction for one user can not be based on the ratings of the other. This paper shows that this problem can be solved, and that the accuracy of collaborative recommendations can be improved by: a) partitioning the collaborative user data into specialized and distributed repositories, and b) aggregating information coming from these repositories. This paper explores a content-dependent partitioning of collaborative movie ratings, where the ratings are partitioned according to the genre of the movie and presents an evaluation of four aggregation approaches. The evaluation demonstrates that the aggregation improves the accuracy of a centralized system containing the same ratings and proves the feasibility and advantages of a distributed collaborative filtering scenario.

[1]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[2]  Tsvi Kuflik,et al.  Collaborative filtering over distributed environment , 2005 .

[3]  Shlomo Berkovsky,et al.  Decentralized Mediation of User Models for a Better Personalization , 2006, AH.

[4]  Hans-Peter Kriegel,et al.  Feature Weighting and Instance Selection for Collaborative Filtering: An Information-Theoretic Approach* , 2003, Knowledge and Information Systems.

[5]  Tsvi Kuflik,et al.  Cross-Domain Mediation in Collaborative Filtering , 2007, User Modeling.

[6]  Derek G. Bridge,et al.  Ways of Computing Diverse Collaborative Recommendations , 2006, AH.

[7]  Barry Smyth,et al.  Communities , Collaboration and Cooperation in Personalized Web Search ∗ , 2005 .

[8]  Tsvi Kuflik,et al.  Identifying Inter-Domain Similarities Through Content-Based Analysis of Hierarchical Web-Directories , 2006, ECAI.

[9]  Eric Horvitz,et al.  Social Choice Theory and Recommender Systems: Analysis of the Axiomatic Foundations of Collaborative Filtering , 2000, AAAI/IAAI.

[10]  Bradley N. Miller,et al.  PocketLens: Toward a personal recommender system , 2004, TOIS.

[11]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[12]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[13]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[14]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[15]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[16]  Luo Si,et al.  An automatic weighting scheme for collaborative filtering , 2004, SIGIR '04.

[17]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[18]  Cherié L. Weible,et al.  The Internet Movie Database , 2001 .

[19]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[20]  Chunxiao Xing,et al.  Similarity measure and instance selection for collaborative filtering , 2003, WWW '03.

[21]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.