WHATSUP: A Decentralized Instant News Recommender

We present WHATSUP, a collaborative filtering system for disseminating news items in a large-scale dynamic setting with no central authority. WHATSUP constructs an implicit social network based on user profiles that express the opinions of users about the news items they receive (like-dislike). Users with similar tastes are clustered using a similarity metric reflecting long-standing and emerging (dis)interests. News items are disseminated through a novel heterogeneous gossip protocol that (1) biases the orientation of its targets towards those with similar interests, and (2) amplifies dissemination based on the level of interest in every news item. We report on an extensive evaluation of WHATSUP through (a) simulations, (b) a ModelNet emulation on a cluster, and (c) a PlanetLab deployment based on real datasets. We show that WHATSUP outperforms various alternatives in terms of accurate and complete delivery of relevant news items while preserving the fundamental advantages of standard gossip: namely, simplicity of deployment and robustness.

[1]  Wei Tsang Ooi,et al.  Controlling Gossip Protocol Infection Pattern Using Adaptive Fanout , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[2]  Krishna P. Gummadi,et al.  You are who you know: inferring user profiles in online social networks , 2010, WSDM '10.

[3]  Lada A. Adamic,et al.  Information flow in social groups , 2003, cond-mat/0305305.

[4]  Mehran Sahami,et al.  Evaluating similarity measures: a large-scale study in the orkut social network , 2005, KDD '05.

[5]  Anne-Marie Kermarrec,et al.  Gossip-based peer sampling , 2007, TOCS.

[6]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[7]  Giovanni Giuffrida,et al.  A Recommendation Algorithm for Personalized Online News based on Collective Intelligence and Content , 2011, ICAART.

[8]  Nick Mathewson,et al.  Tor: The Second-Generation Onion Router , 2004, USENIX Security Symposium.

[9]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[10]  ChengXiang Zhai,et al.  An Online News Recommender System for Social Networks , 2009 .

[11]  L. Massoulié,et al.  Epidemics and Rumours in Complex Networks: From microscopic to macroscopic dynamics , 2009 .

[12]  Anne-Marie Kermarrec,et al.  Heterogeneous Gossip , 2009, Middleware.

[13]  Maarten van Steen,et al.  Epidemic-Style Management of Semantic Overlays for Content-Based Searching , 2005, Euro-Par.

[14]  Yoav Tock,et al.  SpiderCast: a scalable interest-aware overlay for topic-based pub/sub communication , 2007, DEBS '07.

[15]  Rajesh Sharma,et al.  GoDisco: Selective Gossip Based Dissemination of Information in Social Community Based Overlays , 2011, ICDCN.

[16]  Fan Yang,et al.  A scalable P2P recommender system based on distributed collaborative filtering , 2004, Expert Syst. Appl..

[17]  Masanori Takezawa,et al.  Centrality in sociocognitive networks and social influence : An illustration in a group decision-making context , 1997 .

[18]  Alexander J. Smola,et al.  Like like alike: joint friendship and interest propagation in social networks , 2011, WWW.

[19]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[20]  Abhinandan Das,et al.  Google news personalization: scalable online collaborative filtering , 2007, WWW '07.

[21]  Grigorios Tsoumakas,et al.  PersoNews: A Personalized News Reader Enhanced by Machine Learning and Semantic Filtering , 2006, OTM Conferences.

[22]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[24]  Thomas E. Anderson,et al.  Privacy-preserving P2P data sharing with OneSwarm , 2010, SIGCOMM '10.

[25]  Bradley N. Miller,et al.  PocketLens: Toward a personal recommender system , 2004, TOIS.