Rating the raters: a reputation system for wiki-like domains

Collaborative sites like Wikipedia allow the public to contribute contents to a particular domain to ensure a site's growth. However, a major concern with such sites is the credibility of the information posted. Malicious and "lazy" authors can intentionally or accidentally contribute entries that are inaccurate. This paper presents a user-driven reputation system called Rater Rating that encourages authors to review entries in collaborative sites. It uses concepts adopted from reputation systems in mobile ad-hoc networks (MANETs) that promotes cooperation among network nodes. Rater Rating measures the overall reputation of authors based on the quality of their contribution and the "seriousness" of their ratings. Simulations were performed to verify the algorithm's potential in measuring the credibility of ratings made by various raters (i.e. good and lazy). The results show that only 1 out of 4 raters is needed to be a good rater in order to make the algorithm effective.

[1]  J. Wooders,et al.  Reputation in Auctions: Theory, and Evidence from Ebay , 2006 .

[2]  Hector Garcia-Molina,et al.  Limited reputation sharing in P2P systems , 2004, EC '04.

[3]  Refik Molva,et al.  Core: a collaborative reputation mechanism to enforce node cooperation in mobile ad hoc networks , 2002, Communications and Multimedia Security.

[4]  Animesh Kr Trivedi,et al.  Mobile Ad Hoc Network Security Vulnerabilities , 2009 .

[5]  Mary Baker,et al.  Observation-based Cooperation Enforcement in Ad Hoc Networks , 2003, ArXiv.

[6]  Jean-Yves Le Boudec,et al.  Nodes bearing grudges: towards routing security, fairness, and robustness in mobile ad hoc networks , 2002, Proceedings 10th Euromicro Workshop on Parallel, Distributed and Network-based Processing.

[7]  Mike Burmester,et al.  LARS: a locally aware reputation system for mobile ad hoc networks , 2006, ACM-SE 44.

[8]  Cristina Nita-Rotaru,et al.  A survey of attack and defense techniques for reputation systems , 2009, CSUR.

[9]  S. Buchegger,et al.  A Robust Reputation System for P2P and Mobile Ad-hoc Networks , 2004 .

[10]  Krishnendu Chatterjee,et al.  Assigning trust to Wikipedia content , 2008, Int. Sym. Wikis.

[11]  Xin Yao,et al.  Effects of customer feedback level and (in) consistency on new product acceptance in the click-and-mortar context , 2009 .

[12]  Luca de Alfaro,et al.  A content-driven reputation system for the wikipedia , 2007, WWW '07.

[13]  John R. Douceur,et al.  The Sybil Attack , 2002, IPTPS.

[14]  Hector Garcia-Molina,et al.  The Eigentrust algorithm for reputation management in P2P networks , 2003, WWW '03.

[15]  Luca de Alfaro,et al.  Measuring author contributions to the Wikipedia , 2008, Int. Sym. Wikis.

[16]  Jean-Yves Le Boudec,et al.  Performance analysis of the CONFIDANT protocol , 2002, MobiHoc '02.

[17]  Philip S. Yu,et al.  On balancing the load in a clustered web farm , 2001, TOIT.

[18]  David A. Maltz,et al.  DSR: the dynamic source routing protocol for multihop wireless ad hoc networks , 2001 .

[19]  Mary Baker,et al.  Mitigating routing misbehavior in mobile ad hoc networks , 2000, MobiCom '00.

[20]  Jonathon T. Giffin,et al.  An auctioning reputation system based on anomaly , 2005, CCS '05.

[21]  Ernst W. Biersack,et al.  Performance comparison of centralized versus distributed error recovery for reliable multicast , 2000, TNET.

[22]  Charles E. Perkins,et al.  Ad-hoc on-demand distance vector routing , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[23]  Hao Wang,et al.  An auctioning reputation system based on anomaly , 2005, CCS.

[24]  Jean-Yves Le Boudec,et al.  Performance analysis of the CONFIDANT protocol , 2002, MobiHoc '02.

[25]  Tom Cross,et al.  Puppy smoothies: Improving the reliability of open, collaborative wikis , 2006, First Monday.

[26]  Paul Resnick,et al.  Reputation systems , 2000, CACM.