Trust Evaluation Mechanisms for Wikipedia

Wikipedia is the well-nigh successful and most popular free encyclopedia developed by many editors in collaborative manner. It provides multitude of opportunities for online large scale knowledge sharing between virtual communities by letting the viewer to create and edit articles directly in the web browser. Information on Wikipedia is expanding largely, but the increase in quantity is not proportional to quality of the content. The cursory observer of Wikipedia may not be able to differentiate between the good and the bad quality of the content. Despite the success of Wikipedia, trust on Wikipedia content is still questioned because of its open editing model. In this paper primarily the challenges for trust evaluation mechanisms, caused by the significant characteristics of Wikipedia’s knowledge base are discussed. Existing Wikipedia trust evaluation models are comprehensively surveyed and key issues related to these are highlighted. Finally based on this study new dimensions for effective trust evaluation mechanisms are proposed, which are aimed to setup clear goals for future research in this area.

[1]  Ben Shneiderman,et al.  Designing trust into online experiences , 2000, CACM.

[2]  Aniket Kittur,et al.  Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia , 2008, CSCW.

[3]  Mikalai Sabel Structuring wiki revision history , 2007, WikiSym '07.

[4]  Aniket Kittur,et al.  Lifting the veil: improving accountability and social transparency in Wikipedia with wikidashboard , 2008, CHI.

[5]  Aaron Halfaker,et al.  Wikipedians are born, not made: a study of power editors on Wikipedia , 2009, GROUP.

[6]  Klaus Stein,et al.  Does it matter who contributes: a study on featured articles in the german wikipedia , 2007, HT '07.

[7]  Krishnendu Chatterjee,et al.  Assigning trust to Wikipedia content , 2008, Int. Sym. Wikis.

[8]  Peter J. Denning,et al.  Wikipedia risks , 2005, CACM.

[9]  J. Giles Internet encyclopaedias go head to head , 2005, Nature.

[10]  Peter A. Gloor,et al.  Social capital increases efficiency of collaboration among Wikipedia editors , 2011, HT '11.

[11]  Mark Kramer,et al.  Wiki trust metrics based on phrasal analysis , 2008, Int. Sym. Wikis.

[12]  Laurent Vercouter,et al.  Trust Based Evaluation of Wikipedia's Contributors , 2009, ESAW.

[13]  Jan Maarten Schraagen,et al.  Evaluating WikiTrust: A trust support tool for Wikipedia , 2011, First Monday.

[14]  C. Fuchs Don Tapscott & Anthony D. Williams: Wikinomics: How Mass Collaboration Changes Everything , 2008 .

[15]  Luca de Alfaro,et al.  Measuring author contributions to the Wikipedia , 2008, Int. Sym. Wikis.

[16]  Robert West,et al.  A data-driven sketch of Wikipedia editors , 2012, WWW.

[17]  Haifeng Zhao,et al.  Read What You Trust: An Open Wiki Model Enhanced by Social Context , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[18]  Denilson Barbosa,et al.  Leveraging editor collaboration patterns in wikipedia , 2012, HT '12.

[19]  Christian Damsgaard Jensen,et al.  Collaborative trust evaluation for wiki security , 2012, 2012 Tenth Annual International Conference on Privacy, Security and Trust.

[20]  Les Gasser,et al.  Information quality work organization in wikipedia , 2008, J. Assoc. Inf. Sci. Technol..

[21]  Ipke Wachsmuth,et al.  Interfacing Virtual Agents with Collaborative Knowledge: Open Domain Question Answering Using Wikipedia-Based Topic Models , 2011, IJCAI.

[22]  Gary E. Gorman Editorial: Is the wiki concept really so wonderful? , 2005, Online Inf. Rev..

[23]  K Lampe,et al.  Internet Health Resources: from Quality to Trust , 2003, Methods of Information in Medicine.

[24]  Bernardo A. Huberman,et al.  Cooperation and quality in wikipedia , 2007, WikiSym '07.

[25]  Linda C. Smith,et al.  INFORMATION QUALITY DISCUSSIONS IN WIKIPEDIA , 2005 .

[26]  Deborah L. McGuinness,et al.  Mining Revision History to Assess Trustworthiness of Article Fragments , 2006, 2006 International Conference on Collaborative Computing: Networking, Applications and Worksharing.

[27]  Deborah L. McGuinness,et al.  Investigations into Trust for Collaborative Information Repositories: A Wikipedia Case Study , 2006, MTW.

[28]  Morris Sloman,et al.  Trust Management Tools for Internet Applications , 2003, iTrust.

[29]  Luca de Alfaro,et al.  A content-driven reputation system for the wikipedia , 2007, WWW '07.

[30]  Jan Maarten Schraagen,et al.  Researching trust in Wikipedia , 2011 .

[31]  Luca de Alfaro,et al.  Detecting Wikipedia Vandalism using WikiTrust - Lab Report for PAN at CLEF 2010 , 2010, CLEF.

[32]  Deborah L. McGuinness,et al.  Computing trust from revision history , 2006, PST.

[33]  Jesús M. González-Barahona,et al.  Quantitative analysis of thewikipedia community of users , 2007, WikiSym '07.

[34]  Cristina V. Lopes,et al.  Statistical measure of quality in Wikipedia , 2010, SOMA '10.

[35]  Masatoshi Yoshikawa,et al.  Mutual evaluation of editors and texts for assessing quality of Wikipedia articles , 2012, WikiSym '12.

[36]  Andrew Lih,et al.  Wikipedia as Participatory Journalism: Reliable Sources? Metrics for evaluating collaborative media as a news resource , 2004 .

[37]  Huan Liu,et al.  Evaluating the trustworthiness of Wikipedia articles through quality and credibility , 2009, Int. Sym. Wikis.