Extracting Trust from Domain Analysis: A Case Study on the Wikipedia Project

The problem of identifying trustworthy information on the World Wide Web is becoming increasingly acute as new tools such as wikis and blogs simplify and democratize publications. Wikipedia is the most extraordinary example of this phenomenon and, although a few mechanisms have been put in place to improve contributions quality, trust in Wikipedia content quality has been seriously questioned. We thought that a deeper understanding of what in general defines high-standard and expertise in domains related to Wikipedia – i.e. content quality in a collaborative environment – mapped onto Wikipedia elements would lead to a complete set of mechanisms to sustain trust in Wikipedia context. Our evaluation, conducted on about 8,000 articles representing 65% of the overall Wikipedia editing activity, shows that the new trust evidence that we extracted from Wikipedia allows us to transparently and automatically compute trust values to isolate articles of great or low quality.

[1]  Stephen Marsh,et al.  Formalising Trust as a Computational Concept , 1994 .

[2]  J. Giles.  Internet encyclopaedias go head to head , 2005, Nature.

[3]  Joan Feigenbaum,et al.  Decentralized trust management , 1996, Proceedings 1996 IEEE Symposium on Security and Privacy.

[4]  Michael Coghlan,et al.  Online Collaborative Learning: Theory and Practice , 2004, J. Educ. Technol. Soc..

[5]  Anne Morris,et al.  Web Wisdom: How to Evaluate and Create Information Quality on the Web , 2000 .

[6]  Yang-hua Chu.  Trust management for the World Wide Web , 1997 .

[7]  Michael J. Prietula,et al.  The Turing effect: the nature of trust in expert systems advice , 1997 .

[8]  Robin Burke,et al.  Knowledge-based recommender systems , 2000 .

[9]  Cai-Nicolas Ziegler.  Investigating Correlations of Trust and Interest Similarity-Do Birds of a Feather Really Flock Together ? , 2005 .

[10]  Hans-Jürgen Bucher,et al.  Crisis Communication and the Internet: Risk and Trust in a Global Media , 2002, First Monday.

[11]  David W. Chadwick,et al.  The Implementation of a System for Evaluating Trust in a PKI Environment , 2003 .

[12]  D. R. Danielson,et al.  How do users evaluate the credibility of Web sites?: a study with over 2,500 participants , 2003, DUX '03.

[13]  Donna Romano,et al.  The nature of trust: conceptual and operational clarification , 2003 .

[14]  R. Guha,et al.  Open Rating Systems , 2002 .

[15]  James A. Hendler,et al.  Trust Networks on the Semantic Web , 2003, WWW.

[16]  T. Matthew Ciolek.  Today's WWW - Tomorrow's MMM? The Specter of Multi-Media Mediocrity , 1996, Computer.

[17]  Rachel Cassel.  Selection criteria for Internet resources , 1995 .

[18]  Tim S. Roberts.  Online Collaborative Learning: Theory and Practice , 2003 .

[19]  Yong Chen,et al.  Using Trust for Secure Collaboration in Uncertain Environments , 2003, IEEE Pervasive Comput..

[20]  Paddy Nixon,et al.  The SECURE collaboration model , 2003 .

[21]  Mark S. Fox,et al.  Uncertainty in Knowledge Provenance , 2004, ESWS.