Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work

Reverts are important to maintaining the quality of Wikipedia. They fix mistakes, repair vandalism, and help enforce policy. However, reverts can also be damaging, especially to the aspiring editor whose work they destroy. In this research we analyze 400,000 Wikipedia revisions to understand the effect that reverts had on editors. We seek to understand the extent to which they demotivate users, reducing the workforce of contributors, versus the extent to which they help users improve as encyclopedia editors. Overall we find that reverts are powerfully demotivating, but that their net influence is that more quality work is done in Wikipedia as a result of reverts than is lost by chasing editors away. However, we identify key conditions -- most specifically new editors being reverted by much more experienced editors - under which reverts are particularly damaging. We propose that reducing the damage from reverts might be one effective path for Wikipedia to solve the newcomer retention problem.

[1]  Ulrik Brandes,et al.  Visual Analysis of Controversy in User-Generated Encyclopedias∗ , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[2]  Amy Bruckman,et al.  From Wikipedia to the Classroom: Exploring Online Publication and Learning , 2006, ICLS.

[3]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[4]  Martin Wattenberg,et al.  Studying cooperation and conflict between authors with history flow visualizations , 2004, CHI.

[5]  Robert E. Kraut,et al.  Socialization tactics in wikipedia and their effects , 2010, CSCW '10.

[6]  Dan Cosley,et al.  What's mine is mine: territoriality in collaborative authoring , 2009, CHI.

[7]  Aniket Kittur,et al.  He says, she says: conflict and coordination in Wikipedia , 2007, CHI.

[8]  Axel Bruns,et al.  Wikis in teaching and assessment: the M/Cyclopedia project , 2005, Int. Sym. Wikis.

[9]  Aniket Kittur,et al.  Beyond Wikipedia: coordination and conflict in online production groups , 2010, CSCW '10.

[10]  Stephen Barrett,et al.  Extracting Trust from Domain Analysis: A Case Study on the Wikipedia Project , 2006, ATC.

[11]  Luca de Alfaro,et al.  A content-driven reputation system for the wikipedia , 2007, WWW '07.

[12]  Aniket Kittur,et al.  Us vs. Them: Understanding Social Dynamics in Wikipedia with Revert Graph Visualizations , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[13]  Aaron Halfaker,et al.  A jury of your peers: quality, experience and ownership in Wikipedia , 2009, Int. Sym. Wikis.

[14]  Camille Roth,et al.  Measuring wiki viability: an empirical assessment of the social dynamics of a large sample of wikis , 2008, Int. Sym. Wikis.

[15]  R. Stuart Geiger,et al.  The work of sustaining order in wikipedia: the banning of a vandal , 2010, CSCW '10.

[16]  John Riedl,et al.  rv you're dumb: identifying discarded work in Wiki article history , 2009, Int. Sym. Wikis.

[17]  S. Karau,et al.  Understanding individual motivation in groups: The collective effort model. , 2001 .

[18]  Ed H. Chi,et al.  The singularity is not near: slowing growth of Wikipedia , 2009, Int. Sym. Wikis.

[19]  John Riedl,et al.  Creating, destroying, and restoring value in wikipedia , 2007, GROUP.

[20]  Jonathan Grudin,et al.  Wikis at work: success factors and challenges for sustainability of enterprise Wikis , 2010, Int. Sym. Wikis.

[21]  P. D. Magnus,et al.  Early Response to False Claims in Wikipedia , 2008, First Monday.

[22]  Linda C. Smith,et al.  INFORMATION QUALITY DISCUSSIONS IN WIKIPEDIA , 2005 .

[23]  Deborah L. McGuinness,et al.  Mining Revision History to Assess Trustworthiness of Article Fragments , 2006, 2006 International Conference on Collaborative Computing: Networking, Applications and Worksharing.

[24]  Yvette Salaün,et al.  Information quality: meeting the needs of the consumer , 2001, Int. J. Inf. Manag..

[25]  Michael Zhang,et al.  Intrinsic Motivation of Open Content Contributors : the Case of Wikipedia Xiaoquan ( , 2006 .

[26]  Les Gasser,et al.  Assessing Information Quality of a Community-Based Encyclopedia , 2005, ICIQ.