Content Volatility of Scientific Topics in Wikipedia: A Cautionary Tale

Wikipedia has quickly become one of the most frequently accessed encyclopedic references, despite the ease with which content can be changed and the potential for ‘edit wars’ surrounding controversial topics. Little is known about how this potential for controversy affects the accuracy and stability of information on scientific topics, especially those with associated political controversy. Here we present an analysis of the Wikipedia edit histories for seven scientific articles and show that topics we consider politically but not scientifically “controversial” (such as evolution and global warming) experience more frequent edits with more words changed per day than pages we consider “noncontroversial” (such as the standard model in physics or heliocentrism). For example, over the period we analyzed, the global warming page was edited on average (geometric mean ±SD) 1.9±2.7 times resulting in 110.9±10.3 words changed per day, while the standard model in physics was only edited 0.2±1.4 times resulting in 9.4±5.0 words changed per day. The high rate of change observed in these pages makes it difficult for experts to monitor accuracy and contribute time-consuming corrections, to the possible detriment of scientific accuracy. As our society turns to Wikipedia as a primary source of scientific information, it is vital we read it critically and with the understanding that the content is dynamic and vulnerable to vandalism and other shenanigans.

[1]  Kathrin M. Möslein,et al.  Proceedings of The International Symposium on Open Collaboration , 2014 .

[2]  Richard Rogers,et al.  Contropedia - the analysis and visualization of controversies in Wikipedia articles , 2014, OpenSym.

[3]  Victor M. Darriba,et al.  Computational Linguistics and Intelligent Text Processing , 2014, Lecture Notes in Computer Science.

[4]  Taha Yasseri,et al.  The distorted mirror of Wikipedia: a quantitative analysis of Wikipedia coverage of academics , 2013, EPJ Data Science.

[5]  Edgar Brunner,et al.  Rank-based multiple test procedures and simultaneous confidence intervals , 2012 .

[6]  D. Lindenmayer Merchants of Doubt. How a Handful of Scientists Obscured the Truth on Issues from Tobacco Smoke to Global Warming , 2012 .

[7]  András Kornai,et al.  Dynamics of Conflicts in Wikipedia , 2012, PloS one.

[8]  András Kornai,et al.  Edit Wars in Wikipedia , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[9]  A. Bond Why ornithologists should embrace and contribute to Wikipedia , 2011 .

[10]  Matthew J. Betts,et al.  Content Disputes in Wikipedia Reflect Geopolitical Instability , 2011, PloS one.

[11]  Paolo Rosso,et al.  Wikipedia Vandalism Detection: Combining Natural Language, Metadata, and Reputation Features , 2011, CICLing.

[12]  A. Bateman,et al.  Time to underpin Wikipedia wisdom , 2010, Nature.

[13]  Kathy West,et al.  Wikipedia: friend or foe? , 2009 .

[14]  Neil L. Waters,et al.  Why you can't cite Wikipedia in my class , 2007, CACM.

[15]  Finn Årup Nielsen,et al.  Scientific citations in Wikipedia , 2007, First Monday.

[16]  Aniket Kittur,et al.  He says, she says: conflict and coordination in Wikipedia , 2007, CHI.

[17]  J. Giles Internet encyclopaedias go head to head , 2005, Nature.

[18]  P. Ingwersen,et al.  Proceedings of ISSI 2005 – The 10th International Conference of the International Society for Scientometrics and Informetrics: Stockholm, Sweden, July 24-28, 2005 , 2005 .

[19]  P H Abelson,et al.  Acid rain. , 1983, Science.

[20]  John M. Wood,et al.  A Progress Report on Mercury , 1972 .