Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research

Background Articles whose authors have supplemented subscription-based access to the publisher's version by self-archiving their own final draft to make it accessible free for all on the web (“Open Access”, OA) are cited significantly more than articles in the same journal and year that have not been made OA. Some have suggested that this “OA Advantage” may not be causal but just a self-selection bias, because authors preferentially make higher-quality articles OA. To test this we compared self-selective self-archiving with mandatory self-archiving for a sample of 27,197 articles published 2002–2006 in 1,984 journals. Methdology/Principal Findings The OA Advantage proved just as high for both. Logistic regression analysis showed that the advantage is independent of other correlates of citations (article age; journal impact factor; number of co-authors, references or pages; field; article type; or country) and highest for the most highly cited articles. The OA Advantage is real, independent and causal, but skewed. Its size is indeed correlated with quality, just as citations themselves are (the top 20% of articles receive about 80% of all citations). Conclusions/Significance The OA advantage is greater for the more citable articles, not because of a quality bias from authors self-selecting what to make OA, but because of a quality advantage, from users self-selecting what to use and cite, freed by OA from the constraints of selective accessibility to subscribers only. It is hoped that these findings will help motivate the adoption of OA self-archiving mandates by universities, research institutions and research funders.

[1]  Abbas Horri,et al.  The citation performance of open access journals: A disciplinary investigation of citation distribution models , 2007 .

[2]  Colin Smith,et al.  Open Research Online - a self-archiving success story , 2010 .

[3]  Andrew Odlyzko,et al.  Economic costs of toll access , 2006 .

[4]  J. Nicolaisen Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics , 2010 .

[5]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[6]  Per O. Seglen,et al.  The Skewness of Science , 1992, J. Am. Soc. Inf. Sci..

[7]  B. Björk,et al.  Open Access to the Scientific Journal Literature: Situation 2009 , 2010, PloS one.

[8]  Bo-Christer Björk,et al.  Global annual volume of peer reviewed scholarly articles and the share available via different Open Access options , 2008, ELPUB.

[9]  Charles Oppenheim,et al.  The citation advantage of open-access articles , 2008, J. Assoc. Inf. Sci. Technol..

[10]  Philip M. Davis,et al.  Open access publishing, article downloads, and citations: randomised controlled trial , 2008, BMJ : British Medical Journal.

[11]  N. Adler,et al.  When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings , 2009 .

[12]  Alma Swan,et al.  Institutions, Their Repositories and the Web , 2008 .

[13]  S. Harnad,et al.  Cognition distributed : how cognitive technology extends our minds , 2008 .

[14]  Stevan Harnad,et al.  Offloading Cognition onto Cognitive Technology , 2008, ArXiv.

[15]  Alma Swan,et al.  The culture of Open Access: researchers’ views and responses , 2006 .

[16]  Antonella De Robbio,et al.  Analisi citazionale e indicatori bibliometrici nel modello Open Access , 2007 .

[17]  S. Lawrence Free online availability substantially increases a paper's impact , 2001, Nature.

[18]  Lokman I. Meho,et al.  Using the h-index to rank influential information scientists , 2006, J. Assoc. Inf. Sci. Technol..

[19]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[20]  Eugene Garfield,et al.  Citation Frequency as a Measure of Research Activity and Performance , 1962 .

[21]  Stephen S. Murray,et al.  The effect of use and access on citations , 2005, Inf. Process. Manag..

[22]  Anne-Wil Harzing,et al.  Google Scholar as a new source for citation analysis , 2008 .

[23]  Stevan Harnad,et al.  Earlier Web Usage Statistics as Predictors of Later Citation Impact , 2005, J. Assoc. Inf. Sci. Technol..

[24]  Vincent Larivière,et al.  Modeling a century of citation distributions , 2008, J. Informetrics.

[25]  Stevan Harnad,et al.  Ten-Year Cross-Disciplinary Comparison of the Growth of Open Access and How it Increases Research Citation Impact , 2005, IEEE Data Eng. Bull..

[26]  C. Lee Giles,et al.  CiteSeer: an automatic citation indexing system , 1998, DL '98.

[27]  Péter Jacsó,et al.  Testing the Calculation of a Realistic h-index in Google Scholar, Scopus, and Web of Science for F. W. Lancaster , 2008, Libr. Trends.

[28]  Iain D. Craig,et al.  Do open access articles have greater citation impact?: A critical review of the literature , 2007, J. Informetrics.

[29]  Steve Hitchcock,et al.  The effect of open access and downloads ('hits') on citation impact: a bibliography of studies , 2004 .

[30]  A. Diamond,et al.  What is a Citation Worth ? , 2001 .

[31]  Charles Oppenheim Do Citations Count? Citation Indexing and the Research Assessment Exercise (RAE) , 1996 .

[32]  Steffen Bernius,et al.  Open Access to Scientific Literature - Increasing Citations as an Incentive for Authors to Make Their Publications Freely Accessible , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[33]  Les Carr,et al.  Incentivizing the Open Access Research Web: Publication-Archiving, Data-Archiving and Scientometrics , 2007 .

[34]  Stephen S. Murray,et al.  Effect of E-printing on Citation Rates in Astronomy and Physics , 2006, ArXiv.

[35]  Tim Brody,et al.  5 – The impact loss to authors and research , 2006 .

[36]  F. W. Lancaster,et al.  Testing the Calculation of a Realistic h-index in Google Scholar, Scopus, and Web of Science for , 2008 .

[37]  Johan Bollen,et al.  A Principal Component Analysis of 39 Scientific Impact Measures , 2009, PloS one.

[38]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[39]  James A. Evans,et al.  Open Access and Global Participation in Science , 2009, Science.

[40]  Blaise Cronin,et al.  The citation process: The role and significance of citations in scientific communication , 1984 .

[41]  N. Jacobs,et al.  Open access : key strategic, technical and economic aspects , 2006 .

[42]  Henk F. Moed,et al.  Statistical relationships between downloads and citations at the level of individual documents within a single journal , 2005, J. Assoc. Inf. Sci. Technol..

[43]  Arthur H. J. Sale,et al.  The acquisition of open access research articles , 2006, First Monday.

[44]  Alan Singleton,et al.  Bibliometrics and Citation Analysis; from the Science Citation Index to Cybermetrics , 2010, Learn. Publ..

[45]  Stevan Harnad,et al.  Open access scientometrics and the UK Research Assessment Exercise , 2007, Scientometrics.

[46]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[47]  Fytton Rowland,et al.  The citation advantage of open-access articles , 2008 .

[48]  Henk F. Moed,et al.  Statistical relationships between downloads and citations at the level of individual documents within a single journal: Book Reviews , 2005 .

[49]  Edwin A. Henneken,et al.  Open Access does not increase citations for research articles from The Astrophysical Journal , 2007, ArXiv.

[50]  Tim Brody Citebase Search: Autonomous Citation Database for e-Print Archives , 2003 .

[51]  Charles Oppenheim,et al.  Use of citation analysis to predict the outcome of the 2001 Research Assessment Exercise for Unit of Assessment (UoA) 61: Library and Information Management, , 2001, Inf. Res..

[52]  S. Harnad,et al.  Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals , 2004 .

[53]  Philip M. Davis,et al.  Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? , 2006, Scientometrics.

[54]  Stephen S. Murray,et al.  Use of astronomical literature - A report on usage patterns , 2008, J. Informetrics.

[55]  Henk F. Moed,et al.  The effect of 'Open Access' upon citation impact: An analysis of ArXiv's Condensed Matter Section , 2006, ArXiv.

[56]  Les Carr,et al.  Offloading Cognition onto the Web , 2011, IEEE Intelligent Systems.