Will open access increase journal CiteScores? An empirical investigation over multiple disciplines

This paper empirically studies the effect of Open Access on journal CiteScores. We have found that the general effect is positive but not uniform across different types of journals. In particular, we investigate two types of heterogeneous treatment effect: (1) the differential treatment effect among journals grouped by academic field, publisher, and tier; and (2) differential treatment effects of Open Access as a function of propensity to be treated. The results are robust to a number of sensitivity checks and falsification tests. Our findings shed new light on Open Access effect on journals and can help stakeholders of journals in the decision of adopting the Open Access policy.

[1]  Richard J. Roberts,et al.  Bethesda Statement on Open Access Publishing , 2003 .

[2]  Teja Koler-Povh,et al.  Impact of open access on citation of scholarly publications in the field of civil engineering , 2013, Scientometrics.

[3]  Andrew M Ryan,et al.  Methods for evaluating changes in health care policy: the difference-in-differences approach. , 2014, JAMA.

[4]  Henk F. Moed,et al.  The effect of "open access" on citation impact: An analysis of ArXiv's condensed matter section , 2006, J. Assoc. Inf. Sci. Technol..

[5]  Todd A. Gormley,et al.  Common Errors: How to (and Not to) Control for Unobserved Heterogeneity , 2013 .

[6]  Alma Swan,et al.  The Open Access citation advantage: Studies and results to date , 2010 .

[7]  Coady Wing,et al.  Effects of occupational regulations on the cost of dental services: evidence from dental insurance claims. , 2014, Journal of health economics.

[8]  Yu Xie,et al.  Estimating Heterogeneous Treatment Effects with Observational Data , 2012, Sociological methodology.

[9]  J. Angrist,et al.  Empirical Strategies in Labor Economics , 1998 .

[10]  Philip M. Davis.  Eigenfactor : Does the Principle of Repeated Improvement Result in Better Journal Impact Estimates than Raw Citation Counts? , 2008, J. Assoc. Inf. Sci. Technol..

[11]  Lauren B. Collister,et al.  The academic, economic and societal impacts of Open Access: an evidence-based review. , 2016, F1000Research.

[12]  Todd A. Gormley,et al.  Playing It Safe? Managerial Preferences, Risk, and Agency Conflicts , 2016 .

[13]  Paul A. David,et al.  Common Agency Contracting and the Emergence of "Open Science" Institutions , 1998 .

[14]  S. Rijcke,et al.  Bibliometrics: The Leiden Manifesto for research metrics , 2015, Nature.

[15]  B. Björk,et al.  The Development of Open Access Journal Publishing from 1993 to 2009 , 2011, PloS one.

[16]  K. Antelman.  Do Open-Access Articles Have a Greater Research Impact? , 2004 .

[17]  Orley Ashenfelter,et al.  Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs , 1984 .

[18]  Alberto Abadie.  Semiparametric Difference-in-Differences Estimators , 2005 .

[19]  Vincent Larivière,et al.  Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research , 2010, PloS one.

[20]  Christopher M. Snyder,et al.  Does Online Availability Increase Citations? Theory and Evidence from a Panel of Economics and Business Journals , 2013, Review of Economics and Statistics.

[21]  Xianwen Wang,et al.  The open access advantage considering citation, article usage and social media attention , 2015, Scientometrics.

[22]  S. Lawrence.  Free online availability substantially increases a paper's impact , 2001, Nature.

[23]  Steven M. Fazzari,et al.  Financing Constraints and Corporate Investment , 1987 .

[24]  Stevan Harnad,et al.  Ten-Year Cross-Disciplinary Comparison of the Growth of Open Access and How it Increases Research Citation Impact , 2005, IEEE Data Eng. Bull..

[25]  William H Crown,et al.  Propensity-Score Matching in Economic Analyses: Comparison with Regression Models, Instrumental Variables, Residual Inclusion, Differences-in-Differences, and Decomposition Methods , 2014, Applied Health Economics and Health Policy.

[26]  Charles Oppenheim,et al.  The citation advantage of open-access articles , 2008, J. Assoc. Inf. Sci. Technol..

[27]  Erjia Yan,et al.  Adding the dimension of knowledge trading to source impact assessment: Approaches, indicators, and implications , 2017, J. Assoc. Inf. Sci. Technol..

[28]  Edward Vytlacil,et al.  Estimating Marginal Returns to Education , 2010, The American economic review.

[29]  Lauren B. Collister,et al.  The academic, economic and societal impacts of Open Access: an evidence-based review. , 2016, F1000Research.

[30]  Mark L. Burton,et al.  College attendance and the college wage premium: Differences by gender , 1996 .

[31]  Peter A. Bath,et al.  Open‐access repositories worldwide, 2005–2012: Past growth, current characteristics, and future possibilities , 2014, J. Assoc. Inf. Sci. Technol..

[32]  B. Björk,et al.  Open Access to the Scientific Journal Literature: Situation 2009 , 2010, PloS one.

[33]  Yu Xie,et al.  Who Benefits Most from College? , 2010, American sociological review.

[34]  Bladimir Díaz Borges.  Berlin Declaration on Open Access to Knowledge in the Sciences and Humanities , 2008 .

[35]  G. Imbens.  The Role of the Propensity Score in Estimating Dose-Response Functions , 1999 .

[36]  Philip M. Davis,et al.  Open access publishing, article downloads, and citations: randomised controlled trial , 2008, BMJ : British Medical Journal.

[37]  Jonathan Bull,et al.  Will Open Access Get Me Cited? An Analysis of the Efficacy of Open Access Publishing in Political Science , 2014, PS: Political Science & Politics.

[38]  Donald Rubin,et al.  Estimating Causal Effects from Large Data Sets Using Propensity Scores , 1997, Annals of Internal Medicine.

[39]  B. Björk,et al.  Open access versus subscription journals: a comparison of scientific impact , 2012, BMC Medicine.

[40]  Md. Anwarul Islam,et al.  Journal of the Association for Information Science and Technology: Analysis of two decades of published research , 2020, ASIST.

[41]  James A. Evans,et al.  Open Access and Global Participation in Science , 2009, Science.

[42]  Lifang Xu,et al.  Analysis on open access citation advantage: an empirical study based on Oxford open journals , 2011, iConference.

[43]  Stephen Bond,et al.  Financial Factors and Investment in Belgium, France, Germany, and the United Kingdom: A Comparison Using Company Panel Data , 2003, Review of Economics and Statistics.

[44]  Bo-Christer Björk,et al.  Journal of Informetrics , 2022 .

[45]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[46]  Klaus Wohlrabe,et al.  Do open access articles in economics have a citation advantage , 2014 .

[47]  Christopher M. Snyder,et al.  Identifying the Effect of Open Access on Citations Using a Panel of Science Journals , 2013 .

[48]  Till Straumann.  Open Source Real Time Operating Systems Overview , 2001, ArXiv.

[49]  Gerry McKiernan,et al.  arXiv.org: the Los Alamos National Laboratory e‐print server , 2000 .

[50]  Stephen S. Murray,et al.  Effect of E-printing on Citation Rates in Astronomy and Physics , 2006, ArXiv.

[51]  Steve Hitchcock,et al.  The effect of open access and downloads ('hits') on citation impact: a bibliography of studies , 2004 .

[52]  R. Merton.  Social Theory and Social Structure , 1958 .

[53]  R. Breen,et al.  Heterogeneous causal effects and sample selection bias , 2015 .

[54]  R. Pieters,et al.  The Structural Influence of Marketing Journals: A Citation Analysis of the Discipline and its Subareas over Time , 2003 .

[55]  Yu Xie,et al.  11. Identification and Estimation of Causal Effects with Time-Varying Treatments and Time-Varying Outcomes* , 2007 .

[56]  晋典 岡部,et al.  Budapest Open Access Initiativeの思想的背景とその受容 , 2011 .

[57]  Todd A. Gormley,et al.  Common Errors: How to (and Not to) Control for Unobserved Heterogeneity , 2013 .

[58]  Thomas Hess,et al.  Open access publishing in science , 2009, CACM.

[59]  Sofia Johan,et al.  The Problems with and Promise of Entrepreneurial Finance , 2017 .

[60]  J. Avery,et al.  The long tail. , 1995, Journal of the Tennessee Medical Association.

[61]  S. Harnad,et al.  Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals , 2004 .

[62]  Philip M. Davis,et al.  Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? , 2006, Scientometrics.