A framework for systematic analysis of open access journals and its application in software engineering and information systems

This article is a contribution towards an understanding of open access (OA) publishing. It proposes an analysis framework of 18 core attributes, divided into the areas of bibliographic information, activity metrics, economics, accessibility, and predatory issues. The framework has been employed in a systematic analysis of 30 OA journals in software engineering (SE) and information systems (IS), which were selected from among 386 OA journals in Computer Science from the Directory of OA Journals. An analysis was performed on the sample of the journals, to provide an overview of the current situation of OA journals in the fields of SE and IS. The journals were then compared between-group, according to the presence of article processing charges. A within-group analysis was performed on the journals requesting article processing charges from authors, in order to understand what is the value added according to different price ranges. This article offers several contributions. It presents an overview of OA definitions and models. It provides an analysis framework born from the observation of data and the existing literature. It raises the need to study OA in the fields of SE and IS while offering a first analysis. Finally, it provides recommendations to readers of OA journals. This paper highlights several concerns still threatening the adoption of OA publishing in the fields of SE and IS. Among them, it is shown that high article processing charges are not sufficiently justified by the publishers, which often lack transparency and may prevent authors from adopting OA.

[1]  Bo-Christer Björk Open access to scientific publications - an analysis of the barriers to change , 2003, Inf. Res..

[2]  Branka Maravić,et al.  DOAJ - Directory of Open Access Journals , 2005 .

[3]  Richard Van Noorden Open access: The true cost of science publishing , 2013, Nature.

[4]  Susan Crawford,et al.  Peer review and the changing research record , 1990, J. Am. Soc. Inf. Sci..

[5]  Charles Oppenheim,et al.  The economic implications of alternative publishing models , 2010 .

[6]  Abbas Horri,et al.  Tracking open access journals evolution: Some considerations in open access data collection validation , 2007 .

[7]  John J. Regazzi The Shifting Sands of Open Access Publishing, a Publisher's View , 2004 .

[8]  Mary Baker,et al.  The LOCKSS peer-to-peer digital preservation system , 2005, TOCS.

[9]  Robert P. Parks,et al.  The Faustian grip of academic publishing , 2002 .

[10]  H. Momen,et al.  The access principle , 2007 .

[11]  Michelle Grace,et al.  Directory of Open Access Journals , 2013 .

[12]  Abbas Horri,et al.  Tracking open access journals evolution: Some considerations in open access data collection validation , 2007, J. Assoc. Inf. Sci. Technol..

[13]  Wallace Koehler,et al.  Web page change and persistence - A four-year longitudinal study , 2002, J. Assoc. Inf. Sci. Technol..

[14]  Ronald F. Boisvert,et al.  Positioning ACM for an open access future , 2013, CACM.

[15]  Ralf Schimmer,et al.  Open Access at the Max Planck Society , 2008 .

[16]  Victoria Reich,et al.  Preserving today's scientific record for tomorrow , 2004, BMJ : British Medical Journal.

[17]  魏屹东,et al.  Scientometrics , 2018, Encyclopedia of Big Data.

[18]  Christian Gumpenberger,et al.  On the impact of Gold Open Access journals , 2013, Scientometrics.

[19]  Henk G. Sol,et al.  A Feature Analysis of Information Systems Design Methodologies: Methodological Considerations , 1983, International Conference on Current Research Information Systems.

[20]  John Willinsky,et al.  Open Journal Systems: An example of open source software for journal management and publishing , 2005, Libr. Hi Tech.

[21]  Moshe Y. Vardi Predatory scholarly publishing , 2012, Commun. ACM.

[22]  Leon J. Osterweil,et al.  Toward objective, systematic design-method comparisons , 1992, IEEE Software.

[23]  Jacqueline Christodoulou,et al.  Code of conduct , 2016 .

[24]  Jennifer C Molloy,et al.  The Open Knowledge Foundation: Open Data Means Better Science , 2011, PLoS biology.

[25]  William Cyrus Navidi,et al.  Statistics for Engineers and Scientists , 2004 .

[26]  B. Björk,et al.  The Development of Open Access Journal Publishing from 1993 to 2009 , 2011, PloS one.

[27]  K. Antelman Do Open-Access Articles Have a Greater Research Impact? , 2004 .

[28]  Brenda Young International Standard Serial Numbers , 1988 .

[29]  Graziotin Daniel Comparison of Open Access Software Engineering and Information Systems Journals , 2014 .

[30]  Michael Ley,et al.  The DBLP Computer Science Bibliography: Evolution, Research Issues, Perspectives , 2002, SPIRE.

[31]  Marc Langston,et al.  Linking to journal articles in an online teaching environment: The persistent link, DOI, and OpenURL , 2004 .

[32]  Richard Van Noorden Journal offers flat fee for ‘all you can publish’ , 2012, Nature.

[33]  Peter Suber,et al.  Gratis and libre open access , 2008 .

[34]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[35]  Friedemann Mattern Bibliometric Evaluation of Computer Science - Problems and Pitfalls , 2008 .

[36]  S. Schroter,et al.  Perceptions of open access publishing: interviews with journal authors , 2005, BMJ : British Medical Journal.

[37]  Jacques Wainer,et al.  Invisible work in standard bibliometric evaluation of computer science , 2011, Commun. ACM.

[38]  Ziming Liu,et al.  Print vs. electronic resources: A study of user perceptions, preferences, and use , 2006, Inf. Process. Manag..

[39]  R Smith,et al.  Opening up BMJ peer review , 1999, BMJ.

[40]  Charles W. Bailey Open Access and Libraries , 2007 .

[41]  T. Vision Open Data and the Social Contract of Scientific Publishing , 2010 .

[42]  Hans Olsson,et al.  ["Predatory publishers"]. , 2012, Lakartidningen.

[43]  Ingegerd Rabow DOAJ announces new selection criteria , 2013 .

[44]  Rohollah Mosallahnezhad,et al.  REMOVED: Cooperative, compact algorithms for randomized algorithms , 2007 .

[45]  Martin Vingron,et al.  A genome-wide transcriptional fingerprint of normal and malformed human hearts , 2003 .

[46]  Jeffrey Beall,et al.  The Open-Access Movement is Not Really about Open Access , 2013 .

[47]  Jeffrey Beall,et al.  Predatory publishers are corrupting open access , 2012, Nature.

[48]  Declan Butler,et al.  Investigating journals: The dark side of publishing , 2013, Nature.

[49]  晋典 岡部,et al.  Budapest Open Access Initiativeの思想的背景とその受容 , 2011 .

[50]  Veronica F. Hinman Pros and Cons of Open Access , 2013 .

[51]  Paul Weaving,et al.  The Berlin Declaration , 2009 .

[52]  S. Harnad,et al.  Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals , 2004 .

[53]  C. Oppenheim,et al.  The Access/Impact Problem and the Green and Gold Roads to Open Access: An Update , 2008 .

[54]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[55]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[56]  G. Franck Open access , 2012, Cell cycle.

[57]  Peter Suber Timeline of the open access movement , 2009 .

[58]  Richard J. Roberts,et al.  Bethesda Statement on Open Access Publishing , 2003 .

[59]  Philip M. Davis,et al.  "Open Access Publisher Accepts Nonsense Manuscript for Dollars". the scholarly kitchen , 2009 .

[60]  J. Bohannon Who's afraid of peer review? , 2013, Science.

[61]  Sara Schroter,et al.  Open access publishing and author-pays business models: a survey of authors' knowledge and perceptions. , 2006, Journal of the Royal Society of Medicine.

[62]  Matthew E Falagas,et al.  Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses , 2007, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[63]  Jeffrey Beall,et al.  Predatory Publishers and Opportunities for Scholarly Societies , 2012 .

[64]  Carl Leubsdorf Annotum: launching a peer‐reviewed journal online for free , 2012, Learn. Publ..

[65]  Sharon A. Gutman,et al.  Copyright in the Age of Digital Scholarship , 2011 .

[66]  Massimo Franceschet,et al.  The role of conference publications in CS , 2010, Commun. ACM.

[67]  Timothy S. Deliyannides Scholarly Communication and Publishing Lunch and Learn Talk #5: OASPA (Open Access Scholarly Publishers Association) and the ULS , 2013 .

[68]  B. Björk,et al.  Open access versus subscription journals: a comparison of scientific impact , 2012, BMC Medicine.

[69]  Stephen B. Vardeman,et al.  Probability and Statistics for Engineers and Scientists.@@@Probability and Statistics for Engineers. , 1986 .

[70]  Subbiah Arunachalam Open Access to Scientific Knowledge , 2008 .