Metrics for openness

The characterization of scholarly communication is dominated by citation‐based measures. In this paper we propose several metrics to describe different facets of open access and open research. We discuss measures to represent the public availability of articles along with their archival location, licenses, access costs, and supporting information. Calculations illustrating these new metrics are presented using the authors’ publications. We argue that explicit measurement of openness is necessary for a holistic description of research outputs.

[1]  Melissa Terras,et al.  The impact of social media on the dissemination of research: results of an experiment , 2012 .

[2]  StarSusan Leigh,et al.  Layers of Silence, Arenas of Voice , 1999 .

[3]  Charles Lyons,et al.  An Overview of Open Access in the Fields of Business and Management , 2011 .

[4]  C. Tenopir,et al.  Data Sharing by Scientists: Practices and Perceptions , 2011, PloS one.

[5]  Rob Johnson,et al.  Counting the costs of open access - 2013/14 Dataset (Anonymised) , 2014 .

[6]  Martin Paul Eve,et al.  Open access infrastructure: where we are and where we need to go , 2014 .

[7]  Jonathan D Wren,et al.  Open access and openly accessible: a study of scientific publications shared via the internet , 2005, BMJ : British Medical Journal.

[8]  Lisa A. Ennis.  The access principle: The case for open access to research and scholarship , 2007, J. Assoc. Inf. Sci. Technol..

[9]  Oliver Pesch,et al.  ONIX-PL License Encoding Project , 2013 .

[10]  Florence Debarre,et al.  The Availability of Research Data Declines Rapidly with Article Age , 2013, Current Biology.

[11]  LetaJacqueline,et al.  A new indicator for international visibility , 2011 .

[12]  Les Carr,et al.  20 – The Open Research Web , 2006 .

[13]  Jane Hunter,et al.  Scientific Publication Packages - A Selective Approach to the Communication and Archival of Scientific Output , 2008, Int. J. Digit. Curation.

[14]  E. Garfield.  The history and meaning of the journal impact factor. , 2006, JAMA.

[15]  Anthony F. J. van Raan,et al.  Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods , 2005, Scientometrics.

[16]  Charles Oppenheim,et al.  RoMEO Studies 8: self-archiving: The logic behind the colour-coding used in the Copyright Knowledge Bank , 2007, Program.

[17]  Han Woo Park,et al.  Exploring the web visibility of world-class universities , 2011, Scientometrics.

[18]  R. Peng.  Reproducible Research in Computational Science , 2011, Science.

[19]  Ellen Finnie Duranceau,et al.  The Accessibility Quotient: A New Measure of Open Access , 2012 .

[20]  David M. Nichols,et al.  Metadatapedia: a proposal for aggregating metadata on data archiving , 2012, iConference '12.

[21]  J. Willinsky.  The access principle: The case for open access to research , 2005 .

[22]  J. Ioannidis,et al.  Unavailability of online supplementary scientific information from articles published in major journals , 2005, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[23]  Joachim Schöpfel,et al.  Degrees of Openness: Access Restrictions in Institutional Repositories , 2014, D Lib Mag..

[24]  Kalpana Shankar,et al.  Data sharing in the sciences , 2011, Annu. Rev. Inf. Sci. Technol..

[25]  Clifford Lynch.  19 – Open computation: beyond human reader-centric views of scholarly literatures , 2006 .

[26]  Carole A. Goble,et al.  Why Linked Data is Not Enough for Scientists , 2010, 2010 IEEE Sixth International Conference on e-Science.

[27]  Victoria Stodden,et al.  Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research , 2014 .

[28]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[29]  Bob Pymm,et al.  Open Access: Key Strategic, Technical and Economic Aspects , 2007 .

[30]  B. Björk,et al.  The Development of Open Access Journal Publishing from 1993 to 2009 , 2011, PloS one.

[31]  Shinji Mine,et al.  Status of open access in the biomedical field in 2005. , 2009, Journal of the Medical Library Association : JMLA.

[32]  J. Wicherts,et al.  Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results , 2011, PloS one.

[33]  Cassidy R. Sugimoto,et al.  Biobibliometric profiling: An examination of multifaceted approaches to scholarship , 2012, J. Assoc. Inf. Sci. Technol..

[34]  Stevan Harnad,et al.  Open Access to Research: Changing Researcher Behavior Through University and Funder Mandates , 2011 .

[35]  Timo Liimatainen,et al.  The current state of Open Access to research articles from the University of Helsinki , 2010 .

[36]  Paul T. Groth,et al.  Ten Simple Rules for the Care and Feeding of Scientific Data , 2014, PLoS Comput. Biol..

[37]  D. Borsboom,et al.  The poor availability of psychological research data for reanalysis. , 2006, The American psychologist.

[38]  D. Covey.  Self-Archiving Journal Articles: A Case Study of Faculty Practice and Missed Opportunity. , 2009 .

[39]  Sam Yeaman,et al.  Mandated data archiving greatly improves access to research data , 2013, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[40]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[41]  Francesca Dominici,et al.  Estimating the acute health effects of coarse particulate matter accounting for exposure measurement error. , 2011, Biostatistics.

[42]  Benedikt Fecher,et al.  What Drives Academic Data Sharing? , 2014, PloS one.

[43]  Susan Leigh Star,et al.  Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work , 1999, Computer Supported Cooperative Work (CSCW).

[44]  B. Björk,et al.  Open Access to the Scientific Journal Literature: Situation 2009 , 2010, PloS one.

[45]  Charles Oppenheim,et al.  The citation advantage of open-access articles , 2008, J. Assoc. Inf. Sci. Technol..

[46]  Eric G. Campbell,et al.  Codifying Collegiality: Recent Developments in Data Sharing Policy in the Life Sciences , 2014, PloS one.

[47]  Jacques Wainer,et al.  Invisible work in standard bibliometric evaluation of computer science , 2011, Commun. ACM.

[48]  David M. Shotton,et al.  The Five Stars of Online Journal Articles - a Framework for Article Evaluation , 2012, D Lib Mag..

[49]  H. Federrath,et al.  Design issues , 2008 .

[50]  Bo-Christer Björk,et al.  Anatomy of green open access , 2014, J. Assoc. Inf. Sci. Technol..

[51]  Holly Mercer,et al.  Almost Halfway There: An Analysis of the Open Access Behaviors of Academic Librarians , 2011, Coll. Res. Libr..

[52]  Adam Finch,et al.  Can we do better than existing author citation metrics? , 2010, BioEssays : news and reviews in molecular, cellular and developmental biology.

[53]  Anita Coleman,et al.  Self-archiving and the Copyright Transfer Agreements of ISI-ranked library and information science journals , 2007, J. Assoc. Inf. Sci. Technol..

[54]  Fytton Rowland,et al.  The citation advantage of open-access articles , 2008 .

[55]  Jason,et al.  What level of Open Access scholar are you , 2014 .

[56]  Bradley M. Hemminger,et al.  Scientometrics 2.0: New metrics of scholarly impact on the social Web , 2010, First Monday.

[57]  R. McAfee,et al.  Evaluating big deal journal bundles , 2014, Proceedings of the National Academy of Sciences.

[58]  Christine L. Borgman,et al.  The conundrum of sharing research data , 2012, J. Assoc. Inf. Sci. Technol..

[59]  Darrel C. Ince,et al.  The case for open computer programs , 2012, Nature.

[60]  Jingfeng Xia,et al.  A "librarian-LIS faculty" divide in open access practice , 2011, J. Documentation.

[61]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[62]  C. Borgman,et al.  If We Share Data, Will Anyone Use Them? Data Sharing and Reuse in the Long Tail of Science and Technology , 2013, PloS one.

[63]  Anton J. Nederhof,et al.  Policy impact of bibliometric rankings of research performance of departments and individuals in economics , 2008, Scientometrics.

[64]  Alesia Zuccala.  Th e layperson and Open Access. , 2009 .

[65]  Kristin Antelman,et al.  Self‐archiving practice and the influence of publisher policies in the social sciences , 2006, Learn. Publ..

[66]  J. Lane.  Let's make science metrics more scientific , 2010, Nature.

[67]  W. Greene,et al.  The role of data/code archives in the future of economic research , 2008 .

[68]  Boleslaw K. Szymanski,et al.  An Internet measure of the value of citations , 2012, Inf. Sci..

[69]  J. Ioannidis,et al.  Public Availability of Published Research Data in High-Impact Journals , 2011, PloS one.

[70]  Debora Shaw,et al.  Publication and citation patterns among LIS faculty : Profiling a typical professor , 2008 .

[71]  Lauren Bradley,et al.  The New Information Poor: How Limited Access to Digital Scholarly Resources Impacts Higher Education , 2011 .

[72]  Turid Hedlund.  Open Access availability of articles by Nordic authors , 2010 .

[73]  N. Adler,et al.  When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings , 2009 .

[74]  Victoria Stodden,et al.  Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research , 2014 .

[75]  Annie M. Hughes.  Publication Behaviors of the Signers of the Public Library of Science(PLoS) "Open Letter to Scientific Publishers , 2008 .

[76]  Michael F. Gorman,et al.  Evaluating Operations Management-Related Journals via the Author Affiliation Index , 2005, Manuf. Serv. Oper. Manag..

[77]  彰 根本,et al.  Encyclopedia of Library and Information Sciences. 4th ed. , 2018 .

[78]  Fabio Gasparetti,et al.  Personalized Search on the World Wide Web , 2007, The Adaptive Web.

[79]  Jennifer M. Urban,et al.  Shining Light into Black Boxes , 2012, Science.

[80]  Doug Way.  The Open Access Availability of Library and Information Science Literature , 2010, Coll. Res. Libr..

[81]  Scott E. Delman.  ACM offers a new approach to self-archiving , 2011, CACM.

[82]  Michael B. Twidale,et al.  Towards a Data Literate Citizenry , 2013 .

[83]  Roger D Peng,et al.  Reproducible research and Biostatistics. , 2009, Biostatistics.

[84]  Shinji Mine,et al.  Enhancing open access in the biomedical field , 2010, ASIST.

[85]  Alesia Zuccalá,et al.  The lay person and Open Access , 2009, Annu. Rev. Inf. Sci. Technol..

[86]  J. Ruscio,et al.  Measuring Scholarly Impact Using Modern Citation-Based Indices , 2012 .

[87]  Johan Bollen,et al.  Usage bibliometrics , 2011, Annu. Rev. Inf. Sci. Technol..

[88]  José Luis Ortega,et al.  Indicators for a webometric ranking of open access repositories , 2010, Scientometrics.

[89]  Michael W. Carroll.  Why Full Open Access Matters , 2011, PLoS biology.

[90]  Rogério Mugnaini,et al.  A new indicator for international visibility: exploring Brazilian scientific community , 2011, Scientometrics.

[91]  David M. Shotton.  The Five Stars of Online Journal Articles – an article evaluation framework , 2011 .

[92]  Pandelis Perakakis,et al.  Measuring internationality: Reflections and perspectives on academic journals , 2006, Scientometrics.