Who reads research articles? An altmetrics analysis of Mendeley user categories

Little detailed information is known about who reads research articles and the contexts in which research articles are read. Using data about people who register in Mendeley as readers of articles, this article explores different types of users of Clinical Medicine, Engineering and Technology, Social Science, Physics, and Chemistry articles inside and outside academia. The majority of readers for all disciplines were PhD students, postgraduates, and postdocs but other types of academics were also represented. In addition, many Clinical Medicine articles were read by medical professionals. The highest correlations between citations and Mendeley readership counts were found for types of users who often authored academic articles, except for associate professors in some sub‐disciplines. This suggests that Mendeley readership can reflect usage similar to traditional citation impact if the data are restricted to readers who are also authors without the delay of impact measured by citation counts. At the same time, Mendeley statistics can also reveal the hidden impact of some research articles, such as educational value for nonauthor users inside academia or the impact of research articles on practice for readers outside academia.

[1]  Stella Korobili,et al.  Factors that Influence Information-Seeking Behavior: The Case of Greek Graduate Students , 2011 .

[2]  Bradley M. Hemminger,et al.  Altmetrics in the wild: Using social media to explore scholarly impact , 2012, ArXiv.

[3]  Bradley M. Hemminger,et al.  A study of factors that affect the information-seeking behavior of academic scientists , 2012, J. Assoc. Inf. Sci. Technol..

[4]  M. HamidR.Jamali,et al.  Communication and information-seeking behavior of PhD students in physicists and astronomy , 2006, ASIST.

[5]  Rodrigo Costas,et al.  What is the impact of the publications read by the different Mendeley users? Could they help to identify alternative types of impact? PLoS ALM Workshop, San Francisco , 2013 .

[6]  D. Price,et al.  Studies in Scientometrics I Transience and Continuance in Scientific Authorship , 1975 .

[7]  N. Bennett,et al.  Physicians' Internet information‐seeking behaviors , 2004, The Journal of continuing education in the health professions.

[8]  C. Laymon A. study , 2018, Predication and Ontology.

[9]  Kristy Lundahl,et al.  Residents’ Patient-Specific Clinical Questions: Opportunities for Evidence-Based Learning , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Johan Bollen,et al.  A Principal Component Analysis of 39 Scientific Impact Measures , 2009, PloS one.

[11]  Ethelene Whitmire,et al.  Disciplinary differences and undergraduates' information-seeking behavior , 2002, J. Assoc. Inf. Sci. Technol..

[12]  M. Thelwall,et al.  F 1000 , Mendeley and Traditional Bibliometric Indicators , 2012 .

[13]  H. Eyre Introduction I , 2022 .

[14]  Y. Gingras,et al.  The Effects of Aging on Researchers' Publication and Citation Patterns , 2008, PloS one.

[15]  Mike Thelwall,et al.  Assessing non-standard article impact using F1000 labels , 2013, Scientometrics.

[16]  Helen de Castro Silva,et al.  Ciência da Informação , 2009 .

[17]  Paul Nicholls,et al.  Introduction to informetrics: Quantitative methods in library, documentation and information science , 1991 .

[18]  Lishi Kwasitsu,et al.  Information-seeking behavior of design, process, and manufacturing engineers , 2003 .

[19]  Mike Thelwall,et al.  Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows , 2014, J. Assoc. Inf. Sci. Technol..

[20]  Jean Tague-Sutcliffe,et al.  An Introduction to Informetrics , 1992, Inf. Process. Manag..

[21]  Gloria J. Leckie,et al.  Modeling the Information Seeking of Professionals: A General Model Derived from Research on Engineers, Health Care Professionals, and Lawyers , 1996, The Library Quarterly.

[22]  George A. Barnett,et al.  Impact of the internet and scholar age distribution on academic citation age , 2008, J. Assoc. Inf. Sci. Technol..

[23]  Ronald Rousseau,et al.  A Multi-metric Approach for Research Evaluations , 2022 .

[24]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[25]  Mike Thelwall,et al.  Academia.edu: Social network or Academic Network? , 2014, J. Assoc. Inf. Sci. Technol..

[26]  Ian Graham,et al.  Evidence-based medicine and the practicing clinician , 1999, Journal of General Internal Medicine.

[27]  Rodrigo Costas,et al.  How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications , 2014, Scientometrics.

[28]  Stefanie Haustein Journal evaluation and science 2. 0. Using social bookmarks to analyze reader perception , 2010 .

[29]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[30]  Mohd Rafiz Salji,et al.  Information Seeking Behavior , 2012 .

[31]  Lutz Bornmann,et al.  Measuring the societal impact of research , 2012, EMBO reports.

[32]  David Ellis,et al.  Modelling the information seeking patterns of engineers and research scientists in an industrial environment , 1997, J. Documentation.

[33]  Michael H. MacRoberts,et al.  Problems of citation analysis: A critical review , 1989, JASIS.

[34]  Cassidy R. Sugimoto,et al.  Do Altmetrics Work? Twitter and Ten Other Social Web Services , 2013, PloS one.

[35]  Blaise Cronin,et al.  Invoked on the Web , 1998, J. Am. Soc. Inf. Sci..

[36]  Judit Bar-Ilan JASIST 2001–2010 , 2012 .

[37]  Anton J. Nederhof,et al.  Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review , 2006, Scientometrics.

[38]  Ian Rowlands,et al.  The missing link: journal usage metrics , 2007, Aslib Proc..

[39]  Chris Armbruster Access, Usage and Citation Metrics: What Function for Digital Libraries and Repositories in Research Evaluation? , 2008 .

[40]  Kathy Fescemyer,et al.  Information-seeking behavior of undergraduate geography students , 2000 .

[41]  Mike Thelwall,et al.  Validating online reference managers for scholarly impact measurement , 2011, Scientometrics.

[42]  Carol Tenopir,et al.  Journal reading patterns and preferences of pediatricians. , 2007, Journal of the Medical Library Association : JMLA.

[43]  Lutz Bornmann,et al.  The wisdom of citing scientists , 2013, J. Assoc. Inf. Sci. Technol..

[44]  Tobias Siebenlist,et al.  Applying social bookmarking data to evaluate journal usage , 2011, J. Informetrics.

[45]  Blaise Cronin,et al.  Metrics à la mode , 2013, J. Assoc. Inf. Sci. Technol..

[46]  Vincent Larivière,et al.  In their own image? a comparison of doctoral students' and faculty members' referencing behavior , 2013, J. Assoc. Inf. Sci. Technol..

[47]  Mike Thelwall Journal impact evaluation: a webometric perspective , 2012, Scientometrics.

[48]  Blaise Cronin Editor-in-Chief,et al.  Metrics à la mode , 2013 .

[49]  Peter Ingwersen,et al.  Informetric analyses on the world wide web: methodological approaches to 'webometrics' , 1997, J. Documentation.

[50]  Steve Hanney,et al.  Tracing the wider impacts of biomedical research: a literature search to develop a novel citation categorisation technique , 2012, Scientometrics.

[51]  Lutz Bornmann,et al.  Is there currently a scientific revolution in Scientometrics? , 2013, J. Assoc. Inf. Sci. Technol..

[52]  Yelena Pancheshnikov,et al.  A Comparison of Literature Citations in Faculty Publications and Student Theses as Indicators of Collection Use and a Background for Collection Management at a University Library , 2007 .

[53]  Carol Tenopir,et al.  Variations in article seeking and reading patterns of academics: What makes a difference? , 2009 .

[54]  Amy Catalano,et al.  Patterns of graduate students' information seeking behavior: a meta-synthesis of the literature , 2013, J. Documentation.

[55]  Peter Ingwersen,et al.  Toward a basic framework for webometrics , 2004, J. Assoc. Inf. Sci. Technol..

[56]  Mike Thelwall,et al.  Assessing the impact of disciplinary research on teaching: An automatic analysis of online syllabuses , 2008, J. Assoc. Inf. Sci. Technol..

[57]  Ben R. Martin,et al.  The use of multiple indicators in the assessment of basic research , 1996, Scientometrics.

[58]  Gunther Eysenbach Correction: Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact , 2012, Journal of Medical Internet Research.

[59]  Gunther Eysenbach,et al.  Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact , 2011, Journal of medical Internet research.

[60]  Ludo Waltman,et al.  F1000 Recommendations as a Potential New Data Source for Research Evaluation: A Comparison With Citations , 2014, J. Assoc. Inf. Sci. Technol..

[61]  Ian Rowlands,et al.  Revisiting 'obsolescence' and journal article 'decay' through usage data: an analysis of digital journal use by year of publication , 2005, Inf. Process. Manag..

[62]  Blaise Cronin,et al.  The evolving indicator space (iSpace) , 2013, J. Assoc. Inf. Sci. Technol..

[63]  Judit Bar-Ilan,et al.  Coverage and adoption of altmetrics sources in the bibliometric community , 2014, Scientometrics.

[64]  Johan Bollen,et al.  Usage bibliometrics , 2011, Annu. Rev. Inf. Sci. Technol..

[65]  Johan Bollen,et al.  Usage Impact Factor: the effects of sample characteristics on usage-based impact metrics , 2006, J. Assoc. Inf. Sci. Technol..

[66]  Ronald N. Kostoff,et al.  The use and misuse of citation analysis in research evaluation , 1998, Scientometrics.

[67]  Vincent Larivière,et al.  Tweets vs. Mendeley readers: How do these two social media metrics differ? , 2014, it Inf. Technol..

[68]  Jason Priem Scholarship: Beyond the paper , 2013, Nature.

[69]  Vincent Larivière,et al.  Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature , 2013, J. Assoc. Inf. Sci. Technol..

[70]  A. Muraveva,et al.  A SYNTHESIS OF THE LITERATURE , 2012 .

[71]  Robert Boissoneau,et al.  Continuing education in the health professions , 1980 .

[72]  Rob H. Bracewell,et al.  Understanding how the information requests of aerospace engineering designers influence information-seeking behaviour , 2010 .

[73]  Xuemei Ge Information-Seeking Behavior in the Digital Age: A Multidisciplinary Study of Academic Researchers , 2010, Coll. Res. Libr..

[74]  A. Long,et al.  Comparison of bibliographic databases for information on the rehabilitation of people with severe mental illness. , 2001, Bulletin of the Medical Library Association.

[75]  Wolfgang G. Stock,et al.  Impact and relevance of LIS journals: A scientometric analysis of international and German-language LIS journals - Citation analysis versus reader survey , 2004, J. Assoc. Inf. Sci. Technol..

[76]  Carol Tenopir,et al.  Towards Electronic Journals: Realities for Scientists, Librarians, and Publishers,,,, , 2000 .

[77]  Morten Hertzum,et al.  The information-seeking practices of engineers: searching for documents as well as for people , 2000, Inf. Process. Manag..

[78]  Elaine Toms,et al.  Modeling the information behaviour of software engineers using a work - task framework , 2006, ASIST.

[79]  Bradley M. Hemminger,et al.  Information seeking behavior of academic scientists , 2007, J. Assoc. Inf. Sci. Technol..

[80]  Mike Thelwall,et al.  Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics , 2014, J. Assoc. Inf. Sci. Technol..

[81]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[82]  M. Hope Coffman Special Libraries Association , 1984 .

[83]  Rousseau Ronald,et al.  A multi-metric approach for research evaluation , 2013 .