Awareness and usage of altmetrics: A user survey

As the way of evaluating research outputs has gradually changed, and the dissemination of scholarly materials online has gotten easier, research studies investigating the awareness and usage of social media in academia have also been on the rise. The number of user surveys on the awareness and usage of altmetrics (emerging alternative metrics based on social media) has, however, remained low. This paper presents the findings of an online survey, which are the results of the first phase data collection of a user survey on the awareness and usage of altmetrics in academia. Our findings show that article views and downloads from online digital libraries or repositories are very well‐known. The most used altmetrics are mentions and shares on social networks. Mentions in blog posts and topics in a forum are also popular altmetrics. Interestingly, this study reveals a tendency for non‐faculty staff to be more aware of altmetrics. Furthermore, we also investigate how the usage of social media correlates with the usage of altmetrics. The findings show medium to large correlations between the usage of social media and the usage of altmetrics, which means academics who use social media often, also tend to use altmetrics often.

[1]  Mike Thelwall,et al.  Evaluating altmetrics , 2013, Scientometrics.

[2]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[3]  Finn Årup Nielsen,et al.  Scientific citations in Wikipedia , 2007, First Monday.

[4]  Wolfgang Glänzel,et al.  Usage metrics versus altmetrics: confusing terminology? , 2015, Scientometrics.

[5]  Stevan Harnad,et al.  Earlier Web Usage Statistics as Predictors of Later Citation Impact , 2005, J. Assoc. Inf. Sci. Technol..

[6]  Mark Kats,et al.  Tweeting the Meeting: An In-Depth Analysis of Twitter Activity at Kidney Week 2011 , 2012, PloS one.

[7]  Yin Leng Theng,et al.  Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media , 2016, Scientometrics.

[8]  Ian Rowlands,et al.  Social media use in the research workflow , 2011, Inf. Serv. Use.

[9]  Mike Thelwall,et al.  Validating online reference managers for scholarly impact measurement , 2011, Scientometrics.

[10]  Juan Gorraiz,et al.  Global usage versus global citation metrics: The case of pharmacology journals , 2011, J. Assoc. Inf. Sci. Technol..

[11]  M. Thelwall,et al.  F 1000 , Mendeley and Traditional Bibliometric Indicators , 2012 .

[12]  Johan Bollen,et al.  How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations , 2012, PloS one.

[13]  Bradley M. Hemminger,et al.  Scientometrics 2.0: New metrics of scholarly impact on the social Web , 2010, First Monday.

[14]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[15]  Stefanie Haustein,et al.  Grand challenges in altmetrics: heterogeneity, data quality and dependencies , 2016, Scientometrics.

[16]  Vincent Larivière,et al.  Scholarly use of social media and altmetrics: A review of the literature , 2016, J. Assoc. Inf. Sci. Technol..

[17]  Tobias Siebenlist,et al.  Applying social bookmarking data to evaluate journal usage , 2011, J. Informetrics.

[18]  Johan Bollen,et al.  Toward alternative metrics of journal impact: A comparison of download and citation data , 2005, Inf. Process. Manag..

[19]  Gunilla Widén,et al.  Scholarly communication and possible changes in the context of social media: A Finnish case study , 2011, Electron. Libr..

[20]  A. Watson.  Comparing citations and downloads for individual articles at the Journal of Vision , 2009 .

[21]  Rodrigo Costas,et al.  Users, narcissism and control – tracking the impact of scholarly publications in the 21st century , 2012 .

[22]  Wolfgang G. Stock,et al.  Impact and relevance of LIS journals: A scientometric analysis of international and German-language LIS journals - Citation analysis versus reader survey , 2004, J. Assoc. Inf. Sci. Technol..

[23]  Jason Priem,et al.  How and why scholars cite on Twitter , 2010, ASIST.

[24]  Stefanie Haustein,et al.  Multidimensional journal evaluation , 2010 .

[25]  Mike Thelwall,et al.  Can Mendeley bookmarks reflect readership? A survey of user motivations , 2016, J. Assoc. Inf. Sci. Technol..

[26]  Cassidy R. Sugimoto,et al.  Do Altmetrics Work? Twitter and Ten Other Social Web Services , 2013, PloS one.

[27]  Stefanie Haustein,et al.  Multidimensional Journal Evaluation - Analyzing Scientific Periodicals beyond the Impact Factor , 2012 .

[28]  Louise Hall,et al.  Peer review in a changing world: An international study measuring the attitudes of researchers , 2013, J. Assoc. Inf. Sci. Technol..

[29]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[30]  GorraizJuan,et al.  Usage metrics versus altmetrics , 2015 .

[31]  Judit Bar-Ilan,et al.  Coverage and adoption of altmetrics sources in the bibliometric community , 2014, Scientometrics.

[32]  Anatoliy A. Gruzd,et al.  Tenure and promotion in the age of online social media , 2011, ASIST.

[33]  Richard Van Noorden.  Online collaboration: Scientists and the social network , 2014, Nature.

[34]  C. Strasser,et al.  Researcher Perspectives on Publication and Peer Review of Data , 2014, PloS one.

[35]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[36]  Judit Bar-Ilan,et al.  Beyond citations: Scholars' visibility on the social Web , 2012, ArXiv.

[37]  Carol Tenopir,et al.  Social media and scholarly reading , 2013, Online Inf. Rev..