Measuring research impact: bibliometrics, social media, altmetrics, and the BJGP.

Social media platforms such as blogs, Twitter, Facebook, and article reference managers such as Mendeley are now being used to communicate and discuss research. Alternative metrics (‘altmetrics’), first described by Priem and colleagues,1 is a term used to describe ‘web-based metrics for the impact of scholarly material with an emphasis on social media outlets as a source of data’.2 These article-level metrics are increasingly being used in conjunction with traditional bibliometric methods, such as the Impact Factor (IF), the immediacy index, and citation counts, to assess the impact of journals and journal articles and the outputs of individual researchers. A journal’s IF is calculated as the average number of times articles published in the past 2 years have been cited in the Journal Citation Reports (JCR).3 The IF is not article specific, does not show the immediacy of the citation count, and may not be an appropriate or accurate means of assessing the overall impact of research in an article. The h-index4 is another measure that is frequently used to define an individual researcher’s citation records. There is a growing consensus that the IF as a single measure of quality is outdated. The San Francisco Declaration on Research Assessment (DORA)5 recommends the need to eliminate the use of journal-based metrics. It suggests that publishers should offer a range of performance measures to assess and evaluate scholarly output. Altmetrics have the potential to add another dimension to this. Traditional bibliometric analysis and peer review have formed the standard methods to assess the ‘scientific status of disciplines, research institutes and scientists’,6 and it is well known that unless the ‘discipline’ or research is published in a journal with a high IF then it may be ‘lost’. Databases such as PubMed and Thomson Reuters Web of Science …

[1]  Debora Shaw,et al.  A new look at evidence of scholarly citation in citation indexes and from web sources , 2008, Scientometrics.

[2]  Lutz Bornmann,et al.  Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics , 2014, J. Informetrics.

[3]  Jean Liu,et al.  Five challenges in altmetrics: A toolmaker's perspective , 2013 .

[4]  Thomas V Perneger,et al.  Competing interests: None declared. Ethical approval: Ethics committee of Côte d’Ivoire’s Ministry of Public Health and the Institutional Review Board of the US Centers for Disease Control and Prevention , 2004 .

[5]  Mike Thelwall,et al.  A combined bibliometric indicator to predict article impact , 2011, Inf. Process. Manag..

[6]  Gunther Eysenbach,et al.  Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact , 2011, Journal of medical Internet research.

[7]  Jean Liu Data Curator Five challenges in altmetrics: A toolmaker's perspective , 2013 .

[8]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[9]  P. Schofield,et al.  Making an impact: research, publications, and bibliometrics in the BJGP. , 2012, The British journal of general practice : the journal of the Royal College of General Practitioners.

[10]  C. van Weel,et al.  Biomedical science matters for people--so its impact should be better assessed. , 2002, Lancet.

[11]  Biomedical science matters for people—so its impact should be better assessed , 2002, The Lancet.

[12]  Mike Thelwall,et al.  Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics , 2014, J. Assoc. Inf. Sci. Technol..

[13]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[14]  Mike Thelwall,et al.  Google book search: Citation analysis for social science and the humanities , 2009, J. Assoc. Inf. Sci. Technol..

[15]  Marie E. McVeigh,et al.  The journal impact factor denominator: defining citable (counted) items. , 2009, JAMA.

[16]  Richard Furuta,et al.  Do altmetrics follow the crowd or does the crowd follow altmetrics? , 2014, IEEE/ACM Joint Conference on Digital Libraries.

[17]  Anne Osterrieder,et al.  The value and use of social media as communication tool in the plant sciences , 2013, Plant Methods.