Citation metrics for appraising scientists: misuse, gaming and proper use

Citation and other metrics are widely misused, but when properly used, they can be valuable. Science itself thrives on quantitative measurement. Quantitative indicators aim to provide objective data instead of biased beliefs. Here, we focus on citation metrics in appraising scientists1 for hiring, promotion, tenure, funding, selection for some award, recognition or bonus, or other reasons. Many tricks exist to game citation metrics (Box); however, proper use of metrics may overcome these deficiencies. Generic challenges that we describe here may partly apply also to larger, more composite entities such as the appraisal of journals, institutions or large research portfolios, for example, at a national level.

[1]  D. Rennie,et al.  When authorship fails. A proposal to make contributors accountable. , 1997, JAMA.

[2]  Kevin W Boyack,et al.  Multiple Citation Indicators and Their Composite across Scientific Disciplines , 2016, PLoS biology.

[3]  J. Simone Understanding academic medical centers: Simone's Maxims. , 1999, Clinical cancer research : an official journal of the American Association for Cancer Research.

[4]  Carolin Haeussler,et al.  Authorship and contribution disclosures , 2017, Science Advances.

[5]  Richard Van Noorden,et al.  Hundreds of extreme self-citing scientists revealed in new database , 2019, Nature.

[6]  Kevin W Boyack,et al.  A standardized citation metrics author database annotated for scientific field , 2019, PLoS biology.

[7]  S. Rijcke,et al.  Bibliometrics: The Leiden Manifesto for research metrics , 2015, Nature.

[8]  John P. A. Ioannidis,et al.  Thousands of scientists publish a paper every five days , 2018, Nature.

[9]  D. Rennie,et al.  Prevalence of honorary and ghost authorship in Cochrane reviews. , 2002, JAMA.

[10]  David Stuart,et al.  Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact , 2015, Online information review (Print).

[11]  B. Thombs,et al.  A user’s guide to inflated and manipulated impact factors , 2019, European journal of clinical investigation.

[12]  Jeffrey Beall,et al.  Predatory publishers are corrupting open access , 2012, Nature.

[13]  Mario Biagioli,et al.  Watch out for cheats in citation game , 2016, Nature.

[14]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.