Is the impact of journal impact factors decreasing?

Purpose – The purpose of this paper is to examine the effects of the use of the citation‐based journal impact factor for evaluative purposes upon the behaviour of authors and editors. It seeks to give a critical examination of a number of claims as regards the manipulability of this indicator on the basis of an empirical analysis of publication and referencing practices of authors and journal editorsDesign/methodology/approach – The paper describes mechanisms that may affect the numerical values of journal impact factors. It also analyses general, “macro” patterns in large samples of journals in order to obtain indications of the extent to which such mechanisms are actually applied on a large scale. Finally it presents case studies of particular science journals in order to illustrate what their effects may be in individual cases.Findings – The paper shows that the commonly used journal impact factor can to some extent be relatively easily manipulated. It discusses several types of strategic editorial beh...

[1]  Henk F. Moed,et al.  New developments in the use of citation analysis in research evaluation , 2009, Archivum Immunologiae et Therapiae Experimentalis.

[2]  Erjen van Nierop.  Why do statistics journals have low impact factors , 2009 .

[3]  Ben Wooliscroft,et al.  Measuring the impact of accounting journals using Google Scholar and the g-index , 2009 .

[4]  A. Agrawal,et al.  Corruption of journal Impact Factors. , 2005, Trends in ecology & evolution.

[5]  E. Garfield.  Fortnightly Review: How can impact factors be improved? , 1996 .

[6]  J. Morley,et al.  Highly Cited Papers in the Journals , 2003 .

[7]  Thed N. van Leeuwen,et al.  A critical analysis of the journal impact factors ofAngewandte Chemie and the journal of the American Chemical Society inaccuracies in published impact factors based on overall citations only , 1996, Scientometrics.

[8]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[9]  Maxwell L. King,et al.  Measuring research quality using the journal impact factor, citations and ‘Ranked Journals’: blunt instruments or inspired metrics? , 2009 .

[10]  J. Morley,et al.  Flying Through 5 Years , 2004 .

[11]  Melanie James,et al.  Comment: 2004's fastest organic and biomolecular chemistry! , 2004 .

[12]  P. Seglen,et al.  Citations and journal impact factors: questionable indicators of research quality , 1997, Allergy.

[13]  Henk F. Moed,et al.  Measuring contextual citation impact of scientific journals , 2009, J. Informetrics.

[14]  Melanie James,et al.  Comment: 2004's fastest organic and biomolecular chemistry! , 2004, Chemical communications.

[15]  Eugene Garfield,et al.  Citation indexing - its theory and application in science, technology, and humanities , 1979 .

[16]  T. V. Leeuwen,et al.  Impact factors can mislead , 1996, Nature.

[17]  Iain D. Craig.  Impact factor redux--new indicators, new challenges. , 2009, The journal of sexual medicine.

[18]  Wolfgang Glänzel,et al.  Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon , 2004, Scientometrics.

[19]  J. Morley,et al.  The top 10 hot topics in aging. , 2004, The journals of gerontology. Series A, Biological sciences and medical sciences.

[20]  Melanie James,et al.  Comment: 2004's fastest organic and biomolecular chemistry! , 2004, Organic & biomolecular chemistry.

[21]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[22]  Melanie James,et al.  Comment: 2004's fastest organic and biomolecular chemistry! , 2004, Chemical Society reviews.

[23]  Johan Bollen,et al.  Toward alternative metrics of journal impact: A comparison of download and citation data , 2005, Inf. Process. Manag..

[24]  J. Christopher Westland,et al.  Critical mass and willingness to pay for social networks , 2010, Electron. Commer. Res. Appl..

[25]  María Jesús Mancebón-Torrubia,et al.  The evaluation of scientific production: Towards a neutral impact factor , 2009, Scientometrics.

[26]  J. Reedijk.  Sense and nonsense of science citation analyses: comments on the monopoly position of ISI and citation inaccuracies. Risks of possible misuse and biased citation and impact data. , 1998 .

[27]  ANTHONY F. J. VAN RAAN,et al.  Sleeping Beauties in science , 2004, Scientometrics.

[28]  James Hartley,et al.  On the need to distinguish between author and journal self-citations , 2009, Scientometrics.

[29]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[30]  Thed N. van Leeuwen,et al.  A new classification system to describe the ageing of scientific journals and their impact factors , 1998, J. Documentation.

[31]  Melanie James,et al.  Comment: 2004's fastest organic and biomolecular chemistry! , 2004, Chemical communications.