Worshiping False Idols: The Impact Factor Dilemma

It always begins innocently enough! In the middle of the 19th century, mining and earthmoving were increasingly important enterprises of the industrial revolution. To remove rock and to open mine shafts, an explosive was needed, but nitroglycerine was too unstable for practical use. The Swedish scientist/inventor Alfred Nobel discovered that mixing nitroglycerine with the diatomaceous earth kieselguhr produced a stable explosive product he patented as dynamite, which was quickly adopted by the mining and construction industries. In the early 20th century, the Italian physicist Enrico Fermi, while attempting to understand the structure of atomic nuclei, discovered that nuclei bombarded by neutrons would split and release large amounts of energy. As others have employed these discoveries, both dynamite and nuclear fission have had destructive effects on society that were initially unimaginable by their discoverers. It was only a quarter century after the first nuclear fission bombs that Eugene Garfield, a library scientist and structural linguist from the University of Pennsylvania, discovered a metric that could be used to select journals for inclusion in his new publication Genetics Citation Index (the forerunner of Science Citation Index, which was subsequently commercialized by Garfield’s company Institute for Scientific Information). This metric for journals was named “impact factor” and was to be calculated “based on 2 elements: the numerator, which is the number of citations in the current year to any items published in a journal in the previous 2 years, and the denominator, which is the number of substantive articles (source items) published in the same 2 years.” 1,2 Thus, although the journal impact factor was born innocently enough, just like the examples involving Nobel and Fermi, Garfield’s impact factor is now being used by others in ways that threaten to destroy scientific inquiry as we know it. 3,4 For much of human history (about 200,000 generations), scientists were few in number, often worked in relative isolation, and only communicated findings to close

[1]  Richard Smith,et al.  Journal accused of manipulating impact factor , 1997 .

[2]  Klaus Kuhn,et al.  [The journal impact factor as a parameter for the evaluation of researchers and research]. , 2004, Medizinische Klinik.

[3]  Vladimir Hachinski The Impact of Impact Factors , 2001 .

[4]  Peng Dong,et al.  The "impact factor" revisited , 2005, Biomedical digital libraries.

[5]  P. V. van Diest,et al.  Impactitis: new cures for an old disease. , 2001, Journal of clinical pathology.

[6]  R. Hobbs,et al.  Should we ditch impact factors? , 2007, BMJ : British Medical Journal.

[7]  Leo Egghe,et al.  Little science, big science... and beyond , 1994, Scientometrics.

[8]  Mabel Chew,et al.  Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994-2005) and their Editors' views. , 2007, Journal of the Royal Society of Medicine.

[9]  S. Shapin A Social History of Truth: Civility and Science in Seventeenth-Century England , 1994 .

[10]  D. Christakis,et al.  Impact factor: a valid measure of journal quality? , 2003, Journal of the Medical Library Association : JMLA.

[11]  S. Jawaid,et al.  HOW RELEVANT ARE IMPACT FACTOR AND INDEXATION IN MEDLINE , 2007 .

[12]  D. Price,et al.  Little Science, Big Science and Beyond , 1986 .

[13]  E. Garfield Journal impact factor: a brief review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[14]  E. Garfield The history and meaning of the journal impact factor. , 2006, JAMA.

[15]  M. Frank Impact factors: arbiter of excellence? , 2002, The Physiologist.

[16]  M. Van der Weyden,et al.  Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994-2005) and their Editors’ views , 2007, Journal of the Royal Society of Medicine.

[17]  Richard M. Smith,et al.  Commentary: the power of the unrelenting impact factor--is it a force for good or harm? , 2006, International journal of epidemiology.

[18]  Gareth Williams,et al.  Should we ditch impact factors? , 2007, BMJ : British Medical Journal.

[19]  Christopher Martyn Advice to a new editor , 2007, BMJ : British Medical Journal.

[20]  Steven Shapin,et al.  A Social History of Truth: Civility and Science in Seventeenth-Century England. , 1995 .

[21]  Michael Mabe,et al.  Growth dynamics of scholarly and scientific journals , 2001, Scientometrics.

[22]  N. Mohaghegh,et al.  WHY THE IMPACT FACTOR OF JOURNALS SHOULD NOT BE USED FOR EVALUATING RESEARCH , 2005 .

[23]  D. Cohen Chronicle of Higher Education , 1998 .

[24]  Johan Bollen,et al.  Journal status , 2006, Scientometrics.

[25]  Hannah Brown,et al.  How impact factors changed medical publishing—and science , 2007, BMJ : British Medical Journal.

[26]  Anne-Wil Harzing,et al.  Google Scholar: the democratization of citation analysis , 2007 .

[27]  A. Sevinç,et al.  Manipulating impact factor: an unethical issue or an Editor's choice? , 2004, Swiss medical weekly.

[28]  Emma Hill,et al.  Show me the data. , 1998 .

[29]  R. Monastersky The number that's devouring science , 2005 .

[30]  Miquel Porta,et al.  Quality of impact factors of general medical journals , 2003, BMJ : British Medical Journal.

[31]  Michael Mabe,et al.  The growth and number of journals , 2003 .

[32]  Impact of the Journal of Child Neurology: 2002 Data , 2003, Journal of child neurology.

[33]  Charles Jennings,et al.  Citation Data: The Wrong Impact? * * Reprinted with permission from Nature Neuroscience, 1, December, 1998, 641-643. , 2001, Cortex.