Journal impact factor: a bumpy ride in an open space

The journal impact factor (IF) is the leading method of scholarly assessment in today’s research world. An important question is whether or not this is still a constructive method. For a specific journal, the IF is the number of citations for publications over the previous 2 years divided by the number of total citable publications in these years (the citation window). Although this simplicity works to an advantage of this method, complications arise when answers to questions such as ‘What is included in the citation window’ or ‘What makes a good journal impact factor’ contain ambiguity. In this review, we discuss whether or not the IF should still be considered the gold standard of scholarly assessment in view of the many recent changes and the emergence of new publication models. We will outline its advantages and disadvantages. The advantages of the IF include promoting the author meanwhile giving the readers a visualization of the magnitude of review. On the other hand, its disadvantages include reflecting the journal’s quality more than the author’s work, the fact that it cannot be compared across different research disciplines, and the struggles it faces in the world of open access. Recently, alternatives to the IF have been emerging, such as the SCImago Journal & Country Rank, the Source Normalized Impact per Paper and the Eigenfactor Score, among others. However, all alternatives proposed thus far are associated with their own limitations as well. In conclusion, although IF contains its cons, until there are better proposed alternative methods, IF remains one of the most effective methods for assessing scholarly activity.

[1]  L. Bornmann,et al.  A New Family of Cumulative Indexes for Measuring Scientific Performance , 2012, PloS one.

[2]  Ramin Sadeghi,et al.  Comparison Between Impact Factor, Eigenfactor Metrics, and SCimago Journal Rank Indicator of Pediatric Neurology Journals , 2014, Acta informatica medica : AIM : journal of the Society for Medical Informatics of Bosnia & Herzegovina : casopis Drustva za medicinsku informatiku BiH.

[3]  J. Neuberger,et al.  Impact factors: uses and abuses , 2002, European journal of gastroenterology & hepatology.

[4]  The Impact Factor Game , 2006, PLoS medicine.

[5]  Gianluca Setti,et al.  Bibliometric Indicators: Why Do We Need More Than One? , 2013, IEEE Access.

[6]  Armen Yuri Gasparyan,et al.  The Journal Impact Factor: Moving Toward an Alternative and Combined Scientometric Approach , 2016, Journal of Korean medical science.

[7]  Chun-Ting Zhang,et al.  A proposal for a novel impact factor as an alternative to the JCR impact factor , 2013, Scientific Reports.

[8]  Remedios Melero,et al.  Altmetrics – a complement to conventional metrics , 2015, Biochemia medica.

[9]  David L Bartley,et al.  The ups and downs of journal impact factors. , 2008, The Annals of occupational hygiene.

[10]  C K Ranjan,et al.  Bibliometric Indices of Scientific Journals: Time to overcome the obsession and think beyond the Impact Factor. , 2017, Medical journal, Armed Forces India.

[11]  N. Skokauskas,et al.  Impact factor of medical education journals and recently developed indices: Can any of them support academic promotion criteria? , 2016, Journal of postgraduate medicine.

[12]  B. Reider Brace for Impact , 2017, The American journal of sports medicine.

[13]  E. Diamandis,et al.  The emerging landscape of scientific publishing. , 2017, Clinical biochemistry.

[14]  A. Abacı Scientific competition, impact factor, and Altmetrics , 2017, Anatolian journal of cardiology.

[15]  Leslie Citrome,et al.  Impact factor? Shmimpact factor!: the journal impact factor, modern day literature searching, and the publication process. , 2007, Psychiatry (Edgmont (Pa. : Township)).

[16]  Maria Liakata,et al.  Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements , 2017, PloS one.

[17]  A. Vaccaro,et al.  Understanding Traditional Research Impact Metrics , 2017, Clinical spine surgery.

[18]  C. Bradshaw,et al.  How to Rank Journals , 2016, PloS one.

[19]  Ludo Waltman,et al.  Some Limitations of the H Index: A Commentary on Ruscio and Colleagues' Analysis of Bibliometric Indices , 2012 .

[20]  Time to remodel the journal impact factor , 2016, Nature.

[21]  Emmanuel J Favaloro,et al.  Measuring the quality of journals and journal articles: the impact factor tells but a portion of the story. , 2008, Seminars in thrombosis and hemostasis.

[22]  Ted Brown,et al.  Quality Metrics : Options to Consider Other Than Impact Factors , 2011 .

[23]  A. Casadevall,et al.  Causes for the Persistence of Impact Factor Mania , 2014, mBio.

[24]  Vijay Prakash Mathur,et al.  Impact factor and other standardized measures of journal citation: a perspective. , 2009, Indian journal of dental research : official publication of Indian Society for Dental Research.

[25]  Richard van Noorden Controversial impact factor gets a heavyweight rival , 2016, Nature.

[26]  J. Fenton,et al.  Alternatives to the impact factor. , 2014, The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland.

[27]  Raymond Coleman The future of scientific publishing. , 2008, Acta histochemica.

[28]  K. Satyanarayana Are we heading in the right direction? , 2007, The Indian journal of medical research.

[29]  E. Garfield Citation indexes for science. A new dimension in documentation through association of ideas. 1955. , 1955, International journal of epidemiology.

[30]  Ashish Singla,et al.  Altmetrics - A Collated Adjunct Beyond Citations for Scholarly Impact: A Systematic Review. , 2017, Journal of clinical and diagnostic research : JCDR.

[31]  E. Garfield Citation analysis as a tool in journal evaluation. , 1972, Science.

[32]  Y. Ikeda,et al.  Okamoto's Strategy to Develop Argatroban: An Innovative Concept for the Future , 2008 .

[33]  A. Casadevall,et al.  Impacted Science: Impact Is Not Importance , 2015, mBio.

[34]  Sara Aase What weight does impact factor carry? , 2008, Journal of the American Dietetic Association.