Impact Factor : Moving Toward an Alternative and Combined Scientometric Approach

The Journal Impact Factor (JIF) is a single citation metric, which is widely employed for ranking journals and choosing target journals, but is also misused as the proxy of the quality of individual articles and academic achievements of authors. This article analyzes Scopus-based publication activity on the JIF and overviews some of the numerous misuses of the JIF, global initiatives to overcome the ‘obsession’ with impact factors, and emerging strategies to revise the concept of the scholarly impact. The growing number of articles on the JIF, most of which are in English, reflects interest of experts in journal editing and scientometrics toward its uses, misuses, and options to overcome related problems. Solely displaying values of the JIFs on the journal websites is criticized by experts as these average metrics do not reflect skewness of citation distribution of individual articles. Emerging strategies suggest to complement the JIFs with citation plots and alternative metrics, reflecting uses of individual articles in terms of downloads and distribution of related information through social media and networking platforms. It is also proposed to revise the original formula of the JIF calculation and embrace the concept of the impact and importance of individual articles. The latter is largely dependent on ethical soundness of the journal instructions, proper editing and structuring of articles, efforts to promote related information through social media, and endorsements of professional societies.

[1]  D. Quintana,et al.  Twitter Article Mentions and Citations: An Exploratory Analysis of Publications in the American Journal of Psychiatry. , 2016, The American journal of psychiatry.

[2]  Iman Tahamtan,et al.  Factors affecting number of citations: a comprehensive review of the literature , 2016, Scientometrics.

[3]  Jeffrey Beall,et al.  Dangerous Predatory Publishers Threaten Medical Research , 2016, Journal of Korean medical science.

[4]  Tara J Brigham An Introduction to Altmetrics , 2014, Medical reference services quarterly.

[5]  Xue-Li Liu,et al.  Journal Impact Factor: Do the Numerator and Denominator Need Correction? , 2016, PloS one.

[6]  L. Waltman,et al.  A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations , 2016, PloS one.

[7]  Richard Van Noorden,et al.  The top 100 papers , 2014, Nature.

[8]  M. Kunz,et al.  Journal Impact Factors: Their relevance and their influence on society-published scientific journals , 2013 .

[9]  K. Seitz,et al.  Impact Factors and Prediction of Popular Topics in a Journal , 2016, Ultraschall in der Medizin - European Journal of Ultrasound.

[10]  G. Kitas,et al.  Upgrading instructions for authors of scholarly journals , 2014, Croatian medical journal.

[11]  S. Barbic,et al.  An Analysis of Altmetrics in Emergency Medicine. , 2016, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[12]  Tobias Kiesslich,et al.  Reasons for Journal Impact Factor Changes: Influence of Changing Source Items , 2016, PloS one.

[13]  C. Hervé,et al.  Ethics requirements and impact factor , 2011, Journal of Medical Ethics.

[14]  B. AbdullGaffar Impact factor in cytopathology journals: what does it reflect and how much does it matter? , 2012, Cytopathology : official journal of the British Society for Clinical Cytology.

[15]  Robert P. Dellavalle,et al.  Social networking sites: emerging and essential tools for communication in dermatology. , 2014, JAMA dermatology.

[16]  Danielle Li,et al.  Big names or big ideas: Do peer-review panels select the best science proposals? , 2015, Science.

[17]  How publishing in open access journals threatens science and what we can do about it , 2016 .

[18]  Aileen Clarke,et al.  Citation Classics in Systematic Reviews and Meta-Analyses: Who Wrote the Top 100 Most Cited Articles? , 2013, PloS one.

[19]  Juxia Zhang,et al.  Epidemiology, quality, and reporting characteristics of systematic reviews and meta-analyses of nursing interventions published in Chinese journals. , 2015, Nursing outlook.

[20]  T. Hornberger,et al.  Faculty Opinions recommendation of Research funding. Big names or big ideas: do peer-review panels select the best science proposals? , 2015 .

[21]  S. Sohail Of predatory publishers and spurious impact factors. , 2014, Journal of the College of Physicians and Surgeons--Pakistan : JCPSP.

[22]  Tanja Bekhuis Keywords, discoverability, and impact. , 2015, Journal of the Medical Library Association : JMLA.

[23]  H. Haitjema Impact Factor or Impact? , 2015, Ground water.

[24]  R. Cubelli,et al.  Downloads as a possible index of impact? , 2013, Cortex.

[25]  Qinghui Suo Chinese Academic Assessment and Incentive System , 2016, Sci. Eng. Ethics.

[26]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.

[27]  G. Wilkinson,et al.  Impact factors of psychiatric journals , 1997, British Journal of Psychiatry.

[28]  M. Falagas,et al.  Temporal Trends in the Impact Factor of European versus USA Biomedical Journals , 2011, PloS one.

[29]  Ewen Callaway,et al.  Beat it, impact factor! Publishing elite turns against controversial metric , 2016, Nature.

[30]  Marko Pećina,et al.  Impact and alternative metrics for medical publishing: our experience with International Orthopaedics , 2015, International Orthopaedics.

[31]  S. Bavdekar,et al.  Choosing the Right Journal for a Scientific Paper. , 2015, The Journal of the Association of Physicians of India.

[32]  Nader Ale Ebrahim,et al.  Major trends in knowledge management research: a bibliometric study , 2016, Scientometrics.

[33]  Min Chen,et al.  The impact factor of rheumatology journals: an analysis of 2008 and the recent 10 years , 2010, Rheumatology International.

[34]  C. Hervé,et al.  Ethics requirements and impact factor in radiological journals , 2016, Acta radiologica.

[35]  Rinze Benedictus,et al.  Fewer numbers, better science , 2016, Nature.

[36]  Theodore D Cosco,et al.  Medical journals, impact and social media: an ecological study of the Twittersphere , 2015, Canadian Medical Association Journal.

[37]  Impact by Citations and Downloads: What are Heart, Lung and Circulation's Top 25 Articles of All Time? , 2016, Heart, lung & circulation.

[38]  Allan Lee,et al.  A Numbers Game , 2016 .

[39]  John S Rhee,et al.  High-Impact Articles-Citations, Downloads, and Altmetric Score. , 2015, JAMA facial plastic surgery.

[40]  Ju-fang Shao,et al.  Research assessment and monetary rewards: the overemphasized impact factor in China , 2012 .

[41]  Giovanni Abramo,et al.  The effect of a country’s name in the title of a publication on its visibility and citability , 2016, Scientometrics.

[42]  H. Benamer,et al.  Why are journals from less-developed countries constrained to low impact factors? , 2014, The Libyan journal of medicine.

[43]  S. Rijcke,et al.  Bibliometrics: The Leiden Manifesto for research metrics , 2015, Nature.

[44]  Time to remodel the journal impact factor , 2016, Nature.

[45]  Andrew Forbes,et al.  Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions. , 2014, The Cochrane database of systematic reviews.

[46]  R. Haynes,et al.  Doubling the impact: publication of systematic review articles in orthopaedic journals. , 2004, The Journal of bone and joint surgery. American volume.

[47]  F. Fernandez‐Llimos Bradford’s law, the long tail principle, and transparency in Journal Impact Factor calculations , 2016, Pharmacy practice.

[48]  Martina Horvat,et al.  An Analysis of Medical Laboratory Technology Journals’ Instructions for Authors , 2016, Sci. Eng. Ethics.

[49]  C. Blanford Impact factors, citation distributions and journal stratification , 2016, Journal of Materials Science.

[50]  Jagadeesh Bayry,et al.  Metrics: journal's impact factor skewed by a single paper , 2010, Nature.

[51]  Johan Bollen,et al.  A Principal Component Analysis of 39 Scientific Impact Measures , 2009, PloS one.

[52]  A.N. Libkind,et al.  Bibliometric Indicators of Russian Journals by JCR-Science Edition, 1995-2010 , 2013, Acta naturae.

[53]  E. Garfield The history and meaning of the journal impact factor. , 2006, JAMA.

[54]  Christian Schindler,et al.  If I tweet will you cite? The effect of social media exposure of articles on downloads and citations , 2016, International Journal of Public Health.

[55]  Xiyan Zhao,et al.  The top 100 most cited scientific reports focused on diabetes research , 2016, Acta Diabetologica.

[56]  Raymond E. Gibson Considerations on Impact Factor and Publications in Molecular Imaging and Biology , 2015, Molecular Imaging and Biology.

[57]  B. Konety,et al.  Factors associated with the Journal Impact Factor (JIF) for Urology and Nephrology Journals , 2015, International braz j urol : official journal of the Brazilian Society of Urology.

[58]  E. Garfield Journal impact factor: a brief review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[59]  James Wilsdon,et al.  We need a measured approach to metrics , 2015, Nature.

[60]  Sung-Tae Hong,et al.  Celebrating the Achievements and Fulfilling the Mission of the Korean Association of Medical Journal Editors , 2016, Journal of Korean medical science.

[61]  Graham Scott,et al.  The numbers game. , 2010, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[62]  J. Berlin,et al.  Quality of meta-analyses for randomized trials in the field of hypertension: a systematic review , 2016, Journal of hypertension.

[63]  Isabell M. Welpe,et al.  I Like, I Cite? Do Facebook Likes Predict the Impact of Scientific Work? , 2015, PloS one.

[64]  A. Undas The 2015 impact factor for Pol Arch Med Wewn: comments from the Editor‑in‑Chief. , 2016, Polskie Archiwum Medycyny Wewnetrznej.