Journals that Rise from the Fourth Quartile to the First Quartile in Six Years or Less: Mechanisms of Change and the Role of Journal Self-Citations

Journal self-citations may be increased artificially to inflate a journal’s scientometric indicators. The aim of this study was to identify possible mechanisms of change in a cohort of journals that rose from the fourth (Q4) to the first quartile (Q1) over six years or less in Journal Citation Reports (JCR), and the role of journal self-citations in these changes. A total of 51 different journals sampled from all JCR Science Citation Index (SCI) subject categories improved their rank position from Q4 in 2009 to Q1 in any year from 2010 to 2015. I identified changes in the numerator or denominator of the Journal Impact Factor (JIF) that were involved in each year-to-year transition. The main mechanism of change was the increase in the number of citations used to compute the JIF. The effect of journal self-citations in the increase of the JIF was studied. The main conclusion is that there was no evidence of widespread JIF manipulation through the overuse of journal self-citations.

[1]  Mu-Hsuan Huang,et al.  The Influence of Journal Self-citations on Journal Impact Factor and Immediacy Index , 2012, Online Inf. Rev..

[2]  Loet Leydesdorff,et al.  The operationalization of “fields” as WoS subject categories (WCs) in evaluative bibliometrics: The cases of “library and information science” and “science & technology studies” , 2014, J. Assoc. Inf. Sci. Technol..

[3]  Yaoyu Wei,et al.  Citation Characteristics of Non-Citable Documents and Contributions to Journal Impact Factor , 2018 .

[4]  Seyed Javad GHAZI MIRSAEID,et al.  Correlation between Self-Citation and Impact Factor in Iranian English Medical Journals in WoS and ISC: A Comparative Approach , 2015, Iranian journal of public health.

[5]  Ismael Rafols,et al.  A global map of science based on the ISI subject categories , 2009, J. Assoc. Inf. Sci. Technol..

[6]  Jaroslav Fiala,et al.  Reflections on how to evaluate the professional value of scientific papers and their corresponding citations , 2017, Scientometrics.

[7]  Tobias Kiesslich,et al.  Reasons for Journal Impact Factor Changes: Influence of Changing Source Items , 2016, PloS one.

[8]  Dejan Pajic,et al.  On the stability of citation-based journal rankings , 2015, J. Informetrics.

[9]  Antonia Ferrer-Sapena,et al.  Measuring Time-Dynamics and Time-Stability of Journal Rankings in Mathematics and Physics by Means of Fractional p-Variations , 2017, Publ..

[10]  Petr Heneberg,et al.  From Excessive Journal Self-Cites to Citation Stacking: Analysis of Journal Self-Citation Kinetics in Search for Journals, Which Boost Their Scientometric Indicators , 2016, PloS one.

[11]  Diana Epstein,et al.  Impact factor manipulation , 2007 .

[12]  Juan Miguel Campanario,et al.  Structure of the impact factor of journals included in the Social Sciences Citation Index: Citations from documents labeled "editorial material" , 2007, J. Assoc. Inf. Sci. Technol..

[13]  Wen-Yau Cathy Lin.  The performance of Asian S&T journals in international citation indicators , 2017, Learn. Publ..

[14]  Judit Bar-Ilan,et al.  The sources used by bibliometrics-scientometrics as reflected in references , 2002, Scientometrics.

[15]  G. Lundberg,et al.  The “omnipotent” Science Citation Index Impact Factor , 2003, The Medical journal of Australia.

[16]  Petr Heneberg,et al.  Parallel worlds of citable documents and others: Inflated commissioned opinion articles enhance scientometric indicators , 2014, J. Assoc. Inf. Sci. Technol..

[17]  F. Gao,et al.  Comparison of Journal Self-Citation Rates between Some Chinese and Non-Chinese International Journals , 2012, PloS one.

[18]  Daniel Teodorescu,et al.  An examination of “citation circles” for social sciences journals in Eastern European countries , 2013, Scientometrics.

[19]  Steven M. Shugan.  The Mission of Marketing Science , 2002 .

[20]  Matthew E. Falagas,et al.  The top-ten in journal impact factor manipulation , 2008, Archivum Immunologiae et Therapiae Experimentalis.

[21]  Guang Yu,et al.  The self-cited rate of scientific journals and the manipulation of their impact factors , 2007, Scientometrics.

[22]  D. Mannino.  Impact factor, impact, and smoke and mirrors. , 2005, American journal of respiratory and critical care medicine.

[23]  Hongling Fang.  Self-citation rates of scientific and technical journals in SCI from China, Japan, India, and Korea , 2013, Learn. Publ..

[24]  David B. Resnik,et al.  Perceptions of Ethical Problems with Scientific Journal Peer Review: An Exploratory Study , 2008, Sci. Eng. Ethics.

[25]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.

[26]  Juan Miguel Campanario,et al.  Journals that increase their impact factor at least fourfold in a few years: The role of journal self-citations , 2009, Scientometrics.

[27]  Jong Yong Abdiel Foo,et al.  A Study on Journal Self-Citations and Intra-Citing within the Subject Category of Multidisciplinary Sciences , 2009, Sci. Eng. Ethics.

[28]  Stefan N. Groesser,et al.  Dynamics of Journal Impact Factors , 2012 .

[29]  Ju-fang Shao,et al.  Research assessment and monetary rewards: the overemphasized impact factor in China , 2012 .

[30]  Marcel Ausloos,et al.  Quantitative and Qualitative Analysis of Editor Behavior through Potentially Coercive Citations , 2017, Publ..

[31]  L. Waltman,et al.  A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations , 2016, PloS one.

[32]  Ruben Coronel,et al.  Submissions, impact factor, reviewer's recommendations and geographical bias within the peer review system (1997-2002): focus on Germany. , 2002, Cardiovascular research.

[33]  C. Humphrey,et al.  A Time-Series Analysis of the Scale of Coercive Journal Self-Citation and its Effect on Impact Factors and Journal Rankings , 2019 .

[34]  T. Opthof,et al.  Inflation of impact factors by journal self-citation in cardiovascular science , 2013, Netherlands Heart Journal.

[35]  Emilio Delgado López-Cózar,et al.  The evolution of research activity in Spain , 2003, Research Policy.

[36]  M. Mimouni,et al.  Self-Citation Rate and Impact Factor in Ophthalmology , 2014, Ophthalmic Research.

[37]  Nicholas C. Romano,et al.  Journal Self-Citation V: Coercive Journal Self-Citation - Manipulations to Increase Impact Factors May Do More Harm than Good in the Long Run , 2009, Commun. Assoc. Inf. Syst..

[38]  Rosa Rodriguez-Sánchez,et al.  Scientific subject categories of Web of Knowledge ranked according to their multidimensional prestige of influential journals , 2012, J. Assoc. Inf. Sci. Technol..

[39]  Lutz Bornmann,et al.  Confidence intervals for Journal Impact Factors , 2017, Scientometrics.

[40]  Lutz Bornmann,et al.  Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based on Mendeley data , 2016, ArXiv.

[41]  Jong Yong Abdiel Foo,et al.  Impact of Excessive Journal Self-Citations: A Case Study on the Folia Phoniatrica et Logopaedica Journal , 2011, Sci. Eng. Ethics.

[42]  Frank-Thorsten Krell,et al.  Losing the numbers game: abundant self-citations put journals at risk for a life without an impact factor , 2014 .

[43]  Tian Yu,et al.  Classification method for detecting coercive self-citation in journals , 2014, J. Informetrics.

[44]  Somchai Wongwises,et al.  Mandatory and Self-citation; Types, Reasons, Their Benefits and Disadvantages , 2015, Sci. Eng. Ethics.

[45]  Artifactual Increase in Journal Self-Citation , 2011, Anesthesia and analgesia.

[46]  Juan Miguel Campanario,et al.  Large increases and decreases in journal impact factors in only one year: The effect of journal self-citations , 2011, J. Assoc. Inf. Sci. Technol..

[47]  Somchai Wongwises,et al.  Is it Ethical for Journals to Request Self-citation? , 2015, Sci. Eng. Ethics.

[48]  Alexander I. Pudovkin,et al.  Algorithmic procedure for finding semantically related journals , 2002, J. Assoc. Inf. Sci. Technol..

[49]  Keeheon Lee,et al.  Ensemble analysis of topical journal ranking in bioinformatics , 2017, J. Assoc. Inf. Sci. Technol..

[50]  Dong-Hui Yang,et al.  Detecting impact factor manipulation with data mining techniques , 2016, Scientometrics.

[51]  R. Torabian,et al.  The Relation between Self-Citation and Impact Factor in Medical Science Open Access Journals in ISI & DOAJ Databases , 2012 .

[52]  J. Neuberger,et al.  Impact factors: uses and abuses , 2002, European journal of gastroenterology & hepatology.

[53]  Ludo Waltman,et al.  A review of the literature on citation impact indicators , 2015, J. Informetrics.

[54]  Michael Mimouni,et al.  Self-citation rate and impact factor in pediatrics , 2016, Scientometrics.

[55]  Ben R. Martin,et al.  Editors’ JIF-boosting stratagems – Which are appropriate and which not? , 2016 .

[56]  Tove Faber Frandsen,et al.  Journal self-citations - Analysing the JIF mechanism , 2007, J. Informetrics.

[57]  R. Rousseau.  Temporal differences in self-citation rates of scientific journals , 2006, Scientometrics.