The influence of editorial decisions and the academic network on self-citations and journal impact factors

Abstract There are many means by which editors can inappropriately manipulate journal impact factors, but questions remain as to whether these potentially inappropriate behaviors actually influence these scores to an empirically meaningful degree, and which academic disciplines are most culpable. In this manuscript, we propose a game-theoretic/information-asymmetry model that suggests manipulation is reinforced by a feedback loop that creates incentives for manipulation to spread and for disciplines to specialize in the type of manipulation used. We empirically investigate these hypotheses for four different manipulation strategies; coercive citation, self-serving review articles, editorials, and online queuing. Results show that all four of these techniques are effective, they inflate JIF scores and the h-index, and a significant part of that effect is due to inflated self-citations. We also find journals within disciplines tend to specialize in which technique they most frequently employ. Moreover, we show that disciplines are also interconnected, tied together by a journal cross-discipline content network and that disciplines that share more content also tend to rely more heavily on the same JIF influencing behaviors. Effective policy needs to change the editorial decision calculation by removing the benefits of manipulation; removing self-citations from journal metric calculations drastically reduces those benefits.

[1]  Paolo Malighetti,et al.  Self-citations as strategic response to the use of metrics for career decisions , 2017, Research Policy.

[2]  Henk F. Moed,et al.  Improving the accuracy of Institute for Scientific Information's journal impact factors , 1995 .

[3]  Daniel B. Suits,et al.  Dummy Variables: Mechanics v. Interpretation , 1984 .

[4]  C. Hopp,et al.  How prevalent is academic misconduct in management Research , 2017 .

[5]  Bo-Christer Björk,et al.  The publishing delay in scholarly peer-reviewed journals , 2013, J. Informetrics.

[6]  E. Fong,et al.  Authorship and citation manipulation in academic research , 2017, PloS one.

[7]  P. Lawrence The politics of publication , 2003, Nature.

[8]  S. Sachdeva,et al.  Journal Impact Factor: Its Use, Significance and Limitations , 2014, World journal of nuclear medicine.

[9]  L. Waltman,et al.  A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations , 2016, PloS one.

[10]  R. Fisher,et al.  Statistical Methods for Research Workers , 1930, Nature.

[11]  Brian C. Martinson,et al.  The Perverse Effects of Competition on Scientists’ Work and Relationships , 2007, Sci. Eng. Ethics.

[12]  T. Opthof,et al.  Inflation of impact factors by journal self-citation in cardiovascular science , 2013, Netherlands Heart Journal.

[13]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[14]  Overthrowing the Tyranny of the Journal Impact Factor , 2013, The American journal of bioethics : AJOB.

[15]  Matthew E. Falagas,et al.  The top-ten in journal impact factor manipulation , 2008, Archivum Immunologiae et Therapiae Experimentalis.

[16]  Jeremy Hall,et al.  Towards a taxonomy of research misconduct: The case of business school research , 2019, Research Policy.

[17]  Tobias Kiesslich,et al.  Reasons for Journal Impact Factor Changes: Influence of Changing Source Items , 2016, PloS one.

[18]  Olavo B. Amaral,et al.  Rising Publication Delays Inflate Journal Impact Factors , 2012, PloS one.

[19]  R. Monastersky The number that's devouring science , 2005 .

[20]  G. H. Freeman,et al.  Note on an exact treatment of contingency, goodness of fit and other problems of significance. , 1951, Biometrika.

[21]  Hude Quan,et al.  Authors' opinions on publication in relation to annual performance assessment , 2010, BMC medical education.

[22]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.