A Novel Journal Evaluation Metric that Adjusts the Impact Factors across Different Subject Categories

During the last two decades, impact factor has been widely used as a journal evaluation metric that differentiates the influence of a specific journal compared with other journals. However, impact factor does not provide a reliable metric between journals in different subject categories. For example, higher impact factors are given to biology and general sciences than those assigned to other traditional engineering and social sciences. This study initially analyzes the trend of the time series of the impact factors of the journals listed in Journal Citation Reports during the last decade. This study then proposes new journal evaluation metrics that adjust the impact factors across different subject categories. The proposed metrics possibly provides a consistent measure to mitigate the differences in impact factors among subject categories. On the basis of experimental results, we recommend the most reliable and appropriate metric to evaluate journals that are less dependent on the characteristics of subject categories.

[1]  Kai Simons,et al.  The Misused Impact Factor , 2008, Science.

[2]  Carl T. Bergstrom,et al.  Differences in impact factor across fields and over time , 2009 .

[3]  Ying Cheng,et al.  Comparison of the effect of mean-based method and z-score for field normalization of citations at the level of Web of Science subject categories , 2014, Scientometrics.

[4]  Pablo Dorta-González,et al.  Comparing journals from different fields of science and social science through a JCR subject categories normalized impact factor , 2012, Scientometrics.

[5]  Stuart Brody Impact factor: Imperfect but not yet replaceable , 2012, Scientometrics.

[6]  Alexander I. Pudovkin,et al.  Rank normalization of impact factors will resolve Vanclay’s dilemma with TRIF , 2012, Scientometrics.

[7]  Jerome K. Vanclay,et al.  Impact factor: outdated artefact or stepping-stone to journal certification? , 2011, Scientometrics.

[8]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[9]  Joseph A. Konstan,et al.  Conference paper selectivity and impact , 2010, Commun. ACM.

[10]  Andrea Bergmann,et al.  Citation Indexing Its Theory And Application In Science Technology And Humanities , 2016 .

[11]  Michel Zitt,et al.  Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation , 2005, Scientometrics.

[12]  Loet Leydesdorff,et al.  Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers , 2012, Scientometrics.