An indicator of journal impact that is based on calculating a journal's percentage of highly cited publications

The two most used citation impact indicators in the assessment of scientific journals are, nowadays, the impact factor and the h-index. However, both indicators are not field normalized (vary heavily depending on the scientific category) which makes them incomparable between categories. Furthermore, the impact factor is not robust to the presence of articles with a large number of citations, while the h-index depends on the journal size. These limitations are very important when comparing journals of different sizes and categories. An alternative citation impact indicator is the percentage of highly cited articles in a journal. This measure is field normalized (comparable between scientific categories), independent of the journal size and also robust to the presence of articles with a high number of citations. This paper empirically compares this indicator with the impact factor and the h-index, considering different time windows and citation percentiles (levels of citation for considering an article as highly cited compared to others in the same year and category).

[1]  Michel Zitt,et al.  Modifying the journal impact factor by fractional citation weighting: The audience factor , 2008, J. Assoc. Inf. Sci. Technol..

[2]  Leo Egghe,et al.  A general framework for relative impact indicators , 2003 .

[3]  Loet Leydesdorff,et al.  Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers , 2012, Scientometrics.

[4]  Stephen J. Bensman.  Garfield and the impact factor , 2007 .

[5]  Rodrigo Costas,et al.  The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level , 2007, J. Informetrics.

[6]  Henk F. Moed,et al.  Measuring contextual citation impact of scientific journals , 2009, J. Informetrics.

[7]  María Bordons,et al.  Una visión crítica del índice h: algunas consideraciones derivadas de su aplicación práctica , 2007 .

[8]  Pablo Dorta-González,et al.  Impact maturity times and citation time windows: The 2-year maximum journal impact factor , 2013, J. Informetrics.

[9]  Félix de Moya Anegón,et al.  The SJR indicator: A new indicator of journals' scientific prestige , 2009, ArXiv.

[10]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[11]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[12]  Carl T. Bergstrom.  Eigenfactor Measuring the value and prestige of scholarly journals , 2007 .

[13]  Leo Egghe.  Theoretical justification of the central area indices and the central interval indices , 2012, Scientometrics.

[14]  Henk F. Moed,et al.  Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way , 2012, Scientometrics.

[15]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[16]  Thed N. van Leeuwen,et al.  Rivals for the crown: Reply to Opthof and Leydesdorff , 2010, J. Informetrics.

[18]  Rafael Suárez-Vega,et al.  Journal topic citation potential and between-field comparisons: The topic normalized impact factor , 2014, J. Informetrics.

[19]  María Bordons,et al.  Bibliometric analysis of publications of Spanish pharmacologists in the SCI (1984–89). Part II , 1992, Scientometrics.

[20]  Kevin W. Boyack,et al.  Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature , 2011, J. Informetrics.

[21]  Carl T. Bergstrom,et al.  Differences in impact factor across fields and over time , 2009 .

[22]  Ludo Waltman,et al.  Source normalized indicators of citation impact: an overview of different approaches and an empirical comparison , 2012, Scientometrics.

[23]  Pablo Dorta-González,et al.  Comparing journals from different fields of science and social science through a JCR subject categories normalized impact factor , 2012, Scientometrics.

[24]  M. González,et al.  Hábitos de publicación y citación según campos científicos: Principales diferencias a partir de las revistas JCR , 2013 .