Empirical evidence for the relevance of fractional scoring in the calculation of percentile rank scores

Fractional scoring has been proposed to avoid inconsistencies in the attribution of publications to percentile rank classes. Uncertainties and ambiguities in the evaluation of percentile ranks can be demonstrated most easily with small data sets. But for larger data sets, an often large number of papers with the same citation count leads to the same uncertainties and ambiguities, which can be avoided by fractional scoring, demonstrated by four different empirical data sets with several thousand publications each, which are assigned to six percentile rank classes. Only by utilizing fractional scoring does, the total score of all papers exactly reproduce the theoretical value in each case.

[1]  Michael Schreiber,et al.  Seasonal bias in editorial decisions for a physics journal: you should write when you like, but submit in July , 2012, Learn. Publ..

[2]  Michael Schreiber,et al.  An empirical investigation of the g-index for 26 physicists in comparison with the h-index, the A-index, and the R-index , 2008, J. Assoc. Inf. Sci. Technol..

[3]  Ronald Rousseau,et al.  Basic properties of both percentile rank scores and the I3 indicator , 2012, J. Assoc. Inf. Sci. Technol..

[4]  Michael Schreiber,et al.  Revisiting the g-index: The average number of citations in the g-core , 2010, J. Assoc. Inf. Sci. Technol..

[5]  Loet Leydesdorff,et al.  Integrated Impact Indicators (I3) compared with Impact Factors (IFs): An alternative research design with policy implications , 2011, J. Assoc. Inf. Sci. Technol..

[6]  Irving I. Gringorten,et al.  A plotting rule for extreme probability paper , 1963 .

[7]  Lutz Bornmann,et al.  How to analyze percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes, and top-cited papers , 2013, J. Assoc. Inf. Sci. Technol..

[8]  Michael Schreiber,et al.  Uncertainties and ambiguities in percentiles and how to avoid them , 2012, J. Assoc. Inf. Sci. Technol..

[9]  Michael Schreiber,et al.  Inconsistencies of recently proposed citation impact indicators and how to avoid them , 2012, J. Assoc. Inf. Sci. Technol..

[10]  Michael Schreiber,et al.  To share the fame in a fair way, hm modifies h for multi-authored manuscripts , 2008 .

[11]  Allen Hazen,et al.  Storage to be Provided Impounding Reservoirs for Municipal Water Supply , 1913 .

[12]  Lutz Bornmann,et al.  Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization , 2011, J. Informetrics.

[13]  Lutz Bornmann How to analyse percentile impact , 2012 .

[14]  Michael Schreiber,et al.  The influence of self‐citation corrections and the fractionalised counting of multi‐authored manuscripts on the Hirsch index , 2009 .

[15]  Loet Leydesdorff,et al.  Accounting for the Uncertainty in the Evaluation of Percentile Ranks , 2012, J. Assoc. Inf. Sci. Technol..

[16]  Alexander I. Pudovkin,et al.  Percentile Rank and Author Superiority Indexes for Evaluating Individual Journal Articles and the Author’s Overall Citation Performance , 2009 .

[17]  H. Leon Harter,et al.  Another look at plotting positions , 1984 .

[18]  Ludo Waltman,et al.  On the calculation of percentile-based bibliometric indicators , 2012, J. Assoc. Inf. Sci. Technol..

[19]  Loet Leydesdorff,et al.  Turning the tables in citation analysis one more time: Principles for comparing sets of documents by using an “Integrated Impact Indicator” (I3) , 2011 .

[20]  Michael Schreiber,et al.  Twenty Hirsch index variants and other indicators giving more or less preference to highly cited papers , 2010, ArXiv.

[21]  Rob J Hyndman,et al.  Sample Quantiles in Statistical Packages , 1996 .

[22]  Lutz Bornmann The problem of percentile rank scores used with small reference sets , 2013, J. Assoc. Inf. Sci. Technol..

[23]  Loet Leydesdorff,et al.  Percentile ranks and the integrated impact indicator (I3) , 2011, J. Assoc. Inf. Sci. Technol..

[24]  C. Cunnane Unbiased plotting positions — A review , 1978 .