Individual research performance: A proposal for comparing apples to oranges

The evaluation of performance at the individual level is of fundamental importance in informing management decisions. The literature provides various indicators and types of measures, however a problem that is still unresolved and little addressed is how to compare the performance of researchers working in different fields (apples to oranges). In this work we propose a solution, testing various scaling factors for the distributions of research productivity in 174 scientific fields. The analysis is based on the observation of scientific production by all Italian university researchers active in the hard sciences over the period 2004–2008, as indexed by the Web of Science. The most effective scaling factor is the average of the productivity distribution of researchers with productivity above zero.

[1]  Anthony F. J. van Raan.  Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of research groups , 2008 .

[2]  Claudio Castellano,et al.  Rescaling citations of publications in Physics , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Giovanni Abramo,et al.  National-scale research performance assessment at the individual level , 2011, Scientometrics.

[4]  Tindaro Cicero,et al.  Revisiting the scaling of citations for research assessment , 2012, J. Informetrics.

[5]  Anthony F. J. van Raan.  Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of research groups , 2008, J. Assoc. Inf. Sci. Technol..

[6]  J. Gastwirth.  Non-parametric Statistical Methods , 1990 .

[7]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[8]  Thed N. van Leeuwen,et al.  Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of individual researchers , 2009, J. Assoc. Inf. Sci. Technol..

[9]  Thed N. van Leeuwen,et al.  Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of individual researchers , 2009 .

[10]  Tindaro Cicero,et al.  Are the authors of highly cited articles also the most productive ones? , 2018, J. Informetrics.

[11]  W. Glänzel.  Seven Myths in Bibliometrics About facts and fiction in quantitative science studies , 2008 .

[12]  Ulf Sandström,et al.  Meeting the Micro-Level Challenges : Bibliometrics at the Individual Level , 2009 .

[13]  Cristiano Giuffrida,et al.  A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments , 2011, J. Assoc. Inf. Sci. Technol..

[14]  Bruce Thompson,et al.  GRE Percentile Ranks Cannot Be Added or Averaged: A Position Paper Exploring the Scaling Characteristics of Percentile Ranks, and the Ethical and Legal Culpabilities Created by Adding Percentile Ranks in Making "High-Stakes" Admission Decisions. , 1993 .

[15]  Michel Zitt,et al.  Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation , 2005, Scientometrics.