Calibration against a reference set: A quantitative approach to assessment of the methods of assessment of scientific output

A set of authors whose scientific output can be unequivocally ranged from the highest to the lowest is used to assess the methods of assessment of scientific output. The rank-rank correlation coefficient between the known order in the calibration set and the order produced by certain method of assessment is a quantitative measure of the quality of that method. A common-sense-based reference may play a positive role in the communication between the enthusiasts and antagonists of bibliometric indices.

[1]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[2]  Marek Kosmulski,et al.  Successful papers: A new idea in evaluation of scientific output , 2011, J. Informetrics.

[3]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[4]  Lutz Bornmann,et al.  Does the h-index for ranking of scientists really work? , 2005, Scientometrics.

[5]  Anthony F. J. van Raan.  Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups , 2013, Scientometrics.

[6]  Lutz Bornmann,et al.  A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants , 2011, J. Informetrics.

[7]  A A M Wilde,et al.  The Hirsch-index: a simple, new tool for the assessment of scientific output of individual scientists , 2009, Netherlands heart journal : monthly journal of the Netherlands Society of Cardiology and the Netherlands Heart Foundation.

[8]  M. Walport,et al.  Looking for Landmarks: The Role of Expert Review and Bibliometric Analysis in Evaluating Scientific Publication Outputs , 2009, PloS one.

[9]  Richard S. J. Tol,et al.  The h-index and its alternatives: An application to the 100 most prolific economists , 2009, Scientometrics.

[10]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[11]  Peter Vinkler,et al.  The πv-index: a new indicator to characterize the impact of journals , 2010, Scientometrics.

[12]  Marek Kosmulski.  Hirsch-type index of international recognition , 2010, J. Informetrics.