Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups

In this paper we present characteristics of the statistical correlation between the Hirsch (h-) index and several standard bibliometric indicators, as well as with the results of peer review judgment. We use the results of a large evaluation study of 147 university chemistry research groups in the Netherlands covering the work of about 700 senior researchers during the period 1991–2000. Thus, we deal with research groups rather than individual scientists, as we consider the research group as the most important work floor unit in research, particularly in the natural sciences. Furthermore, we restrict the citation period to a three-year window instead of ‘life time counts’ in order to focus on the impact of recent work and thus on current research performance. Results show that the h-index and our bibliometric ‘crown indicator’ both relate in a quite comparable way with peer judgments. But for smaller groups in fields with ‘less heavy citation traffic’ the crown indicator appears to be a more appropriate measure of research performance.

[1]  Lutz Bornmann,et al.  Does the h-index for ranking of scientists really work? , 2005, Scientometrics.

[2]  Henk F. Moed,et al.  Handbook of Quantitative Science and Technology Research , 2005 .

[3]  Mônica G. Campiteli,et al.  An index to quantify an individual's scientific research valid across disciplines , 2005 .

[4]  R. Prins,et al.  Chemistry and chemical engineering of catalytic processes , 1980 .

[5]  Anthony F. J. van Raan,et al.  Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises , 1996, Scientometrics.

[6]  Willi Meier,et al.  Chemistry and Chemical Engineering , 1999 .

[7]  Wolfgang Glänzel,et al.  A Hirsch-type index for journals , 2006, Scientometrics.

[8]  A. V. van Raan,et al.  Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods , 2005 .

[9]  S. Popov A parameter to quantify dynamics of a researcher's scientific activity , 2005, physics/0508113.

[10]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[11]  J. Hirsch An index to quantify an individual's scientific output , 2005 .

[12]  Anthony F. J. van Raan,et al.  Statistical properties of bibliometric indicators: Research group indicator distributions and correlations , 2006, J. Assoc. Inf. Sci. Technol..

[13]  Mônica G. Campiteli,et al.  Is it possible to compare researchers with different scientific interests? , 2006, Scientometrics.

[14]  W. Glänzel,et al.  A Hirsch-type index for journals [1] , 2005 .

[15]  A. Raan Measuring Science: Capita Selecta of Current Main Issues , 2004 .

[16]  Philip Ball,et al.  Index aims for fair ranking of scientists , 2005, Nature.

[17]  H. Moed Citation Analysis in Research Evaluation (Information Science & Knowledge Management) , 2005 .