Do we need the h index and its variants in addition to standard bibliometric measures?

In this study, we investigate whether there is a need for the h index and its variants in addition to standard bibliometric measures (SBMs). Results from our recent study (L. Bornmann, R. Mutz, & H.-D. Daniel, 2008) have indicated that there are two types of indices: One type of indices (e.g., h index) describes the most productive core of a scientist’s output and informs about the number of papers in the core.The other type of indices (e.g., a index) depicts the impact of the papers in the core. In evaluative bibliometric studies, the two dimensions quantity and quality of output are usually assessed using the SBMs “number of publications” (for the quantity dimension) and “total citation counts” (for the impact dimension). We additionally included the SBMs into the factor analysis. The results of the newly calculated analysis indicate that there is a high intercorrelation between “number of publications” and the indices that load substantially on the factor Quantity of the Productive Core as well as between “total citation counts” and the indices that load substantially on the factor Impact of the Productive Core. The high-loading indices and SBMs within one performance dimension could be called redundant in empirical application, as high intercorrelations between different indicators are a sign for measuring something similar (or the same). Based on our findings, we propose the use of any pair of indicators (one relating to the number of papers in a researcher’s productive core and one relating to the impact of these core papers) as a meaningful approach for comparing scientists.

[1]  L. Egghe Power Laws in the Information Production Process: Lotkaian Informetrics , 2005 .

[2]  Henk F. Moed,et al.  Handbook of Quantitative Science and Technology Research: The Use of Publication and Patent Statistics in Studies of S&T Systems , 2004 .

[3]  N. H. Timm Applied Multivariate Analysis , 2002 .

[4]  Lutz Bornmann,et al.  Selecting scientific excellence through committee peer review - A citation analysis of publications previously published to approval or rejection of post-doctoral research fellowship applicants , 2006, Scientometrics.

[5]  Lutz Bornmann,et al.  What do we know about the h index? , 2007, J. Assoc. Inf. Sci. Technol..

[6]  S. West,et al.  The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. , 1996 .

[7]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[8]  L. Egghe An improvement of the h-index: the g-index , 2006 .

[9]  W F Velicer,et al.  Component Analysis versus Common Factor Analysis: Some issues in Selecting an Appropriate Procedure. , 1990, Multivariate behavioral research.

[10]  M. Kosmulski A new Hirsch-type index saves time and works equally well as the original h-index , 2009 .

[11]  A. Raan Measuring Science: Capita Selecta of Current Main Issues , 2004 .

[12]  L. Bornmann,et al.  The state of h index research , 2009, EMBO reports.

[13]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[14]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[15]  J. Hirsch Does the h index have predictive power? , 2007, Proceedings of the National Academy of Sciences.

[16]  L. Egghe,et al.  The power of power laws and an interpretation of Lotkaian informetric systems as self-similar fractals , 2005, J. Assoc. Inf. Sci. Technol..

[17]  P. Kline The New Psychometrics: Science, Psychology and Measurement , 1998 .

[18]  T. V. Leeuwen Testing the validity of the Hirsch-index for research assessment purposes , 2008 .

[19]  Lutz Bornmann,et al.  Does the h-index for ranking of scientists really work? , 2005, Scientometrics.

[20]  Leo Egghe,et al.  An h-index weighted by citation impact , 2008, Inf. Process. Manag..

[21]  R. Gonzalez Applied Multivariate Statistics for the Social Sciences , 2003 .