A two-dimensional approach to performance evaluation for a large number of research institutions

We characterize the research performance of a large number of institutions in a two-dimensional coordinate system based on the shapes of their h-cores so that their relative performance can be conveniently observed and compared. The 2D distribution of these institutions is then utilized (1) to categorize the institutions into a number of qualitative groups revealing the nature of their performance, and (2) to determine the position of a specific institution among the set of institutions. The method is compared with some major h-type indices and tested with empirical data using clinical medicine as an illustrative case. The method is extensible to the research performance evaluation at other aggregation levels such as researchers, journals, departments, and nations.

[1]  Fred Y. Ye Two H-mixed Synthetic Indices for the Assessment of Research Performance , 2010 .

[2]  Chun-Ting Zhang,et al.  The e-Index, Complementing the h-Index for Excess Citations , 2009, PloS one.

[3]  Francisco Herrera,et al.  q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core , 2010, J. Informetrics.

[4]  Ricardo Arencibia Jorge,et al.  Applying successive H indices in the institutional evaluation: A case study , 2008, J. Assoc. Inf. Sci. Technol..

[5]  Angelos Hatzakis,et al.  Assessing the impact of biomedical research in academic institutions of disparate sizes , 2009, BMC medical research methodology.

[6]  András Schubert,et al.  Successive h-indices , 2007, Scientometrics.

[7]  Leo Egghe,et al.  The Hirsch index and related impact measures , 2010, Annu. Rev. Inf. Sci. Technol..

[8]  Francisco Herrera,et al.  hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices , 2010, Scientometrics.

[9]  Mu-Hsuan Huang,et al.  A Comparative Analysis of the Application of H-index, G-index, and A-index in Institutional-Level Research Evaluation , 2010 .

[10]  L. Egghe An improvement of the h-index: the g-index , 2006 .

[11]  Bihui Jin The AR-index: complementing the h-index , 2007 .

[12]  Ronald Rousseau,et al.  New developments related to the Hirsch index , 2006 .

[13]  Qiang Wu,et al.  The w-index: A measure to assess scientific impact by focusing on widely cited papers , 2010, J. Assoc. Inf. Sci. Technol..

[14]  Claes Wohlin,et al.  A new index for the citation curve of researchers , 2009, Scientometrics.

[15]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[16]  Mu-Hsuan Huang,et al.  Positioning research and innovation performance using shape centroids of h-core and h-tail , 2011, J. Informetrics.

[17]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[18]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[19]  Mu-Hsuan Huang,et al.  Ranking patent assignee performance by h-index and shape descriptors , 2011, J. Informetrics.

[20]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[21]  Ronald Rousseau,et al.  A discussion of Prathap's h2-index for institutional evaluation with an application in the field of HIV infection and therapy , 2010, J. Informetrics.

[22]  Lutz Bornmann,et al.  The h index research output measurement: Two approaches to enhance its accuracy , 2010, J. Informetrics.

[23]  M. Kosmulski A new Hirsch-type index saves time and works equally well as the original h-index , 2009 .

[24]  Jean-François Molinari,et al.  A new methodology for ranking scientific institutions , 2008, Scientometrics.

[25]  Ronald Rousseau,et al.  Probing the h-core: an investigation of the tail–core ratio for rank distributions , 2010, Scientometrics.

[26]  Jean-François Molinari,et al.  Mathematical aspects of a new criterion for ranking scientific institutions based on the h-index , 2008, Scientometrics.

[27]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.