Weighted Consensus Index for Assessment of The Scientific Performance of Researchers

A variety of indices based on different strategies have been proposed in the literature to evaluate the scientific performance of researchers. The majority of those indices were designed to quantify the production of researchers and the impact of their publications. Currently, finding a suitable index among existing indices or developing a new index for determining the quality of research is a challenging task for the scientific community. The process of evaluating researchers should rely upon a proper aggregation of reliable and valid indices. However, very few studies have been reported on aggregating different indices to possibly generate better results. In this paper, we propose a weighted index to combine the results from individual indices. The proposed index utilizes a policy of consensus that assigns the weights to indices and linearly combines them. We evaluate and compare the weighted consensus index with the 25 indices. Experimental results on two citation data demonstrate that the weighted index may serve as a supplement to h-index and its variants to better draw the evaluation results

[1]  Qiang Wu,et al.  The w-index: A measure to assess scientific impact by focusing on widely cited papers , 2010, J. Assoc. Inf. Sci. Technol..

[2]  Chun-Ting Zhang,et al.  The e-Index, Complementing the h-Index for Excess Citations , 2009, PloS one.

[3]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[4]  Leo Egghe.  A mathematical characterization of the Hirsch-index by means of minimal increments , 2013, J. Informetrics.

[5]  M. Kosmulski.  A new Hirsch-type index saves time and works equally well as the original h-index , 2009 .

[6]  Wolfgang Glänzel,et al.  A systematic analysis of Hirsch-type indices for journals , 2007, J. Informetrics.

[7]  Robin K. S. Hankin,et al.  Beyond the Durfee square: Enhancing the h-index to score total publication output , 2008, Scientometrics.

[8]  Roberto Todeschini,et al.  The j-index: a new bibliometric index and multivariate comparisons between other common indices , 2011, Scientometrics.

[9]  Ash Mohammad Abbas,et al.  Bounds and Inequalities Relating h-Index, g-Index, e-Index and Generalized Impact Factor: An Improvement over Existing Models , 2011, PloS one.

[10]  Michael Schreiber,et al.  A case study of the arbitrariness of the h-index and the highly-cited-publications indicator , 2013, J. Informetrics.

[11]  Gangan Prathap,et al.  Is there a place for a mock h-index? , 2010, Scientometrics.

[12]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[13]  Ramiz M. Aliguliyev,et al.  Performance evaluation of density-based clustering methods , 2009, Inf. Sci..

[14]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[15]  Yannis Manolopoulos,et al.  Generalized Hirsch h-index for disclosing latent facts in citation networks , 2007, Scientometrics.

[16]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[17]  John Panaretos,et al.  Assessing scientific research performance and impact with single indices , 2008, Scientometrics.

[18]  M. Schreiber,et al.  Exploratory factor analysis for the Hirsch index, 17 h-type variants, and some traditional bibliometric indicators , 2012, J. Informetrics.

[19]  Casey W. Miller.  Superiority of the $h$-index over the Impact Factor for Physics , 2006 .

[20]  Michael Schreiber,et al.  Twenty Hirsch index variants and other indicators giving more or less preference to highly cited papers , 2010, ArXiv.

[21]  Leo Egghe,et al.  Dynamic h-index: The Hirsch index in function of time , 2007, J. Assoc. Inf. Sci. Technol..

[22]  Ludo Waltman,et al.  Generalizing the H- and G-Indices , 2008, J. Informetrics.

[23]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[24]  Leo Egghe,et al.  An h-index weighted by citation impact , 2008, Inf. Process. Manag..

[25]  Ronald Rousseau,et al.  Probing the h-core: an investigation of the tail–core ratio for rank distributions , 2010, Scientometrics.

[26]  Francisco Herrera,et al.  q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core , 2010, J. Informetrics.

[27]  Fiorenzo Franceschini,et al.  Criticism on the hg-index , 2011, Scientometrics.

[28]  Tao Li,et al.  Weighted consensus multi-document summarization , 2012, Inf. Process. Manag..

[29]  Peter Vinkler,et al.  The π-index: a new indicator for assessing scientific impact , 2009, J. Inf. Sci..

[30]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[31]  Fred Y. Ye.  An investigation on mathematical models of the h-index , 2008, Scientometrics.

[32]  Francisco Herrera,et al.  hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices , 2010, Scientometrics.

[33]  Radko Mesiar,et al.  Aggregating different paper quality measures with a generalized h-index , 2012, J. Informetrics.

[34]  F. J. Cabrerizoa,et al.  q 2-Index : Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core , 2009 .

[35]  Z. Govindarajulu,et al.  Rank Correlation Methods (5th ed.) , 2012 .

[36]  Liming Liang,et al.  h-index sequence and h-index matrix: Constructions and applications , 2006, Scientometrics.

[37]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[38]  Marek Kosmulski,et al.  MAXPROD - A New Index for assessment of the scientific output of an individual, and a comparison with the h-index , 2007 .

[39]  Richard S. J. Tol,et al.  The h-index and its alternatives: An application to the 100 most prolific economists , 2009, Scientometrics.

[40]  Ronald Rousseau,et al.  New developments related to the Hirsch index , 2006 .

[41]  Z. K. Silagadze,et al.  Citation entropy and research impact estimation , 2009, ArXiv.

[42]  M. Kendall,et al.  Rank Correlation Methods (5th ed.). , 1992 .

[43]  Peter Vinkler,et al.  The ź-index , 2009 .

[44]  Michael Schreiber,et al.  Revisiting the g-index: The average number of citations in the g-core , 2010, J. Assoc. Inf. Sci. Technol..