A Survey of Impact and Citation Indices: Limitations and Issues

Research projects can be evaluated through evaluating the research publications produced through those projects. Research publications are evaluation using impact factors and citation indices. There are several citation indices that are proposed and existed to assess the value of a research publication or the research impact of an author or a journal. In this paper, an extensive survey is conducted to evaluate the majority of the citation indices. Using examples, we demonstrated some of the limitations and problems with those indices. The evaluation showed that there is a need for more sensitive and comprehensive citation indices that can take into considerations all the factors that may impact a research publication or author. Survey also showed that the majority of citation indices heavily depend on the “Hcore” focus on most cited papers which exist in H-index and most successive indices.

[1]  M. Jennions,et al.  The h index and career assessment by numbers. , 2006, Trends in ecology & evolution.

[2]  Lutz Bornmann,et al.  The h index research output measurement: Two approaches to enhance its accuracy , 2010, J. Informetrics.

[3]  Chun-Yang Yin,et al.  Do impact factor, h-index and Eigenfactor (TM) of chemical engineering journals correlate well with each other and indicate the journals' influence and prestige? , 2011 .

[4]  Chun-Ting Zhang,et al.  The e-Index, Complementing the h-Index for Excess Citations , 2009, PloS one.

[5]  Ludo Waltman,et al.  The inconsistency of the h-index , 2011, J. Assoc. Inf. Sci. Technol..

[6]  Quentin L. Burrell,et al.  On Hirsch’s h, Egghe’s g and Kosmulski’s h(2) , 2009, Scientometrics.

[7]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[8]  M. Kosmulski.  A new Hirsch-type index saves time and works equally well as the original h-index , 2009 .

[9]  Robin K. S. Hankin,et al.  Beyond the Durfee square: Enhancing the h-index to score total publication output , 2008, Scientometrics.

[10]  Rodrigo Costas,et al.  The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level , 2007, J. Informetrics.

[11]  Karen T. Lum,et al.  Selecting Best Practices for Effort Estimation , 2006, IEEE Transactions on Software Engineering.

[12]  Francisco Herrera,et al.  q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core , 2010, J. Informetrics.

[13]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[14]  Leo Egghe,et al.  An h-index weighted by citation impact , 2008, Inf. Process. Manag..

[15]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[16]  Ronald Rousseau,et al.  Probing the h-core: an investigation of the tail–core ratio for rank distributions , 2010, Scientometrics.

[17]  Peter Vinkler,et al.  The πv-index: a new indicator to characterize the impact of journals , 2010, Scientometrics.

[18]  Francisco Herrera,et al.  hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices , 2010, Scientometrics.

[19]  Yannis Manolopoulos,et al.  Generalized Hirsch h-index for disclosing latent facts in citation networks , 2007, Scientometrics.

[20]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[21]  Gangan Prathap,et al.  Is there a place for a mock h-index? , 2010, Scientometrics.

[22]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[23]  Qiang Wu,et al.  The w-index: A measure to assess scientific impact by focusing on widely cited papers , 2010, J. Assoc. Inf. Sci. Technol..