h-index and its alternative: A Review

In recent years, several Scientometrics and Bibliometrics indicators were proposed to evaluate the scientific impact of individuals, institutions, colleges, universities and research teams. The h-index gives a major breakthrough in the research community to evaluate the scientific impact of an individual. It got a lot of attention due to its simplicity and several other indicators were proposed to extend the properties of h-index as well as to overcome shortcomings of h-index. In this literature review, we have discussed the advantages and limitations of almost all Scientometrics as well as Bibliometrics indicators which have been categorized into seven categories :(i) Complement of h-index, (ii) Based on total number of authors, (iii) Based on publication age, (iv) Combination of two indices, (v) Based on excess citation count, (vi) Based on total publication count, (vii) Based on other variants. The main objective of this article is to study all those indicators which have been proposed to evaluate the scientific impact of an individual researcher or a group of researchers.

[1]  Lutz Bornmann,et al.  A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants , 2011, J. Informetrics.

[2]  Mauno Vihinen,et al.  National research contributions: A case study on Finnish biomedical research , 2008, Scientometrics.

[3]  Roman A. Zubarev,et al.  An updated h-index measures both the primary and total scientific output of a researcher , 2015, Discoveries.

[4]  Anand Bihari,et al.  Year based EM-index: a new approach to evaluate the scientific impact of scholars , 2018, Scientometrics.

[5]  Gangan Prathap.  Going much beyond the Durfee square: enhancing the hT index , 2009, Scientometrics.

[6]  L. Bornmann,et al.  The state of h index research , 2009, EMBO reports.

[7]  Richard S. J. Tol,et al.  Rational (successive) h-indices: An application to economics in the Republic of Ireland , 2008, Scientometrics.

[8]  Nils T. Hagen,et al.  Harmonic Allocation of Authorship Credit: Source-Level Correction of Bibliometric Bias Assures Accurate Publication and Citation Analysis , 2008, PloS one.

[9]  Ronald Rousseau,et al.  A Simple Impact Measure and Its Evolution over Time , 2011 .

[10]  Francisco Herrera,et al.  hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices , 2010, Scientometrics.

[11]  Xiaojun Hu,et al.  Loads of special authorship functions: Linear growth in the percentage of “equal first authors” and corresponding authors , 2009 .

[12]  F. J. Cabrerizoa,et al.  q 2-Index : Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core , 2009 .

[13]  R. Rousseau,et al.  Reflections on recent developments of the h-index and h-type indices , 2008 .

[14]  Quentin L. Burrell,et al.  Hirsch's h-index: A stochastic model , 2007, J. Informetrics.

[15]  L. Egghe.  An improvement of the h-index: the g-index , 2006 .

[16]  Ronald Rousseau,et al.  Real and rational variants of the h-index and the g-index , 2009, J. Informetrics.

[17]  Leo Egghe,et al.  An h-index weighted by citation impact , 2008, Inf. Process. Manag..

[18]  Derek R. Smith.  “Platinum H”: Refining the H-Index to More Realistically Assess Career Trajectory and Scientific Publications , 2015, Archives of Environmental & Occupational Health.

[19]  Quentin L. Burrell,et al.  On the h-index, the size of the Hirsch core and Jin's A-index , 2007, J. Informetrics.

[20]  Ying Ding,et al.  Popular and/or prestigious? Measures of scholarly esteem , 2010, Inf. Process. Manag..

[21]  Judit Bar-Ilan,et al.  Informetrics at the beginning of the 21st century - A review , 2008, J. Informetrics.

[22]  Mu-Hsuan Huang,et al.  A probe into dynamic measures for h-core and h-tail , 2013, J. Informetrics.

[23]  Jerome K. Vanclay,et al.  On the robustness of the h-index , 2007, J. Assoc. Inf. Sci. Technol..

[24]  J. Spicer.  The Holy Grail , 1964 .

[25]  Anne-Wil Harzing,et al.  The Publish or Perish Book: Your guide to effective and responsible citation analysis , 2010 .

[26]  M. Kosmulski.  A new Hirsch-type index saves time and works equally well as the original h-index , 2009 .

[27]  Jörn Altmann,et al.  Evaluating scholars based on their academic collaboration activities: two indices, the RC-index and the CC-index, for quantifying collaboration activities of researchers and scientific communities , 2010, Scientometrics.

[28]  Robin K. S. Hankin,et al.  Beyond the Durfee square: Enhancing the h-index to score total publication output , 2008, Scientometrics.

[29]  Fiorenzo Franceschini,et al.  The citation triad: An overview of a scientist's publication output based on Ferrers diagrams , 2010, J. Informetrics.

[30]  Anand Bihari,et al.  EM-index: a new measure to evaluate the scientific impact of scientists , 2017, Scientometrics.

[31]  Loet Leydesdorff,et al.  Simple arithmetic versus intuitive understanding: The case of the impact factor , 2011 .

[32]  Ronald Rousseau,et al.  New developments related to the Hirsch index , 2006 .

[33]  Marek Kosmulski,et al.  Successful papers: A new idea in evaluation of scientific output , 2011, J. Informetrics.

[34]  Ludo Waltman,et al.  Generalizing the H- and G-Indices , 2008, J. Informetrics.

[35]  Chun-Ting Zhang,et al.  The e-Index, Complementing the h-Index for Excess Citations , 2009, PloS one.

[36]  Yuxian Liu.  The diffusion of scientific ideas in time and indicators for the description of this process , 2011 .

[37]  Yu Liu,et al.  Empirical study of L-Sequence: The basic h-index sequence for cumulative publications with consideration of the yearly citation performance , 2014, J. Informetrics.

[38]  Rodrigo Costas,et al.  The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level , 2007, J. Informetrics.

[39]  Leo Egghe,et al.  The single publication H-index and the indirect H-index of a researcher , 2011, Scientometrics.

[40]  Jayant S. Vaidya,et al.  V-index: A fairer index to quantify an individual 's research output capacity , 2005 .

[41]  Richard S. J. Tol,et al.  A rational, successive g-index applied to economics departments in Ireland , 2008, J. Informetrics.

[42]  Josep Domingo-Ferrer,et al.  A bibliometric index based on the collaboration distance between cited and citing authors , 2011, J. Informetrics.

[43]  M. Greene.  The demise of the lone author , 2007, Nature.

[44]  Michael Schreiber,et al.  To share the fame in a fair way, hm modifies h for multi-authored manuscripts , 2008 .

[45]  Michael Schreiber.  A case study of the modified Hirsch index hm accounting for multiple coauthors , 2009, J. Assoc. Inf. Sci. Technol..

[46]  Chun-Ting Zhang,et al.  The h’-Index, Effectively Improving the h-Index Based on the Citation Distribution , 2013, PloS one.

[47]  R. Todeschini,et al.  Handbook of Bibliometric Indicators: Quantitative Tools for Studying and Evaluating Research , 2016 .

[48]  Ronald Rousseau,et al.  Properties of Hirsch-type indices: the case of library classification categories , 2009, Scientometrics.

[49]  Ronald Rousseau,et al.  Probing the h-core: an investigation of the tail–core ratio for rank distributions , 2010, Scientometrics.

[50]  Lucio Bertoli-Barsotti,et al.  On a formula for the h-index , 2015, J. Informetrics.

[51]  Henk F. Moed,et al.  Measuring contextual citation impact of scientific journals , 2009, J. Informetrics.

[52]  Jorge E. Hirsch,et al.  An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship , 2009, Scientometrics.

[53]  Ronald Rousseau,et al.  Year-based h-type indicators , 2012, Scientometrics.

[54]  András Schubert,et al.  Using the h-index for assessing single publications , 2009, Scientometrics.

[55]  Wiley Interscience.  Journal of the American Society for Information Science and Technology , 2013 .

[56]  Lutz Bornmann,et al.  The b index as a measure of scientific excellence. A promising supplement to the h index , 2007 .

[57]  Qiang Wu.  The w-index: A significant improvement of the h-index , 2008 .

[58]  Dietmar Wolfram,et al.  Citer analysis as a measure of research impact: library and information science as a case study , 2010, Scientometrics.

[59]  Sune Lehmann,et al.  A quantitative analysis of indicators of scientific performance , 2008, Scientometrics.

[60]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[61]  Marek Kosmulski,et al.  MAXPROD - A New Index for assessment of the scientific output of an individual, and a comparison with the h-index , 2007 .

[62]  Claes Wohlin,et al.  A new index for the citation curve of researchers , 2009, Scientometrics.

[63]  Ronald Rousseau,et al.  A proposal for a dynamic h-type index , 2008, J. Assoc. Inf. Sci. Technol..

[64]  Ronald Rousseau,et al.  In those fields where multiple authorship is the rule, the h-index should be supplemented by role-based h-indices , 2010, J. Inf. Sci..

[65]  András Schubert,et al.  Hirsch-type indices for characterizing networks , 2009, Scientometrics.

[66]  M. Jennions,et al.  The h index and career assessment by numbers. , 2006, Trends in ecology & evolution.

[67]  Jörn Altmann,et al.  Evaluating the Productivity of Researchers and their Communities: The RP-Index and the CP-Index , 2010 .

[68]  Wolfgang Glänzel,et al.  Hirsch-type characteristics of the tail of distributions. The generalised h-index , 2010, J. Informetrics.

[69]  Fiorenzo Franceschini,et al.  Analysis of the Hirsch index's operational properties , 2010, Eur. J. Oper. Res..

[70]  Lutz Bornmann,et al.  Convergent validation of peer review decisions using the h index: Extent of and reasons for type I and type II errors , 2007, J. Informetrics.

[71]  Qiang Ma,et al.  Socializing the h-index , 2013, J. Informetrics.

[72]  Serge Galam,et al.  Tailor based allocations for multiple authorship: a fractional gh-index , 2010, Scientometrics.

[73]  Panayiotis Bozanis,et al.  The f index: Quantifying the impact of coterminal citations on scientists' ranking , 2009, J. Assoc. Inf. Sci. Technol..

[74]  Ludo Waltman,et al.  The inconsistency of the h-index , 2011, J. Assoc. Inf. Sci. Technol..

[75]  Nadine Rons,et al.  Impact Vitality - A Measure for Excellent Scientists , 2013, ArXiv.

[76]  Anthony F. J. van Raan.  Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups , 2013, Scientometrics.

[77]  M. Rozing,et al.  Profit (p)-Index: The Degree to Which Authors Profit from Co-Authors , 2013, PloS one.

[78]  Xiaojun Hu,et al.  Loads of special authorship functions: Linear growth in the percentage of "equal first authors" and corresponding authors , 2009, J. Assoc. Inf. Sci. Technol..

[79]  Pablo Dorta-González,et al.  Central indexes to the citation distribution: a complement to the h-index , 2011, Scientometrics.

[80]  Leo Egghe,et al.  The single publication H-index of papers in the Hirsch-core of a researcher and the indirect H-index , 2011, Scientometrics.

[81]  J. Hirsch.  Does the h index have predictive power? , 2007, Proceedings of the National Academy of Sciences.

[82]  Leo Egghe,et al.  Dynamic h-index: The Hirsch index in function of time , 2007, J. Assoc. Inf. Sci. Technol..

[83]  Thomas C. Erren,et al.  Research metrics: What about weighted citations? , 2016, Scientometrics.

[84]  Gerhard J. Woeginger,et al.  An axiomatic characterization of the Hirsch-index , 2008, Math. Soc. Sci..

[85]  Héctor Guerrero,et al.  A robust formula to credit authors for their publications , 2004, Scientometrics.

[86]  Gangan Prathap.  The fractional and harmonic p-indices for multiple authorship , 2010, Scientometrics.

[87]  Akshaya Kumar Biswal,et al.  An Absolute Index (Ab-index) to Measure a Researcher’s Useful Contributions and Productivity , 2013, PloS one.

[88]  Liming Liang,et al.  h-index sequence and h-index matrix: Constructions and applications , 2006, Scientometrics.

[89]  Michael Schreiber.  Restricting the h-index to a publication and citation time window: A case study of a timed Hirsch index , 2015, J. Informetrics.

[90]  Leo Egghe,et al.  Methods for accrediting publications to authors or countries: Consequences for evaluation studies , 2000, J. Am. Soc. Inf. Sci..

[91]  Berwin A. Turlach,et al.  The stochastic h-index , 2012, J. Informetrics.

[92]  Marek Kosmulski.  Hirsch-type index of international recognition , 2010, J. Informetrics.

[93]  Miguel A. García-Pérez,et al.  A multidimensional extension to Hirsch’s h-index , 2009, Scientometrics.

[94]  John Panaretos,et al.  Assessing scientific research performance and impact with single indices , 2008, Scientometrics.

[95]  Birger Larsen,et al.  A review of the characteristics of 108 author-level bibliometric indicators , 2014, Scientometrics.

[96]  Mu-Hsuan Huang,et al.  Positioning research and innovation performance using shape centroids of h-core and h-tail , 2011, J. Informetrics.

[97]  Martha A. Harsanyi.  Multiple authors, multiple problems: bibliometrics and the study of scholarly collaboration: a literature review , 1993 .

[98]  Miguel A. García-Pérez,et al.  An extension of the h index that covers the tail and the top of the citation curve and allows ranking researchers with similar h , 2012, J. Informetrics.

[99]  Leo Egghe.  Theoretical justification of the central area indices and the central interval indices , 2012, Scientometrics.

[100]  Izzat Alsmadi,et al.  A Survey of Impact and Citation Indices: Limitations and Issues , 2012 .

[101]  Donald Kennedy,et al.  Multiple Authors, Multiple Problems , 2003, Science.

[102]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[103]  Leo Egghe.  On the correction of the h-index for career length , 2012, Scientometrics.

[104]  Ç. Şekercioğlu.  Quantifying Coauthor Contributions , 2008, Science.

[105]  Guido Van Hooydonk,et al.  Methods for accrediting publications to authors or countries: consequences for evaluation studies , 2000 .

[106]  Mousa Yaminfirooz,et al.  Multiple h-index: a new scientometric indicator , 2015, Electron. Libr..

[107]  Michael Schreiber,et al.  A variant of the h‐index to measure recent performance , 2014, J. Assoc. Inf. Sci. Technol..

[108]  M. Shapiro,et al.  The contributions of authors to multiauthored biomedical research papers. , 1994, JAMA.

[109]  K. Henkens,et al.  Signals in Science - on the Importance of Signaling in Gaining Attention in Science , 2004 .

[110]  Wolfgang Glänzel,et al.  The R- and AR-indices: Complementing the h-index - Comments , 2007 .

[111]  Ash Mohammad Abbas,et al.  Weighted indices for evaluating the quality of research with multiple authorship , 2010, Scientometrics.

[112]  Gangan Prathap,et al.  Is there a place for a mock h-index? , 2010, Scientometrics.

[113]  Xuan Zhen Liu,et al.  Modifying h-index by allocating credit of multi-authored papers whose author names rank based on contribution , 2012, J. Informetrics.

[114]  Mônica G. Campiteli,et al.  Is it possible to compare researchers with different scientific interests? , 2006, Scientometrics.

[115]  S. Sereika,et al.  Multiple authorship: issues and recommendations. , 1997, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[116]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[117]  Roberto Todeschini,et al.  The j-index: a new bibliometric index and multivariate comparisons between other common indices , 2011, Scientometrics.

[118]  Qiang Wu,et al.  The w-index: A measure to assess scientific impact by focusing on widely cited papers , 2010 .

[119]  Nils T. Hagen,et al.  Harmonic publication and citation counting: sharing authorship credit equitably – not equally, geometrically or arithmetically , 2009, Scientometrics.

[120]  T. Keats,et al.  On multiple authorship. , 1996, Skeletal radiology.

[121]  Richard S. J. Tol,et al.  The h-index and its alternatives: An application to the 100 most prolific economists , 2009, Scientometrics.

[122]  Ronald Rousseau,et al.  The pure h-index: calculating an author’s h- index by taking co-authors into account , 2007 .

[123]  Xiaojun Wan,et al.  WL‐index: Leveraging citation mention number to quantify an individual's scientific impact , 2014, J. Assoc. Inf. Sci. Technol..

[124]  Leo Egghe,et al.  Mathematical theory of the h- and g-index in case of fractional counting of authorship , 2008, J. Assoc. Inf. Sci. Technol..

[125]  Chun-Ting Zhang,et al.  A proposal for calculating weighted citations based on author rank , 2009, EMBO reports.

[126]  Michael Schreiber,et al.  A modification of the h-index: The hm-index accounts for multi-authored manuscripts , 2008, J. Informetrics.

[127]  Hui Fang,et al.  Fairly sharing the credit of multi-authored papers and its application in the modification of h-index and g-index , 2011, Scientometrics.

[128]  R. Rousseau,et al.  Fractional counts for authorship attribution: a numerical study , 1995 .

[129]  Lutz Bornmann,et al.  The citation speed index: A useful bibliometric indicator to add to the h index , 2010, J. Informetrics.

[130]  Alex De Visscher,et al.  An index to measure a scientist's specific impact , 2010, J. Assoc. Inf. Sci. Technol..

[131]  Santo Fortunato,et al.  Author Impact Factor: tracking the dynamics of individual scientific impact , 2013, Scientific Reports.

[132]  Marek Kosmulski,et al.  Hirsch-type approach to the 2nd generation citations , 2010, J. Informetrics.

[133]  Mu-Hsuan Huang,et al.  Ranking patent assignee performance by h-index and shape descriptors , 2011, J. Informetrics.

[134]  Helmut A. Abt.  A publication index that is independent of age , 2011, Scientometrics.

[135]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[136]  Lutz Bornmann,et al.  The h index research output measurement: Two approaches to enhance its accuracy , 2010, J. Informetrics.

[137]  Dalibor Fiala.  Current index: A Proposal for a dynamic rating system for researchers , 2014, J. Assoc. Inf. Sci. Technol..

[138]  M. Würtz,et al.  The stratified H-index. , 2016, Annals of epidemiology.

[139]  Charles Oppenheim.  Fractional counting of multiauthored publications , 1998 .

[140]  Nadine Rons,et al.  Impact vitality: an indicator based on citing publications in search of excellent scientists , 2013, ArXiv.

[141]  Fiorenzo Franceschini,et al.  The success-index: an alternative approach to the h-index for evaluating an individual’s research output , 2012, Scientometrics.

[142]  Francisco Herrera,et al.  q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core , 2010, J. Informetrics.

[143]  Ben R. Martin,et al.  The use of multiple indicators in the assessment of basic research , 1996, Scientometrics.

[144]  Ronald Rousseau,et al.  The influence of missing publications on the Hirsch index , 2007, J. Informetrics.

[145]  A. D. Jackson,et al.  Measures for measures , 2006, Nature.

[146]  Michael Schreiber,et al.  Self-citation corrections for the Hirsch index , 2007 .

[147]  Stephen Cole,et al.  Social Stratification in Science , 1974 .

[148]  Yannis Manolopoulos,et al.  Generalized Hirsch h-index for disclosing latent facts in citation networks , 2007, Scientometrics.

[149]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[150]  Guido Van Hooydonk,et al.  Fractional Counting of Multiauthored Publications: Consequences for the Impact of Authors , 1997, J. Am. Soc. Inf. Sci..

[151]  Richard J. C. Brown.  A simple method for excluding self-citation from the h-index: the b-index , 2009, Online Inf. Rev..

[152]  Ana Paula Couto da Silva,et al.  tc-index: A New Research Productivity Index Based on Evolving Communities , 2015, TPDL.

[153]  Marek Kosmulski.  New seniority-independent Hirsch-type index , 2009, J. Informetrics.

[154]  Peter Vinkler,et al.  The π-index: a new indicator for assessing scientific impact , 2009, J. Inf. Sci..

[155]  Wolfgang Glänzel,et al.  Mean response time — A new indicator of journal citation speed with application to physics journals , 1986 .

[156]  Juan Imperial,et al.  Usefulness of Hirsch’s h-index to evaluate scientific research in Spain , 2007, Scientometrics.

[157]  Duncan Lindsey,et al.  Production and Citation Measures in the Sociology of Science: The Problem of Multiple Authorship , 1980 .

[158]  J. E. Hirsch,et al.  The meaning of the h-index , 2014 .

[159]  ANTHONY F. J. VAN RAAN,et al.  Sleeping Beauties in science , 2004, Scientometrics.

[160]  Pablo Dorta-gonzález,et al.  Indicador bibliométrico basado en el índice h , 2010 .

[161]  Marek Kosmulski,et al.  The order in the lists of authors in multi-author papers revisited , 2012, J. Informetrics.

[162]  Bihui Jin.  The AR-index: complementing the h-index , 2007 .