The success-index: an alternative approach to the h-index for evaluating an individual’s research output

Among the most recent bibliometric indicators for normalizing the differences among fields of science in terms of citation behaviour, Kosmulski (J Informetr 5(3):481–485, 2011) proposed the NSP (number of successful paper) index. According to the authors, NSP deserves much attention for its great simplicity and immediate meaning—equivalent to those of the h-index—while it has the disadvantage of being prone to manipulation and not very efficient in terms of statistical significance. In the first part of the paper, we introduce the success-index, aimed at reducing the NSP-index’s limitations, although requiring more computing effort. Next, we present a detailed analysis of the success-index from the point of view of its operational properties and a comparison with the h-index’s ones. Particularly interesting is the examination of the success-index scale of measurement, which is much richer than the h-index’s. This makes success-index much more versatile for different types of analysis—e.g., (cross-field) comparisons of the scientific output of (1) individual researchers, (2) researchers with different seniority, (3) research institutions of different size, (4) scientific journals, etc.

[1]  Brian W. Rogers,et al.  Meeting Strangers and Friends of Friends: How Random are Social Networks? , 2007 .

[2]  Henk F. Moed,et al.  Measuring contextual citation impact of scientific journals , 2009, J. Informetrics.

[3]  F. Roberts.  Measurement Theory with Applications to Decisionmaking, Utility, and the Social Sciences: Measurement Theory , 1984 .

[4]  Henry G. Small,et al.  Clustering thescience citation index® using co-citations - I. A comparison of methods , 1985, Scientometrics.

[5]  Fiorenzo Franceschini,et al.  The citation triad: An overview of a scientist's publication output based on Ferrers diagrams , 2010, J. Informetrics.

[6]  Marek Kosmulski.  New seniority-independent Hirsch-type index , 2009, J. Informetrics.

[7]  Paul Nicholls,et al.  Introduction to informetrics: Quantitative methods in library, documentation and information science , 1991 .

[8]  Lutz Bornmann,et al.  Some interesting insights from aggregated data published in the World Report SIR 2010 , 2011, J. Informetrics.

[9]  Ronald Rousseau,et al.  A Simple Impact Measure and Its Evolution over Time , 2011 .

[10]  Ronald Rousseau,et al.  New journal impact indicators take references into account: a comparison , 2010 .

[11]  Ronald Rousseau,et al.  New developments related to the Hirsch index , 2006 .

[12]  Loet Leydesdorff,et al.  Normalization at the field level: fractional counting of citations , 2010, J. Informetrics.

[13]  Fiorenzo Franceschini,et al.  Bibliometric positioning of scientific manufacturing journals: a comparative analysis , 2011, Scientometrics.

[14]  Manfred Kochen,et al.  Principles of information retrieval , 1974 .

[15]  Leo Egghe,et al.  The influence of merging on h-type indices , 2008, J. Informetrics.

[16]  Mônica G. Campiteli,et al.  Is it possible to compare researchers with different scientific interests? , 2006, Scientometrics.

[17]  Ludo Waltman,et al.  A recursive field-normalized bibliometric performance indicator: an application to the field of library and information science , 2011, Scientometrics.

[18]  Peter Taylor,et al.  Citation Statistics , 2009, ArXiv.

[19]  Marek Kosmulski,et al.  Successful papers: A new idea in evaluation of scientific output , 2011, J. Informetrics.

[20]  Michel Zitt,et al.  Citing-side normalization of journal impact: A robust variant of the Audience Factor , 2010, J. Informetrics.

[21]  Leo Egghe,et al.  An informetric model for the Hirsch-index , 2006, Scientometrics.

[22]  Günter Krampen,et al.  Acceleration of citing behavior after the millennium? Exemplary bibliometric reference analyses for psychology journals , 2010, Scientometrics.

[23]  Juan E. Iglesias,et al.  Scaling the h-index for different scientific ISI fields , 2006, Scientometrics.

[24]  Sam Wilson,et al.  What makes an article influential? Predicting impact in social and personality psychology , 2008, Scientometrics.

[25]  Quentin L. Burrell,et al.  Hirsch index or Hirsch rate? Some thoughts arising from Liang’s data , 2007, Scientometrics.

[26]  Fiorenzo Franceschini,et al.  Management by Measurement: Designing Key Indicators and Performance Measurement Systems , 2007 .

[27]  Koenraad Debackere,et al.  A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking , 2011, Scientometrics.

[28]  Vincent Larivière,et al.  The fall of uncitedness , 2008 .

[29]  Eugene Garfield,et al.  Is citation analysis a legitimate evaluation tool? , 2005, Scientometrics.

[30]  John Mingers,et al.  Measuring the research contribution of management academics using the Hirsch-index , 2009, J. Oper. Res. Soc..

[31]  I. K. Ravichandra Rao,et al.  Relations among the number of Citations, References and Authors: Revisited , 2012 .

[32]  Loet Leydesdorff,et al.  How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines , 2010, J. Assoc. Inf. Sci. Technol..

[33]  H. Moed.  CWTS crown indicator measures citation impact of a research group's publication oeuvre , 2010, J. Informetrics.

[34]  W. J. Thron,et al.  Encyclopedia of Mathematics and its Applications. , 1982 .

[35]  Lutz Bornmann,et al.  Mimicry in science? , 2010, Scientometrics.

[36]  Henry G. Small,et al.  On the shoulders of Robert Merton: Towards a normative theory of citation , 2004, Scientometrics.

[37]  Loet Leydesdorff,et al.  Fractional counting of citations in research evaluation: A cross- and interdisciplinary assessment of the Tsinghua University in Beijing , 2011, J. Informetrics.

[38]  M. Amin,et al.  Impact factors: use and abuse. , 2003, Medicina.

[39]  Michel Zitt,et al.  Modifying the journal impact factor by fractional citation weighting: The audience factor , 2008, J. Assoc. Inf. Sci. Technol..

[40]  Jan M. Rabaey,et al.  Comparison of Methods , 2004 .

[41]  Loet Leydesdorff,et al.  Integrated Impact Indicators (I3) compared with Impact Factors (IFs): An alternative research design with policy implications , 2011, J. Assoc. Inf. Sci. Technol..

[42]  Douglas W. Mitchell,et al.  88.27 More on spreads and non-arithmetic means , 2004, The Mathematical Gazette.

[43]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[44]  Thed N. van Leeuwen,et al.  Towards a new crown indicator: Some theoretical considerations , 2010, J. Informetrics.

[45]  Fiorenzo Franceschini,et al.  Analysis of the Hirsch index's operational properties , 2010, Eur. J. Oper. Res..

[46]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[47]  James R Williamson,et al.  My h-index turns 40: my midlife crisis of impact. , 2009, ACS chemical biology.

[48]  Anne-Wil Harzing,et al.  Google Scholar as a new source for citation analysis , 2008 .

[49]  Henry G. Small,et al.  Clustering thescience citation index® using co-citations , 1985, Scientometrics.

[50]  Fiorenzo Franceschini,et al.  Article in Press G Model Journal of Informetrics the Hirsch Spectrum: a Novel Tool for Analyzing Scientific Journals , 2022 .