The Measurement of Low- and High-Impact in Citation Distributions: Technical Results

This paper introduces a novel methodology for comparing the citation distributions of research units of a certain size working in the same homogeneous field. Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of any distribution: a high-impact and a low-impact measure defined over the set of articles with citations above or below the CCL. The key to this methodology is the identification of a citation distribution with an income distribution. Once this step is taken, it is easy to realize that the measurement of low-impact coincides with the measurement of economic poverty. In turn, it is equally natural to identify the measurement of high-impact with the measurement of a certain notion of economic affluence. On the other hand, it is seen that the ranking of citation distributions according to a family of low-impact measures is essentially characterized by a number of desirable axioms. Appropriately redefined, these same axioms lead to the selection of an equally convenient class of decomposable high-impact measures. These two families are shown to satisfy other interesting properties that make them potentially useful in empirical applications, including the comparison of research units working in different fields.

[1]  H. Watts.  An Economic Definition Of Poverty , 1969 .

[2]  Thed N. van Leeuwen,et al.  New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications , 1995, Scientometrics.

[3]  A. F. J. van Raan,et al.  Handbook of quantitative studies of science and technology , 1988 .

[4]  A. Sen,et al.  Notes on the measurement of inequality , 1973 .

[5]  Peter Vinkler,et al.  Evaluation of some methods for the relative assessment of scientific publications , 1986, Scientometrics.

[6]  Dominique Thon.  A Note on a Troublesome Axiom for Poverty Indices [On Indices for the Measurement of Poverty] , 1983 .

[7]  Stephen P. Jenkins,et al.  THREE ‘I’S OF POVERTY CURVES, WITH AN ANALYSIS OF UK POVERTY TRENDS , 1997 .

[8]  Christopher A. Sims,et al.  Advances in Econometrics , 1996 .

[9]  Gerhard J. Woeginger,et al.  A symmetry axiom for scientific impact indices , 2008, J. Informetrics.

[10]  E. Garfield,et al.  Long live the scientists: Tracking the scientific fame of great minds in physics , 2018, J. Informetrics.

[11]  Dag W. Aksnes,et al.  The effect of highly cited papers on national citation indicators , 2004, Scientometrics.

[12]  S. Chakravarty.  A New Index of Poverty , 1983, Poverty, Social Exclusion and Stochastic Dominance.

[13]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[14]  Gerhard J. Woeginger,et al.  An axiomatic characterization of the Hirsch-index , 2008, Math. Soc. Sci..

[15]  Wolfgang Glänzel,et al.  A relational charting approach to the world of basic research in twelve science fields at the end of the second millennium , 2004, Scientometrics.

[16]  Henk F. Moed,et al.  Handbook of Quantitative Science and Technology Research , 2005 .

[17]  E. Thorbecke,et al.  A Class of Decomposable Poverty Measures , 1984 .

[18]  Wolfgang Glänzel,et al.  Characteristic scores and scales in assessing citation impact , 1988, J. Inf. Sci..

[19]  Thed N. van Leeuwen,et al.  The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence , 2003, Scientometrics.

[20]  Pedro Albarrán,et al.  High- and Low-Impact Citation Measures: Empirical Applications , 2010, J. Informetrics.

[21]  Wolfgang Glänzel,et al.  Subject field characteristic citation scores and scales for assessing research performance , 1987, Scientometrics.

[22]  J. S. Katz,et al.  Scale-independent indicators and research evaluation , 2000 .

[23]  Graham Pyatt,et al.  MEASURING WELFARE, POVERTY AND INEQUALITY* , 1987 .

[24]  Wolfgang Glänzel,et al.  Theoretical and Empirical Studies of the Tail of Scientometric Distributions , 1988 .

[25]  P. Gottschalk,et al.  The Measurement of Poverty , 1983 .

[26]  Tibor Braun,et al.  Relative indicators and relational charts for comparative assessment of publication output and citation impact , 1986, Scientometrics.

[27]  Ronald Rousseau,et al.  Journal of Informetrics -index , 2022 .

[28]  B. Zheng.  Aggregate Poverty Measures , 2002 .

[29]  Robert J. W. Tijssen,et al.  Scoreboards of research excellence , 2003 .

[30]  Zameer Shah,et al.  Measuring science , 2004, BMJ : British Medical Journal.

[31]  A. Shorrocks,et al.  Revisiting the Sen Poverty Index , 1995 .

[32]  Ben R. Martin,et al.  Assessing basic research , 1993 .

[33]  Wolfgang Glänzel,et al.  Coauthorship Patterns and Trends in the Sciences (1980-1998): A Bibliometric Study With Implications for Database Indexing and Search Strategies , 2002, Libr. Trends.

[34]  Peter Vinkler.  Relations of relative scientometric indicators , 2004, Scientometrics.

[35]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[36]  David Johnson.  The Measurement of Poverty in Australia: 1981–82 and 1985–86 , 1988 .

[37]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[38]  H. Moed,et al.  The use of bibliometric data for the measurement of university research performance , 1985 .

[39]  B. Martin,et al.  Some partial indicators of scientific progress in radio astronomy , 1983 .

[40]  A. Sen,et al.  Poverty: An Ordinal Approach to Measurement , 1976 .

[41]  Antonio Quesada,et al.  Monotonicity and the Hirsch index , 2009, J. Informetrics.

[42]  Jean-François Molinari,et al.  Mathematical aspects of a new criterion for ranking scientific institutions based on the h-index , 2008, Scientometrics.

[43]  B. Martin,et al.  Assessing Basic Research : Some Partial Indicators of Scientific Progress in Radio Astronomy : Research Policy , 1987 .

[44]  Daniel P. Moynihan,et al.  On understanding poverty : perspectives from the social sciences , 1970 .

[45]  D. Ulph,et al.  On Indices for the Measurement of Poverty , 1981 .

[46]  J. S. Katz,et al.  The self-similar science system , 1999 .

[47]  A. Kinney.  National scientific facilities and their science impact on nonbiomedical research , 2007, Proceedings of the National Academy of Sciences.

[48]  James E. Foster,et al.  SUBGROUP CONSISTENT POVERTY INDICES , 1991 .

[49]  Thed N. van Leeuwen,et al.  Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? , 2002, Scientometrics.

[50]  Jean-François Molinari,et al.  A new methodology for ranking scientific institutions , 2008, Scientometrics.

[51]  Lutz Bornmann,et al.  OPEN PEN ACCESS CCESS , 2008 .

[52]  W. Glänzel,et al.  Scientometric indicators. A 32 country comparison of publication productivity and citation impact , 1985 .

[53]  Dominique Thon,et al.  On Measuring Poverty , 1979 .

[54]  Thierry Marchant,et al.  An axiomatic characterization of the ranking based on the h-index and some other bibliometric rankings of authors , 2009, Scientometrics.

[55]  P. Allison.  Inequality and Scientific Productivity , 1980 .

[56]  Pedro Albarrán,et al.  References made and citations received by scientific articles , 2011, J. Assoc. Inf. Sci. Technol..

[57]  Pedro Albarrán,et al.  A comparison of the scientific performance of the U.S. and the European Union at the turn of the XXI century , 2009 .

[58]  Per O. Seglen,et al.  The Skewness of Science , 1992, J. Am. Soc. Inf. Sci..

[59]  Pedro Albarrán,et al.  The skewness of science in 219 sub-fields and a number of aggregates , 2010, Scientometrics.

[60]  Wolfgang Glänzel,et al.  Characteristic scores and scales: A bibliometric analysis of subject characteristics based on long-term citation observation , 2007, J. Informetrics.

[61]  Tibor Braun,et al.  AGAINST ABSOLUTE METHODS: RELATIVE SCIENTOMETRIC INDICATORS AND RELATIONAL CHARTS AS EVALUATION TOOLS , 1988 .

[62]  Antonio Quesada,et al.  More axiomatics for the Hirsch index , 2010, Scientometrics.