A Measure of Total Research Impact Independent of Time and Discipline

Authorship and citation practices evolve with time and differ by academic discipline. As such, indicators of research productivity based on citation records are naturally subject to historical and disciplinary effects. We observe these effects on a corpus of astronomer career data constructed from a database of refereed publications. We employ a simple mechanism to measure research output using author and reference counts available in bibliographic databases to develop a citation-based indicator of research productivity. The total research impact (tori) quantifies, for an individual, the total amount of scholarly work that others have devoted to his/her work, measured in the volume of research papers. A derived measure, the research impact quotient (riq), is an age-independent measure of an individual's research ability. We demonstrate that these measures are substantially less vulnerable to temporal debasement and cross-disciplinary bias than the most popular current measures. The proposed measures of research impact, tori and riq, have been implemented in the Smithsonian/NASA Astrophysics Data System.

[1]  Wolfgang Glänzel,et al.  A bibliometric approach to the role of author self-citations in scientific communication , 2004, Scientometrics.

[2]  R. BRIGHTMAN,et al.  The Social Function of Science , 1939, Nature.

[3]  Stephen S. Murray,et al.  The bibliometric properties of article readership information , 2005, J. Assoc. Inf. Sci. Technol..

[4]  Alberto Accomazzi,et al.  The ADS in the Information Age - Impact on Discovery , 2011, ArXiv.

[5]  Henk F. Moed,et al.  Measuring contextual citation impact of scientific journals , 2009, J. Informetrics.

[6]  Arthur W. Elias,et al.  Key papers in information science , 1971 .

[7]  Chun-Ting Zhang,et al.  The e-Index, Complementing the h-Index for Excess Citations , 2009, PloS one.

[8]  Stephen S. Murray,et al.  Worldwide Use and Impact of the NASA Astrophysics Data System Digital Library , 2009, J. Assoc. Inf. Sci. Technol..

[9]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[10]  R. Kostoff.  The (scientific) wealth of nations , 2004 .

[11]  R. Simonsen.  Credit where credit is due , 1995, Nature Cell Biology.

[12]  Leo Egghe,et al.  The Hirsch index and related impact measures , 2010, Annu. Rev. Inf. Sci. Technol..

[13]  A. D. Jackson,et al.  Measures for measures , 2006, Nature.

[14]  H. C. Spruit.  The relative significance of the H-index , 2012, ArXiv.

[15]  Michel Zitt,et al.  Citing-side normalization of journal impact: A robust variant of the Audience Factor , 2010, J. Informetrics.

[16]  D. King.  The scientific impact of nations , 2004, Nature.

[17]  Claudio Castellano,et al.  Universality of citation distributions: Toward an objective measure of scientific impact , 2008, Proceedings of the National Academy of Sciences.

[18]  Ludo Waltman,et al.  The inconsistency of the h-index , 2011, J. Assoc. Inf. Sci. Technol..

[19]  M. Bonitz.  The Scientific Talents of Nations , 1997 .

[20]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[21]  R. May.  The Scientific Wealth of Nations , 1997, Science.

[22]  Michel Zitt,et al.  Behind citing-side normalization of citations: some properties of the journal impact factor , 2011, Scientometrics.

[23]  R. Jackson,et al.  The Matthew Effect in Science , 1988, International journal of dermatology.

[24]  D J PRICE,et al.  NETWORKS OF SCIENTIFIC PAPERS. , 1965, Science.

[25]  Benjamin F. Jones,et al.  Supporting Online Material Materials and Methods Figs. S1 to S3 References the Increasing Dominance of Teams in Production of Knowledge , 2022 .

[26]  Y. Liu,et al.  Credit Where Credit Is Due , 2001 .

[27]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[28]  Mônica G. Campiteli,et al.  Is it possible to compare researchers with different scientific interests? , 2006, Scientometrics.

[29]  Amy M. Hightower,et al.  Science and Engineering Indicators , 1993 .

[30]  Plergiorgio Strata,et al.  Citation analysis , 1995, Nature.

[31]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[32]  James C. French,et al.  TRENDS IN ASTRONOMICAL PUBLICATION BETWEEN 1975 AND 1996 , 1997 .

[33]  Belver C. Griffith,et al.  Key Papers in Information Science , 1980 .

[34]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[35]  Loet Leydesdorff,et al.  How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines , 2010, J. Assoc. Inf. Sci. Technol..

[36]  Carl T. Bergstrom,et al.  The Eigenfactor MetricsTM: A Network Approach to Assessing Scholarly Journals , 2010, Coll. Res. Libr..