The highly cited papers of professors as an indicator of a research group's scientific performance

In the first part of the paper the citations in 1986 and 1987 of 3938 papers published in 1985 by 324 research groups in the faculties of science and of medicine of eight universities in the Netherlands are analyzed. Because of the large statistical spread of (1) the number of short-term citations of papers cited equally frequently over a long period, and (2) the number of citations over a long period of papers by the same author, short-term citation scores appear to be an unreliable indicator of a research group's contribution to science. In the second part of the paper an alternative approach is presented, based on a subdivision of the 3938 papers in papers authored by professors with 0–2, 3–8, or ≥9 highly cited papers (HCPs, ≥25 citations) to their name. Very large citation score differences were found for the three categories. For example: for papers first-authored by a professor, the average number of citations per person in 1986 and 1987 for 1985 papers was for 161 professors with ≥9 HCPs a factor 14 larger than for 575 professors with only 0–2 HCPs; for papers co-authored by professors, this factor was 6.6. These findings justify the conclusion that the number of HCPs scored by the professors (and other senior scientists) during their entire career is a much more reliable predictor of the performance of a research group than the number of short-term citations of the articles published by the group within a short period. A research group's contribution to science is primarily determined by the individual scientifictalents of its members.

[1]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[2]  J. Witkowski Fifty years on: molecular biology's hall of fame , 1988 .

[3]  Reinier Plomp Statistical reliability of citation frequency as an indicator of scientific impact , 2005, Scientometrics.

[4]  H. Moed,et al.  The use of bibliometric data for the measurement of university research performance , 1985 .

[5]  Wolfgang Glänzel,et al.  The newest version of the facts and figures on publication output and relative citation impact in the life sciences and chemistry 1981–1985 , 1988, Scientometrics.

[6]  Henk F. Moed,et al.  A comparative study of bibliometric past performance analysis and peer judgement , 2005, Scientometrics.

[7]  Alan E. Bayer,et al.  Validity of citation criteria for assessing the influence of scientific publications: New evidence with peer assessment , 1983, J. Am. Soc. Inf. Sci..

[8]  Wolfgang Glänzel,et al.  The newest version of the facts and figures on publication output and relative citation impact in physics, engineering and mathematics 1981–1985 , 1988, Scientometrics.

[9]  H. Judson The Eighth Day of Creation: Makers of the Revolution in Biology , 2013 .

[10]  Julie A. C. Virgo,et al.  A Statistical Procedure for Evaluating the Importance of Scientific Papers , 1977, The Library Quarterly.

[11]  Reinier Plomp,et al.  The significance of the number of highly cited papers as an indicator of scientific prolificacy , 1990, Scientometrics.