Facing Diversity of Science: A Challenge for Bibliometric Indicators

Bibliometrics has come of age and is generally accepted, together with peer review, as one way to describe the activity of players in science. Van Raan (this issue), with his team a prominent contributor to this specialty, describes in the focus article a variety of state-of-the-art indicators that show the concern of bibliometricians for improving measures used in sensitive contexts such as research assessment. I shall not try to comment on all aspects of this substantial contribution. The sections of the focus article (performance, interdisciplinarity, structure) deal in various ways with the central question of the diversity of science as either an object or a framework for performance indicators. I limit my discussion here to a few practical issues stemming from this diversity: How do you define or structure a scientific field? Is normalization straightforward? Which measure can be used for measuring knowledge flows and relations among fields? As the present challenges of science and technology indicators can hardly be disconnected from a historical perspective of scientometrics, a bit of hindsight is perhaps necessary. There is a lot of evidence since the work of Price (1963), Nalimov & Mulczenko (1969), and Garfield & Cawkell (1970) that many facets of scientific activity are amenable to measurement and modeling. Scientometrics handles as typical objects the networks generated by scientific activity, especially those implicitly carried by published outputs (networks of authors–institutions, of documents, of lexical contents, etc.). A typical one is the network of citation link-

[1]  Leo Egghe,et al.  The exact place of Zipf's and Pareto's law amongst the classical informetric laws , 2005, Scientometrics.

[2]  Michel Zitt,et al.  Indicators in a research institute: A multi-level classification of scientific journals , 1999, Scientometrics.

[3]  J. ANTHONYF. Competition amongst scientists for publication status: Toward a model of scientific publication and citation distributions , 2001 .

[4]  Grant Lewison Researchers" and users" perceptions of the relative standing of biomedical papers in different journals , 2004, Scientometrics.

[5]  Henry G. Small,et al.  On the shoulders of Robert Merton: Towards a normative theory of citation , 2004, Scientometrics.

[6]  S. Bradford "Sources of information on specific subjects" by S.C. Bradford , 1985 .

[7]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[8]  Henry G. Small,et al.  Clustering thescience citation index® using co-citations , 1985, Scientometrics.

[9]  Michael J. Moravcsik,et al.  Variation of the nature of citation measures with journals and scientific specialties , 1978, J. Am. Soc. Inf. Sci..

[10]  Wiebe E. Bijker,et al.  Science in action : how to follow scientists and engineers through society , 1989 .

[11]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[12]  A. Bookstein Informetric distributions, part I: Unified overview , 1990 .

[13]  Ronald Rousseau Relations between continuous versions of bibliometric laws , 1990, J. Am. Soc. Inf. Sci..

[14]  André Salem Jean-Paul Benzécri et collaborateurs, Pratique de l'analyse des données : linguistique et lexicologie , 1982 .

[15]  Tibor Braun,et al.  AGAINST ABSOLUTE METHODS: RELATIVE SCIENTOMETRIC INDICATORS AND RELATIONAL CHARTS AS EVALUATION TOOLS , 1988 .

[16]  Henry Small,et al.  Structural dynamics of scientific literature , 1976 .

[17]  Francis Narin,et al.  Status report: Linkage between technology and science , 1992 .

[18]  L. Butler,et al.  Explaining Australia’s increased share of ISI publications—the effects of a funding formula based on publication counts , 2003 .

[19]  Ed C. M. Noyons,et al.  Bibliometric mapping of science in a policy context , 2004, Scientometrics.

[20]  Henk F. Moed,et al.  Improving the accuracy of Institute for Scientific Information's journal impact factors , 1995 .

[21]  Henry G. Small,et al.  Clustering thescience citation index® using co-citations - I. A comparison of methods , 1985, Scientometrics.

[22]  Francis Narin,et al.  Clustering of scientific journals , 1973, J. Am. Soc. Inf. Sci..

[23]  Subbiah Arunachalam,et al.  HOW RELEVANT IS MEDICAL RESEARCH DONE IN INDIA? : A STUDY BASED ON MEDLINE , 1997 .

[24]  P. T. P. OLIVER,et al.  Citation Indexing for Studying Science , 1970, Nature.

[25]  D. Hicks The Four Literatures of Social Science , 2004 .

[26]  Thed N. van Leeuwen,et al.  Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance , 2001, Scientometrics.

[27]  Michel Zitt,et al.  The transition from “national” to “transnational” model and related measures of countries' performance , 1998 .

[28]  Anthony F. J. van Raan,et al.  On Growth, Ageing, and Fractal Differentiation of Science , 2000, Scientometrics.

[29]  M. Callon,et al.  From translations to problematic networks: An introduction to co-word analysis , 1983 .

[30]  Michel Zitt,et al.  Bridging citation and reference distributions: Part I - The referencing-structure function and its application to co-citation and co-item studies , 2004, Scientometrics.

[31]  B. C. Griffith,et al.  The Structure of Scientific Literatures I: Identifying and Graphing Specialties , 1974 .

[32]  Loet Leydesdorff,et al.  The delineation of specialties in terms of journals using the dynamic journal set of the SCI , 2005, Scientometrics.

[33]  R. Merton Behavior Patterns Of Scientists , 1970, American scientist.

[34]  S. D. Haitun,et al.  Stationary scientometric distributions , 1982, Scientometrics.

[35]  M. Moravcsik,et al.  The coverage of science in the thrid world : The "Philadelphia program" , 1988 .

[36]  Abraham Bookstein,et al.  Informetric distributions, part I: Unified overview , 1990, J. Am. Soc. Inf. Sci..

[37]  Alfred J. Lotka,et al.  The frequency distribution of scientific productivity , 1926 .

[38]  Anthony F. J. van Raan,et al.  Competition amongst scientists for publication status:Toward a model of scientific publication and citation distributions , 2001, Scientometrics.

[39]  M. Trajtenberg,et al.  International Knowledge Flows: Evidence from Patent Citations , 1998 .

[40]  L. Leydesdorff The triple helix: an evolutionary model of innovations , 2000 .

[41]  J. S. Katz,et al.  The self-similar science system , 1999 .

[42]  Ronald N. Kostoff,et al.  Citation analysis of research performer quality , 2004, Scientometrics.

[43]  Michel Zitt,et al.  The Transition from "National" to "Transnational" Model and Related Measures of Countries' Performance , 1998, J. Am. Soc. Inf. Sci..

[44]  Rafael Bailón-Moreno,et al.  Structure and dynamics of scientific networks. Part II: The new Zipf's law, the clusters of co-citations and the model of the descriptor presence , 1999, Scientometrics.

[45]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[46]  R. Merton The Matthew Effect in Science , 1968, Science.

[47]  Michel Zitt,et al.  Correcting glasses help fair comparisons in international science landscape: Country indicators as a function of ISI database delineation , 2003, Scientometrics.

[48]  Grant Lewison,et al.  From biomedical research to health improvement , 2002, Scientometrics.

[49]  Michel Zitt,et al.  Development of a method for detection and trend analysis of research fronts built by lexical or cocitation analysis , 1994, Scientometrics.

[50]  M. M. Kessler Bibliographic coupling between scientific papers , 1963 .

[51]  S. D. Haitun Stationary scientometric distributions - Part II. Non-Gaussian nature of scientific activities , 1982, Scientometrics.

[52]  Wolfgang Glänzel,et al.  A bibliometric study on ageing and reception processes of scientific literature , 1995, J. Inf. Sci..

[53]  Location of Milestone Papers Through Citation Networks , 1962 .

[54]  Peter Ingwersen,et al.  The calculation of web impact factors , 1998, J. Documentation.