Extending citation analysis to non-source items

SummaryThis paper reports the first results of the extension of citation analysis to 'non-source' items, which is one strand of an extensive study of quantitative performance indicators used in the assessment of research. It would be presumptuous to draw firm conclusions from this first foray into the realm of non-source citations, however our analysis is based on an extensive experimental database of over 30,000 publications, so the results can be viewed as strong pointers to possible generalised outcomes. We show that it is possible to mine ISI databases for references to a comprehensive oeuvre of items from whole institutions. Many types of publications are visible in the ISI data - books, book chapters, journals not indexed by ISI, and some conference publications. When applied to the assessment of university departments, they can have a significant effect on rankings, though this does not follow in all cases. The investment of time, effort, and money in a significantly extended analysis will not be equally beneficial in all fields. However, a considerable amount of testing is required to confirm our initial results.

[1]  Wolfgang Glänzel,et al.  A bibliometric approach to social sciences. National research performances in 6 selected social science areas, 1990–1992 , 2005, Scientometrics.

[2]  Thed N. van Leeuwen,et al.  New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications , 1995, Scientometrics.

[3]  T. V. Leeuwen,et al.  Assessment of the scientific basis of interdisciplinary, applied research: Application of bibliometric methods in Nutrition and Food Research , 2002 .

[4]  van Raan,et al.  Assessment of social sciences: The use of advanced bibliometric methods as a necessary complement of peer review , 1998 .

[5]  J. C. Korevaar,et al.  Validation of bibliometric indicators in the field of mathematics , 1996, Scientometrics.

[6]  L. Butler,et al.  Institutions and the map of science: matching university departments and fields of research , 1998 .

[7]  Diana Hicks,et al.  The difficulty of achieving full coverage of international social science literature and the bibliometric consequences , 1999, Scientometrics.

[8]  Blaise Cronin,et al.  Comparative citation rankings of authors in monographic and journal literature: a study of sociology , 1997, J. Documentation.

[9]  Wolfgang Glänzel,et al.  A Bibliometric Study of Reference Literature in the Sciences and Social Sciences , 1999, Inf. Process. Manag..

[10]  C. le Pair,et al.  THE CITATION GAP OF APPLICABLE SCIENCE , 1988 .