Coverage and citation impact of oncological journals in the Web of Science and Scopus

This paper reviews a number of studies comparing Thomson Scientific’s Web of Science (WoS) and Elsevier’s Scopus. It collates their journal coverage in an important medical subfield: oncology. It is found that all WoS-covered oncological journals (n=126) are indexed in Scopus, but that Scopus covers many more journals (an additional n=106). However, the latter group tends to have much lower impact factors than WoS covered journals. Among the top 25% of sources with the highest impact factors in Scopus, 94% is indexed in the WoS, and for the bottom 25% only 6%. In short, in oncology the WoS is a genuine subset of Scopus, and tends to cover the best journals from it in terms of citation impact per paper. Although Scopus covers 90% more oncological journals compared to WoS, the average Scopus-based impact factor for journals indexed by both databases is only 2.6% higher than that based on WoS data. Results reflect fundamental differences in coverage policies: the WoS based on Eugene Garfield’s concepts of covering a selective set of most frequently used (cited) journals; Scopus with broad coverage, more similar to large disciplinary literature databases. The paper also found that ‘classical’, WoS-based impact factors strongly correlate with a new, Scopus-based metric, SCImago Journal Rank (SJR), one of a series of new indicators founded on earlier work by Pinski and Narin [Pinski, G., & Narin F. (1976). Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Information Processing and Management, 12, 297–312] that weight citations according to the prestige of the citing journal (Spearman’s rho=0.93). Four lines of future research are proposed.

[1]  Charles Oppenheim,et al.  Comparing alternatives to the Web of Science for coverage of the social sciences' literature , 2007, J. Informetrics.

[2]  P. Jacsó As we may search : Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases , 2005 .

[3]  Lluís Codina Bonilla,et al.  Scopus: el mayor navegador científico de la web , 2005 .

[4]  S. Fingerman,et al.  Web of Science and Scopus: Current features and Capabilities. , 2006, Issues in Science and Technology Librarianship.

[5]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[6]  S. Fingerman,et al.  SCOPUS: Profusion and confusion , 2005 .

[7]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[8]  Zaida Chinchilla-Rodríguez,et al.  Coverage analysis of Scopus: A journal metric approach , 2007, Scientometrics.

[9]  Henk F. Moed,et al.  Handbook of Quantitative Science and Technology Research , 2005 .

[10]  Judit Bar-Ilan,et al.  Which h-index? — A comparison of WoS, Scopus and Google Scholar , 2008, Scientometrics.

[11]  Michael H. MacRoberts,et al.  Problems of citation analysis , 1996, Scientometrics.

[12]  Péter Jacsó,et al.  Evaluation of citation enhanced scholarly databases , 2006 .

[13]  Nisa Bakkalbasi,et al.  An Examination of Citation Counts in a New Scholarly Communication Environment , 2005, D Lib Mag..

[14]  E. Garfield Citation indexes for science. A new dimension in documentation through association of ideas. 1955. , 1955, International journal of epidemiology.

[15]  Rafael Ball,et al.  Science indicators revisited - Science Citation Index versus SCOPUS: A bibliometric comparison of both citation databases , 2007, Inf. Serv. Use.

[16]  B. Martin,et al.  Some partial indicators of scientific progress in radio astronomy , 1983 .

[17]  Hans-Dieter Daniel,et al.  Data sources for performing citation analysis: an overview , 2008, J. Documentation.

[18]  Koenraad Debackere,et al.  Using a bibliometric approach to support research policy making: The case of the Flemish BOF-key , 2004, Scientometrics.

[19]  Judit Bar-Ilan,et al.  Some measures for comparing citation databases , 2007, J. Informetrics.

[20]  J. Burnham Scopus database: a review , 2006, Biomedical digital libraries.

[21]  Henk F. Moed,et al.  Handbook of Quantitative Science and Technology Research: The Use of Publication and Patent Statistics in Studies of S&T Systems , 2004 .

[22]  Carmen López-Illescas,et al.  The actual citation impact of European oncological research. , 2008, European journal of cancer.

[23]  Michel Zitt,et al.  Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation , 2005, Scientometrics.

[24]  Oscar Volij,et al.  The Measurement of Intellectual Influence , 2002 .

[25]  Carl T. Bergstrom Eigenfactor Measuring the value and prestige of scholarly journals , 2007 .

[26]  Eugene Garfield,et al.  Citation indexing - its theory and application in science, technology, and humanities , 1979 .

[27]  Wolfgang Glänzel,et al.  The newest version of the facts and figures on publication output and relative citation impact of 100 countries 1981–1985 , 2005, Scientometrics.

[28]  Johan Bollen,et al.  Journal status , 2006, Scientometrics.

[29]  Joshua Lederberg,et al.  [Introduction to "Toward A Metric of Science: The Advent of Science Indicators"] , 1979 .

[30]  S. Bloch,et al.  Counting on citations: a flawed way to measure quality , 2003, The Medical journal of Australia.

[31]  Ronald Fagin,et al.  Comparing top k lists , 2003, SODA '03.

[32]  T. V. Leeuwen,et al.  Impact factors can mislead , 1996, Nature.

[33]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[34]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[35]  Julianne Cheek,et al.  What's in a Number? Issues in Providing Evidence of Impact and Quality of Research(ers) , 2006, Qualitative health research.

[36]  Lei Wang,et al.  Three options for citation tracking: Google Scholar, Scopus and Web of Science , 2006, Biomedical digital libraries.