Assessing the scholarly impact of information studies: A tale of two citation databases—Scopus and Web of Science

This study uses citations, from 1996 to 2007, to the work of 80 randomly selected full-time, information studies (IS) faculty members from North America to examine differences between Scopus and Web of Science in assessing the scholarly impact of the field focusing on the most frequently citing journals, conference proceedings, research domains and institutions, as well as all citing countries. Results show that when assessment is limited to smaller citing entities (e.g., journals, conference proceedings, institutions), the two databases produce considerably different results, whereas when assessment is limited to larger citing entities (e.g., research domains, countries), the two databases produce very similar pictures of scholarly impact. In the former case, the use of Scopus (for journals and institutions) and both Scopus and Web of Science (for conference proceedings) is necessary to more accurately assess or visualize the scholarly impact of IS, whereas in the latter case, assessing or visualizing the scholarly impact of IS is independent of the database used. © 2009 Wiley Periodicals, Inc.

[1]  H. Benamer,et al.  Arab nations lagging behind other Middle Eastern countries in biomedical research: a comparative study , 2009, BMC Medical Research Methodology.

[2]  Michael Levine-Clark,et al.  A Comparative Citation Analysis of Web of Science, Scopus, and Google Scholar , 2008 .

[3]  Kuan-Teh Jeang,et al.  H-index, mentoring-index, highly-cited and highly-accessed: how to evaluate scientists? , 2008, Retrovirology.

[4]  Henk F. Moed,et al.  Coverage and citation impact of oncological journals in the Web of Science and Scopus , 2008, J. Informetrics.

[5]  Dean Hendrix,et al.  An analysis of bibliometric indicators, National Institutes of Health funding, and faculty size at Association of American Medical Colleges medical schools, 1997-2007. , 2008, Journal of the Medical Library Association : JMLA.

[6]  Juan Gorraiz,et al.  A bibliometric analysis of pharmacology and pharmacy journals: Scopus versus Web of Science , 2008, J. Inf. Sci..

[7]  Lokman I. Meho,et al.  Citation Counting, Citation Ranking, and h-Index of Human-Computer Interaction Researchers: A Comparison between Scopus and Web of Science , 2008, ArXiv.

[8]  Lars Iselid,et al.  Web of Science and Scopus: a journal title overlap study , 2008, Online Inf. Rev..

[9]  Lokman I. Meho,et al.  The shifting balance of intellectual trade in information studies , 2008, J. Assoc. Inf. Sci. Technol..

[10]  Judit Bar-Ilan,et al.  Informetrics at the beginning of the 21st century - A review , 2008, J. Informetrics.

[11]  Loet Leydesdorff,et al.  Visualization of the citation impact environments of scientific journals: An online mapping exercise , 2009, J. Assoc. Inf. Sci. Technol..

[12]  Lokman I. Meho,et al.  Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar , 2007, J. Assoc. Inf. Sci. Technol..

[13]  Loet Leydesdorff,et al.  Environment and Planning B: Planning and Design as a Journal: The Interdisciplinarity of its Environment and the Citation Impact , 2007 .

[14]  Hsinchun Chen,et al.  Worldwide nanotechnology development: a comparative study of USPTO, EPO, and JPO patents (1976–2004) , 2007 .

[15]  Debora Shaw,et al.  Peers and Spheres of Influence: Situating Rob Kling , 2007, Inf. Soc..

[16]  Chaomei Chen,et al.  Delineating the citation impact of scientific discoveries , 2007, JCDL '07.

[17]  Thomas E. Nisonger.  Journals in the Core Collection , 2007 .

[18]  Charles Oppenheim,et al.  Comparing alternatives to the Web of Science for coverage of the social sciences' literature , 2007, J. Informetrics.

[19]  Loet Leydesdorff,et al.  Mapping interdisciplinarity at the interfaces between the Science Citation Index and the Social Science Citation Index , 2007, Scientometrics.

[20]  Lokman I. Meho.  The Rise and Rise of Citation Analysis , 2006, ArXiv.

[21]  Judit Bar-Ilan,et al.  Some measures for comparing citation databases , 2007, J. Informetrics.

[22]  Robert L. Goldstone,et al.  The Import and Export of Cognitive Science , 2006, Cogn. Sci..

[23]  Varun Grover,et al.  A Citation Analysis of the Evolution and State of Information Systems within a Constellation of Reference Disciplines , 2006, J. Assoc. Inf. Syst..

[24]  Lokman I. Meho,et al.  Ranking the research productivity of library and information science faculty and schools: An evaluation of data sources and research methods: Research Articles , 2005 .

[25]  H. Moed.  Citation Analysis in Research Evaluation (Information Science & Knowledge Management) , 2005 .

[26]  Lokman I. Meho,et al.  Ranking the research productivity of library and information science faculty and schools: An evaluation of data sources and research methods , 2005, J. Assoc. Inf. Sci. Technol..

[27]  Nisa Bakkalbasi,et al.  An Examination of Citation Counts in a New Scholarly Communication Environment , 2005, D Lib Mag..

[28]  Chengzhi Wang,et al.  Mapping interdisciplinarity in demography: a journal network analysis , 2005, J. Inf. Sci..

[29]  Abagail McWilliams,et al.  The Balance of Trade Between Disciplines , 2005 .

[30]  P. Jacsó.  As we may search : Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases , 2005 .

[31]  Rong Tang,et al.  Evolution of the interdisciplinary characteristics of information and library science , 2005, ASIST.

[32]  C. Benn,et al.  Impact of astronomical research from different countries , 2004 .

[33]  H. D. White.  Citation Analysis and Discourse Analysis Revisited. , 2004 .

[34]  T. V. Leeuwen,et al.  Assessment of the scientific basis of interdisciplinary, applied research: Application of bibliometric methods in Nutrition and Food Research , 2002 .

[35]  Ronald E. Rice,et al.  Scholarly Communication in Developmental Dyslexia: Influence of Network Structure on Change in a Hybrid Problem Area , 1998, J. Am. Soc. Inf. Sci..

[36]  E. Garfield.  From Citation Indexes to Informetrics: Is the Tail Now Wagging the Dog ? , 1998 .

[37]  C. Borgman,et al.  The convergence of information science and communication : a bibliometric analysis , 1992 .

[38]  S. Bradford.  "Sources of information on specific subjects" by S.C. Bradford , 1985 .

[39]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .