Web citation data for impact assessment: A comparison of four science disciplines

The number and type of Web citations to journal articles in four areas of science are examined: biology, genetics, medicine, and multidisciplinary sciences. For a sample of 5,972 articles published in 114 journals, the median Web citation counts per journal article range from 6.2 in medicine to 10.4 in genetics. About 30% of Web citations in each area indicate intellectual impact (citations from articles or class readings, in contrast to citations from bibliographic services or the author's or journal's home page). Journals receiving more Web citations also have higher percentages of citations indicating intellectual impact. There is significant correlation between the number of citations reported in the databases from the Institute for Scientific Information (ISI, now Thomson Scientific) and the number of citations retrieved using the Google search engine (Web citations). The correlation is much weaker for journals published outside the United Kingdom or United States and for multidisciplinary journals. Web citation numbers are higher than ISI citation counts, suggesting that Web searches might be conducted for an earlier or a more fine-grained assessment of an article's impact. The Web-evident impact of non-UK/USA publications might provide a balance to the geographic or cultural biases observed in ISI's data, although the stability of Web citation counts is debatable.

[1]  Liwen Vaughan,et al.  Relationship between links to journal Web sites and impact factors , 2002, Aslib Proc..

[2]  Mike Thelwall,et al.  Which academic subjects have most online impact? A pilot study and a new classification process , 2003, Online Inf. Rev..

[3]  Ken Hyland,et al.  Self-citation and Self-reference: Credibility and Promotion in Academic Publication , 2003, J. Assoc. Inf. Sci. Technol..

[4]  Mike Thelwall,et al.  The connection between the research of a university and counts of links to its web pages: An investigation based upon a classification of the relationships of pages to the research of the host university , 2003, J. Assoc. Inf. Sci. Technol..

[5]  A. K. Dhiman,et al.  Science Citation Index : A failure under Indian scientific environment , 2000 .

[6]  Yo.  United Nations Educational, Scientific and Cultural Organization (Unesco) and International Council of Scientific Unions (ICSU) (eds.) , "UNISIST: The Feasibility Study on a World Science Information System", Unesco, Paris, 1971., Study RepQrt, $4.00., Synopsis, gratis. , 1971 .

[7]  Leo Egghe,et al.  New informetric aspects of the Internet: some reflections - many problems , 2000, J. Inf. Sci..

[8]  K. Knorr-Cetina,et al.  Epistemic cultures : how the sciences make knowledge , 1999 .

[9]  Rob Kling,et al.  The internet and unrefereed scholarly publishing , 2005, Annu. Rev. Inf. Sci. Technol..

[10]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[11]  B. Cronin.  The Warholian moment and other proto-indicators of scholarly salience , 1999 .

[12]  W. Wayt Gibbs,et al.  Lost Science in the Third World , 1995 .

[13]  Thed N. van Leeuwen,et al.  Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance , 2001, Scientometrics.

[14]  Debora Shaw,et al.  Bibliographic and Web citations: What is the difference? , 2003, J. Assoc. Inf. Sci. Technol..

[15]  Jonathan Furner,et al.  Scholarly communication and bibliometrics , 2005, Annu. Rev. Inf. Sci. Technol..

[16]  Blaise Cronin,et al.  Invoked on the Web , 1998, J. Am. Soc. Inf. Sci..

[17]  Blaise Cronin,et al.  Bibliometrics and beyond: some thoughts on web-based citation analysis , 2001, J. Inf. Sci..

[18]  K. Hyland,et al.  Disciplinary Discourses: Social Interactions in Academic Writing , 2001 .

[19]  Liwen Vaughan,et al.  New measurements for search engine evaluation proposed and tested , 2004, Inf. Process. Manag..

[20]  Mike Thelwall,et al.  Do the Web sites of higher rated scholars have significantly more online impact? , 2004, J. Assoc. Inf. Sci. Technol..

[21]  Howard Rosenbaum,et al.  Can search engines be used as tools for web-link analysis? A critical view , 1999, J. Documentation.

[22]  Belver C. Griffith,et al.  Communication and information processing within scientific disciplines: Empirical findings for Psychology , 1972, Inf. Storage Retr..

[23]  Mike Thelwall,et al.  Scholarly Use of the Web: What Are the Key Inducers of Links to Journal Web Sites , 2003, J. Assoc. Inf. Sci. Technol..

[24]  Tomàs Baiget,et al.  Valparaíso declaration for improved scientific communication in the electronic medium , 2004 .

[25]  Judit Bar-Ilan,et al.  The use of web search engines in information science research , 2005, Annu. Rev. Inf. Sci. Technol..

[26]  Debora Shaw,et al.  Can web citations be a measure of impact? An investigation of journals in the life sciences , 2005, ASIST.

[27]  Rob Kling,et al.  Not Just a Matter of Time: Field Differences and the Shaping of Electronic Media , 1999 .

[28]  Thomas E. Nisonger,et al.  Citation Autobiography: An Investigation of ISI Database Coverage in Determining Author Citedness , 2004 .