Policy-relevant Webometrics for individual scientific fields

Despite over 10 years of research there is no agreement on the most suitable roles for Webometric indicators in support of research policy and almost no field-based Webometrics. This article partly fills these gaps by analyzing the potential of policy-relevant Webometrics for individual scientific fields with the help of 4 case studies. Although Webometrics cannot provide robust indicators of knowledge flows or research impact, it can provide some evidence of networking and mutual awareness. The scope of Webometrics is also relatively wide, including not only research organizations and firms but also intermediary groups like professional associations, Web portals, and government agencies. Webometrics can, therefore, provide evidence about the research process to compliment peer review, bibliometric, and patent indicators: tracking the early, mainly prepublication development of new fields and research funding initiatives, assessing the role and impact of intermediary organizations and the need for new ones, and monitoring the extent of mutual awareness in particular research areas.

[1]  Liwen Vaughan,et al.  Relationship between links to journal Web sites and impact factors , 2002, Aslib Proc..

[2]  Mike Thelwall,et al.  A web crawler design for data mining , 2001, J. Inf. Sci..

[3]  P. Patel,et al.  University-industry research collaborations in the UK: Bibliometric trends , 2003 .

[4]  Judit Bar-Ilan,et al.  Search engine results over time-a case study on search engine stability , 1998 .

[5]  Mike Thelwall,et al.  Which factors explain the Web impact of scientists' personal homepages? , 2007 .

[6]  M. Nentwich.  Cyberscience: Research in the Age of the Internet , 2003 .

[7]  U. Matzat.  Social Networks and Cooperation in Electronic Communities: A Theoretical-Empirical Analysis of Academic Communication and Internet Discussion Groups , 2006 .

[8]  Mike Thelwall,et al.  Local government web sites in Finland: A geographic and webometric analysis , 2009, Scientometrics.

[9]  Mike Thelwall,et al.  Motivations for URL citations to open access library and information science articles , 2006, Scientometrics.

[10]  Mike Thelwall,et al.  Motivations for academic web site interlinking: evidence for the Web as a novel source of information on informal scholarly communication , 2003, J. Inf. Sci..

[11]  Peter Ingwersen,et al.  The calculation of web impact factors , 1998, J. Documentation.

[12]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[13]  Mike Thelwall,et al.  UK academic web links and collaboration - an exploratory study , 2007, J. Inf. Sci..

[14]  Peter Ingwersen,et al.  Perspective of webometrics , 2004, Scientometrics.

[15]  Mike Thelwall,et al.  Extracting macroscopic information from Web links , 2001, J. Assoc. Inf. Sci. Technol..

[16]  Ronald Rousseau,et al.  Social network analysis: a powerful strategy, also for the information sciences , 2002, J. Inf. Sci..

[17]  Vivian Cothey,et al.  Web-crawling reliability , 2004, J. Assoc. Inf. Sci. Technol..

[18]  X. Polanco,et al.  Using a compound approach based on elaborated neural network for Webometrics: An example issued from the EICSTES project , 2004, Scientometrics.

[19]  Eliezer Geisler.  The Metrics of Science and Technology , 2000 .

[20]  Debora Shaw,et al.  Web citation data for impact assessment: A comparison of four science disciplines , 2005, J. Assoc. Inf. Sci. Technol..

[21]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[22]  Gaston Heimeriks,et al.  Mapping communication and collaboration in heterogeneous research networks , 2003, Scientometrics.

[23]  Rna Rudi Bekkers,et al.  Analysing knowledge transfer channels between universities and industry: To what degree do sectors also matter? , 2008 .

[24]  Tony Becher.  Academic Tribes And Territories , 1989 .

[25]  Ronald Rousseau,et al.  Web-to-print citations and the humanities , 2006 .

[26]  Debora Shaw,et al.  Bibliographic and Web citations: What is the difference? , 2003, J. Assoc. Inf. Sci. Technol..

[27]  Fletcher T. H. Cole,et al.  Libcitations: A measure for comparative assessment of book publications in the humanities and social sciences , 2009 .

[28]  Debora Shaw.  Playing the Links: Interactivity and Stickiness in .Com and "Not.Com" Web Sites , 2001, First Monday.

[29]  Katherine W. McCain,et al.  Visualizing a discipline: an author co-citation analysis of information science, 1972–1995 , 1998 .

[30]  Judit Bar-Ilan,et al.  Data collection methods on the Web for infometric purposes — A review and analysis , 2004, Scientometrics.

[31]  Liwen Vaughan,et al.  Exploring website features for business information , 2004, Scientometrics.

[32]  Fabrice Rossi,et al.  Visualization methods for metric studies , 2006 .

[33]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[34]  Mike Thelwall,et al.  Conceptualizing documentation on the Web: An evaluation of different heuristic-based models for counting links between university Web sites , 2002, J. Assoc. Inf. Sci. Technol..

[35]  E. Garfield.  Journal impact factor: a brief review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[36]  Rob Kling,et al.  Not just a matter of time: Field differences and the shaping of electronic media in supporting scientific communication , 1999, J. Am. Soc. Inf. Sci..

[37]  Ronald Rousseau,et al.  Daily time series of common single word searches in AltaVista and NorthernLight , 1998 .

[38]  M. Thelwall,et al.  U.S. academic departmental Web-site interlinking in the United States Disciplinary differences , 2003 .

[39]  Paul Nieuwenhuysen,et al.  Internet search engines - fluctuations in document accessibility , 2001, J. Documentation.

[40]  Judit Bar-Ilan,et al.  The use of web search engines in information science research , 2005, Annu. Rev. Inf. Sci. Technol..

[41]  Howard D. White,et al.  Author cocitation: A literature measure of intellectual structure , 1981, J. Am. Soc. Inf. Sci..

[42]  Jenny Fry,et al.  Studying the Scholarly web: How disciplinary culture shapes online representations , 2006 .

[43]  Loet Leydesdorff,et al.  The university-industry knowledge relationship: Analyzing patents and the science base of technologies , 2004, J. Assoc. Inf. Sci. Technol..

[44]  Liwen Vaughan,et al.  Visualizing linguistic and cultural differences using Web co-link data , 2006, J. Assoc. Inf. Sci. Technol..

[45]  David F. Channell.  Pasteur's Quadrant: Basic Science and Technological Innovation , 1999 .

[46]  Liwen Vaughan,et al.  Webometrics , 2005, Annu. Rev. Inf. Sci. Technol..

[47]  Mike Thelwall,et al.  Hyperlinks as a data source for science mapping , 2004, J. Inf. Sci..

[48]  Alastair Smith,et al.  A Tale of Two Web Spaces: Comparing Sites Using Web Impact Factors. , 1999 .

[49]  José Luis Ortega,et al.  Maps of the academic web in the European Higher Education Area — an exploration of visual web indicators , 2007, Scientometrics.

[50]  José Luis Ortega,et al.  Scientific research activity and communication measured with cybermetrics indicators , 2006, J. Assoc. Inf. Sci. Technol..

[51]  Peter Ingwersen,et al.  Toward a basic framework for webometrics , 2004, J. Assoc. Inf. Sci. Technol..

[52]  Gaston Heimeriks,et al.  Analyzing hyperlinks networks: The meaning of hyperlink based indicators of knowledge production , 2006 .

[53]  Michel Zitt,et al.  Co-citations and co-sitations: A cautionary view on an analogy , 2002, Scientometrics.

[54]  M. Thelwall,et al.  Google Scholar citations and Google Web-URL citations: A multi-discipline exploratory analysis , 2007 .

[55]  Uwe Matzat,et al.  Academic communication and Internet Discussion Groups: transfer of information or creation of social contacts? , 2004, Soc. Networks.

[56]  R. Whitley.  The Intellectual and Social Organization of the Sciences (Second Edition: with new introductory chapter entitled 'Science Transformed? The Changing Nature of Knowledge Production at the End of the Twentieth Century') , 1984 .

[57]  Peter Ingwersen,et al.  Informetric analyses on the world wide web: methodological approaches to 'webometrics' , 1997, J. Documentation.

[58]  Satoru Kawai,et al.  An Algorithm for Drawing General Undirected Graphs , 1989, Inf. Process. Lett..

[59]  Kevin W. Boyack,et al.  Using detailed maps of science to identify potential collaborations , 2009, Scientometrics.