Webometrics: emergent or doomed?

Introduction. For some years bibliometric studies have identified webometrics as one of the largest information science fields. Nevertheless, most published webometric research is relatively theoretical and, as a new research field, seems unlikely to survive unless it is useful in some way. In general it is very important for academics to identify hot research topics and avoid unpromising ones and so methods are needed to help this identification process. Method. This article uses citation analysis and a survey of webometricians to assess the extent to which webometrics has found applications outside of its parent discipline. Results. The results suggest that there has been a turn towards applied webometrics with several externally-financed studies being contracted. Moreover, there is a significant amount of citation of webometrics research by disciplines outside information science, including computing, communication science and health. Nevertheless, it seems that the potential user base for current webometric techniques is wider still, creating a need for awareness-raising. Conclusions. Whilst webometrics already has several claims to usefulness, there is still progress to be made.

[1]  M. Thelwall,et al.  U.S. academic departmental Web-site interlinking in the United States Disciplinary differences , 2003 .

[2]  Andreas Strotmann,et al.  Information science during the first decade of the web: An enriched author cocitation analysis , 2008, J. Assoc. Inf. Sci. Technol..

[3]  Fredrik Åström,et al.  Changes in the LIS research front: Time-sliced cocitation analyses of LIS journal articles, 1990-2004 , 2007, J. Assoc. Inf. Sci. Technol..

[4]  Judit Bar-Ilan,et al.  The use of web search engines in information science research , 2005, Annu. Rev. Inf. Sci. Technol..

[5]  Gaston Heimeriks,et al.  Mapping communication and collaboration in heterogeneous research networks , 2004, Scientometrics.

[6]  Richard A. Rogers Operating Issue Networks On The Web , 2002 .

[7]  David M. Pennock,et al.  Winners don't take all: Characterizing the competition for links on the web , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Xuemei Li National and international university departmental web site interlinking : a webometric analysis , 2005 .

[9]  F. Barjak,et al.  International collaboration, mobility and team diversity in the life sciences: impact on research performance. , 2007 .

[10]  Pavica Sheldon,et al.  The Relationship Between Unwillingness-to-Communicate and Students' Facebook Use , 2008, J. Media Psychol. Theor. Methods Appl..

[11]  Nicholas Mays,et al.  Describing the impact of health services and policy research , 2007, Journal of health services research & policy.

[12]  Ellen G. Cohn,et al.  The Impact of Research on Legal Policy: The Minneapolis Domestic Violence Experiment , 1989 .

[13]  Danah Boyd,et al.  Social network sites: definition, history, and scholarship , 2007, IEEE Engineering Management Review.

[14]  Mike Thelwall,et al.  A statistical analysis of the web presences of European life sciences research teams , 2008 .

[15]  Reidar Conradi,et al.  Impact of the research community for the field of software configuration management , 2002, Proceedings of the 24th International Conference on Software Engineering. ICSE 2002.

[16]  Philipp Mayr,et al.  An exploratory study of Google Scholar , 2007, Online Inf. Rev..

[17]  Ahmet Uyar Google stemming mechanisms , 2009 .

[18]  Tony Becher Academic Tribes And Territories , 1989 .

[19]  Rong Tang,et al.  Visualizing interdisciplinary citations to and from information and library science publications , 2004, Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004..

[20]  Alastair G. Smith Issues in "Blogmetrics" - Case Studies Using BlogPulse to Observe Trends in Weblogs , 2007 .

[21]  Debora Shaw,et al.  Bibliographic and Web citations: What is the difference? , 2003, J. Assoc. Inf. Sci. Technol..

[22]  M. Thelwall Social networks, gender, and friending: An analysis of MySpace member profiles , 2008 .

[23]  Debora Shaw,et al.  Web citation data for impact assessment: A comparison of four science disciplines , 2005, J. Assoc. Inf. Sci. Technol..

[24]  Lennart Björneborn,et al.  'Mini small worlds' of shortest link paths crossing domain boundaries in an academic Web space , 2006, Scientometrics.

[25]  Judit Bar-Ilan Search engine results over time-a case study on search engine stability , 1998 .

[26]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[27]  Peter Ingwersen,et al.  Characteristics of scientific Web publications: Preliminary data gathering and analysis , 2004, J. Assoc. Inf. Sci. Technol..

[28]  R. Rogers,et al.  Information politics on the Web , 2004 .

[29]  Justin W. Patchin,et al.  Personal information of adolescents on the Internet: A quantitative content analysis of MySpace. , 2008, Journal of adolescence.

[30]  Mike Thelwall,et al.  Motivations for URL citations to open access library and information science articles , 2006, Scientometrics.

[31]  José Luis Ortega,et al.  Maps of the academic web in the European Higher Education Area — an exploration of visual web indicators , 2007, Scientometrics.

[32]  Judit Bar-Ban,et al.  Search Engine Ability to Cope With the Changing Web , 2004 .

[33]  Peter Ingwersen,et al.  The calculation of web impact factors , 1998, J. Documentation.

[34]  Albert-László Barabási,et al.  Linked: The New Science of Networks , 2002 .

[35]  Alastair Smith,et al.  A Tale of Two Web Spaces: Comparing Sites Using Web Impact Factors. , 1999 .

[36]  N. Mays,et al.  Describing the impact of health research: a Research Impact Framework , 2006, BMC Health Services Research.

[37]  Ronald Rousseau,et al.  Daily time series of common single word searches in AltaVista and NorthernLight , 1998 .

[38]  Mike Thelwall,et al.  Interpreting social science link analysis research: A theoretical framework , 2006, J. Assoc. Inf. Sci. Technol..

[39]  José Luis Ortega,et al.  Mapping world-class universities on the web , 2009, Inf. Process. Manag..

[40]  Judit Bar-Ilan,et al.  Data collection methods on the Web for infometric purposes — A review and analysis , 2004, Scientometrics.

[41]  Liwen Vaughan,et al.  Exploring website features for business information , 2004, Scientometrics.

[42]  Mike Thelwall,et al.  Which types of news story attract bloggers? , 2007, Information Research.

[43]  Mike Thelwall,et al.  Web intelligence analyses of digital libraries: A case study of the National electronic Library for Health (NeLH) , 2007, J. Documentation.

[44]  D. E. Stokes Pasteur's Quadrant: Basic Science and Technological Innovation , 1997 .

[45]  Sourav S. Bhowmick,et al.  A survey of Web metrics , 2002, CSUR.

[46]  N. Charness The impact of chess research on cognitive science , 1992 .

[47]  Kathrin Kissau,et al.  Political Online-Participation of Migrants in Germany , 2008 .

[48]  Liwen Vaughan,et al.  Links to commercial websites as a source of business information , 2004, Scientometrics.

[49]  R. Ackland Social Network Services as Data Sources and Platforms for e-Researching Social Networks , 2009 .

[50]  R. Whitley The Intellectual and Social Organization of the Sciences (Second Edition: with new introductory chapter entitled 'Science Transformed? The Changing Nature of Knowledge Production at the End of the Twentieth Century') , 1984 .

[51]  Peter Ingwersen,et al.  Informetric analyses on the world wide web: methodological approaches to 'webometrics' , 1997, J. Documentation.

[52]  Junping Qiu,et al.  An analysis of backlink counts and Web Impact Factorsfor Chinese university websites , 2004, Scientometrics.

[53]  Mike Thelwall,et al.  Search engine coverage bias: evidence and possible causes , 2004, Inf. Process. Manag..

[54]  LeydesdorffLoet,et al.  The self-organization of the European information society , 2001 .

[55]  R. Rousseau Sitations: an exploratory study , 1997 .

[56]  John Lavis,et al.  Measuring the impact of health research , 2003, Journal of health services research & policy.

[57]  Mike Thelwall,et al.  An initial exploration of the link relationship between UK university Web sites , 2002, Aslib Proc..

[58]  Mike Thelwall,et al.  Introduction to Webometrics: Quantitative Web Research for the Social Sciences , 2009, Introduction to Webometrics.

[59]  Jenny Fry Studying the Scholarly web: How disciplinary culture shapes online representations , 2006 .

[60]  Ahmet Uyar,et al.  Investigation of the accuracy of search engine hit counts , 2009, J. Inf. Sci..

[61]  Paul Nieuwenhuysen,et al.  Internet search engines - fluctuations in document accessibility , 2001, J. Documentation.

[62]  Marc Najork,et al.  A large‐scale study of the evolution of Web pages , 2004, Softw. Pract. Exp..

[63]  John E. Brandl,et al.  Pasteur's Quadrant: Basic science and technological innovation , 1998 .

[64]  Wallace Koehler,et al.  Web page change and persistence - A four-year longitudinal study , 2002, J. Assoc. Inf. Sci. Technol..

[65]  Reidar Conradi,et al.  Impact of the research community on the field of software configuration management: summary of an impact project report , 2002, SOEN.

[66]  M. Thelwall,et al.  Google Scholar citations and Google Web-URL citations: A multi-discipline exploratory analysis , 2007 .

[67]  José Luis Ortega,et al.  Scientific research activity and communication measured with cybermetrics indicators , 2006, J. Assoc. Inf. Sci. Technol..

[68]  Peter Ingwersen,et al.  Toward a basic framework for webometrics , 2004, J. Assoc. Inf. Sci. Technol..