A review of Web searching studies and a framework for future research

Research on Web searching is at an incipient stage. This aspect provides a unique opportunity to review the current state of research in the field, identify common trends, develop a methodological framework, and define terminology for future Web searching studies. In this article, the results from published studies of Web searching are reviewed to present the current state of research. The analysis of the limited Web searching studies available indicates that research methods and terminology are already diverging. A framework is proposed for future studies that will facilitate comparison of results. The advantages of such a framework are presented, and the implications for the design of Web information retrieval systems studies are discussed. Additionally, the searching characteristics of Web users are compared and contrasted with users of traditional information retrieval and online public access systems to discover if there is a need for more studies that focus predominantly or exclusively on Web searching. The comparison indicates that Web searching differs from searching in other environments.

[1]  Nicholas J. Belkin,et al.  A case for interaction: a study of interactive information retrieval behavior and effectiveness , 1996, CHI.

[2]  Donna K. Harman,et al.  Overview of the Second Text REtrieval Conference (TREC-2) , 1994, HLT.

[3]  Martin Kurth,et al.  The limits and limitations of transaction log analysis , 1993 .

[4]  Neal K. Kaske.  Research methodologies and transaction log analysis: Issues, questions, and a proposed model , 1993 .

[5]  Michael D. Gordon,et al.  Finding Information on the World Wide Web: The Retrieval Effectiveness of Search Engines , 1999, Inf. Process. Manag..

[6]  Giles,et al.  Searching the world wide Web , 1998, Science.

[7]  C. Lee Giles,et al.  Accessibility of information on the web , 1999, Nature.

[8]  L HoffmanDonna,et al.  Internet and Web use in the U.S. , 1996 .

[9]  Chun Wei Choo,et al.  A behavioral model of information seeking on the web: preliminary results of a study of how managers and IT specialists use the web , 1998 .

[10]  Daqing He,et al.  Detecting session boundaries from Web user logs , 2000 .

[11]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[12]  Andrei Z. Broder,et al.  A Technique for Measuring the Relative Size and Overlap of Public Web Search Engines , 1998, Comput. Networks.

[13]  Paul B. Kantor,et al.  A study of information seeking and retrieving. I. background and methodology , 1988 .

[14]  Ingrid Hsieh-Yee,et al.  Effects of Search Experience and Subject Knowledge on the Search Tactics of Novice and Experienced Searchers , 1993, J. Am. Soc. Inf. Sci..

[15]  Sally Jo Cunningham,et al.  An Analysis of Usage of a Digital Library , 1998, ECDL.

[16]  Beth Sandore,et al.  Applying the results of transaction log analysis , 1993 .

[17]  Tom Peters,et al.  When Smart People Fail: An Analysis of the Transaction Log of an Online Public Access Catalog. , 1989 .

[18]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[19]  Bernard J. Jansen,et al.  Digital video in education , 1999, SIGCSE '99.

[20]  Monika Henzinger,et al.  Analysis of a very large web search engine query log , 1999, SIGF.

[21]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[22]  Tom Peters,et al.  The history and development of transaction log analysis , 1993 .

[23]  J Allan,et al.  Readings in information retrieval. , 1998 .

[24]  Amanda Spink,et al.  The Use of Relevance Feedback on the Web: Implications for Web IR System Design , 1999, WebNet.

[25]  Dietmar Wolfram,et al.  End user searching on the Internet: An analysis of term pair topics submitted to the Excite search engine , 2000, J. Am. Soc. Inf. Sci..

[26]  Tefko Saracevic,et al.  Evaluation of evaluation in information retrieval , 1995, SIGIR '95.

[27]  Tefko Saracevic,et al.  Modeling Interaction in Information Retrieval (IR): A Review and Proposal. , 1996 .

[28]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[29]  Christine L. Borgman,et al.  Why Are Online Catalogs Still Hard to Use? , 1996, J. Am. Soc. Inf. Sci..

[30]  Amanda Spink,et al.  From Highly Relevant to Not Relevant: Examining Different Regions of Relevance , 1998, Inf. Process. Manag..

[31]  Paul B. Kantor,et al.  A study of information seeking and retrieving. I. Background and methodology , 1997, J. Am. Soc. Inf. Sci..

[32]  Christoph Hölscher.  How Internet Experts Search For Information On The Web , 1998, WebNet.

[33]  Oren Etzioni,et al.  Multi-Service Search and Comparison Using the MetaCrawler , 1995 .

[34]  Marcia J. Bates,et al.  A Profile of End-User Searching Behavior by Humanities Scholars: The Getty Online Searching Project Report No. 2 , 1993, J. Am. Soc. Inf. Sci..

[35]  Susan Brewer,et al.  Information storage and retrieval , 1959, ACM '59.

[36]  Huberman,et al.  Strong regularities in world wide web surfing , 1998, Science.

[37]  Edward A. Fox,et al.  Searching the World-Wide Web: Implications From Studying Different User Behavior , 1998, World Conference on the WWW and Internet.

[38]  Robert W. Pasicznyuk,et al.  The Internet and Reference Services: A Real-World Test of Internet Utility , 1998 .

[39]  Stephen E. Robertson,et al.  On the Evaluation of IR Systems , 1992, Inf. Process. Manag..

[40]  Val G. Hemming.  Background and Methodology , 2002 .

[41]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part I. Background and Theory , 1997, J. Documentation.

[42]  W. Bruce Croft,et al.  Providing Government Information on the Internet: Experiences with THOMAS , 1995, DL.

[43]  William D. Kalsbeek,et al.  Internet and Web use in the U.S. , 1996, CACM.

[44]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[45]  D. T. Hawkins.  Hunting, grazing, browsing : a model for online information retrieval , 1996 .

[46]  Steve Kirsch.  The future of Internet search (keynote address) , 1998, SIGIR '98.

[47]  Larry Millsap,et al.  Search Patterns of Remote Users: An Analysis of OPAC Transaction Logs. , 1993 .

[48]  Stefano Mizzaro,et al.  Relevance: The Whole History , 1997, J. Am. Soc. Inf. Sci..

[49]  Amanda Spink,et al.  Visual Information Seeking: A Study of Image Queries on the World Wide Web , 1999 .

[50]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[51]  Amanda Spink,et al.  Searching the Web: a survey of EXCITE users , 1999, Internet Res..

[52]  Patricia Te Arapo Wallace,et al.  How Do Patrons Search the Online Catalog When No One's Looking? Transaction Log Analysis and Implications for Bibliographic Instruction and Systems Design. , 1993 .