Training for Web search: Will it get you in shape?

Given that time is money, Web searching can be a very expensive proposition. Even with the best search technology, the usefulness of search results depends on the searcher's ability to use that technology effectively. In an effort to improve this ability, our research investigates the effects of logic training, interface training, and the type of search interface on the search process. In a study with 145 participants, we found that even limited training in basic Boolean logic improved performance with a simple search interface. Surprisingly, for users of an interface that assisted them in forming syntactically correct Boolean queries, performance was negatively affected by logic training and unaffected by interface training. Use of the assisted interface itself, however, resulted in strong improvements in performance over use of the simple interface. In addition to being useful for search engine providers, these findings are important for all companies that rely heavily on search for critical aspects of their operations, in that they demonstrate simple means by which the search experience can be improved for their employees and customers.

[1]  Howard R. Turtle Natural language vs. Boolean query evaluation: a comparison of retrieval performance , 1994, SIGIR '94.

[2]  Christine L. Borgman,et al.  Why are Online Catalogs Hard to Use? Lessons Learned from Information=Retrieval Studies , 1986 .

[3]  Amanda Spink,et al.  From E-Sex to E-Commerce: Web Search Changes , 2002, Computer.

[4]  Detlef Kroemker Proceedings of the Third International World-Wide Web Conference, 10-14 April, 1995, Darmstadt, Germany , 1995 .

[5]  Christoph Hölscher,et al.  Web search behavior of Internet experts and newbies , 2000, Comput. Networks.

[6]  Bernard C. Y. Tan,et al.  Three important determinants of user performance for database retrieval , 1999, Int. J. Hum. Comput. Stud..

[7]  Christine L. Borgman,et al.  Why are online catalogs hard to use? Lessons learned from information-retrieval studies , 1986, J. Am. Soc. Inf. Sci..

[8]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[9]  Peter G. Anick,et al.  A direct manipulation interface for boolean information retrieval via natural language query , 1989, SIGIR '90.

[10]  Annabel Pollock,et al.  What''s Wrong with Internet Searching , 1997 .

[11]  Amanda Spink,et al.  Searching the Web: the public and their queries , 2001 .

[12]  Trudi Bellardo An investigation of online searcher traits and their relationship to search outcome , 1985, J. Am. Soc. Inf. Sci..

[13]  Alistair Sutcliffe,et al.  Empirical studies of end-user information searching , 2000 .

[14]  Donna K. Harman,et al.  Relevance feedback revisited , 1992, SIGIR '92.

[15]  Ben Shneiderman,et al.  A Graphical Filter/Flow Representation of Boolean Queries: A Prototype Implementation and Evaluation , 1993, J. Am. Soc. Inf. Sci..

[16]  Peter Bruza,et al.  Web searching: A process-oriented experimental study of three interactive search paradigms , 2002, J. Assoc. Inf. Sci. Technol..

[17]  Stefano Mizzaro,et al.  Strategic help in user interfaces for information retrieval , 2002, J. Assoc. Inf. Sci. Technol..

[18]  Andrew Turpin,et al.  Challenging conventional assumptions of automated information retrieval with real users: Boolean searching and batch retrieval evaluations , 2001, Inf. Process. Manag..

[19]  Bryce Allen,et al.  Cognitive and task influences on Web searching behavior , 2002, J. Assoc. Inf. Sci. Technol..

[20]  Bryce Allen Individual differences and the conundrums of user-centered design: Two experiments , 2000, J. Am. Soc. Inf. Sci..

[21]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[22]  Wendy T. Lucas Search engines, relevancy, and the World Wide Web , 2001 .

[23]  Bernard J. Jansen,et al.  The effect of query complexity on Web searching results , 2000, Inf. Res..

[24]  Bryce Allen Individual differences and the conundrums of user-centered design: two experiments , 2000 .

[25]  Oren Etzioni,et al.  Scaling question answering to the Web , 2001, WWW '01.

[26]  Wendy T. Lucas,et al.  Form and function: The impact of query term and operator usage on Web search results , 2002, J. Assoc. Inf. Sci. Technol..

[27]  Monika Henzinger,et al.  Analysis of a very large web search engine query log , 1999, SIGF.

[28]  David Miller,et al.  The role of individual differences in Internet searching: An empirical study , 2001, J. Assoc. Inf. Sci. Technol..

[29]  Vivian Cothey,et al.  A longitudinal study of World Wide Web users' information-searching behavior , 2002, J. Assoc. Inf. Sci. Technol..

[30]  James Allan,et al.  Automatic Query Expansion Using SMART: TREC 3 , 1994, TREC.

[31]  Edward A. Fox,et al.  Searching the World-Wide Web: Implications From Studying Different User Behavior , 1998, World Conference on the WWW and Internet.

[32]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[33]  Ehud Rivlin,et al.  Placing search in context: the concept revisited , 2002, TOIS.

[34]  Eugene V. Stakhiv,et al.  Empirical Studies , 2004, Administration and Policy in Mental Health and Mental Health Services Research.

[35]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[36]  Wendy T. Lucas,et al.  Searching the Web: operator assistance required , 2005, Inf. Process. Manag..