An empirical investigation into strategies for guiding interactive search

One activity people engage in when using the web is estimating the likelihood that labelled links will lead to their goal. However, they must also decide whether to select one of the assessed items immediately or make further assessments. There are a number of theoretical accounts of this behaviour. The accounts differ as to whether, for example, they assume that people consider all of the items on a page prior to making a selection, or tend to make a selection immediately following an assessment of a highly relevant item. A series of experiments were conducted to discriminate between these accounts. The empirical studies demonstrated that people are in fact more strategic and sensitive to context than previous models suggest. People sometimes choose an option which appears good enough, but sometimes choose to continue checking. The decision to select an item was found to be sensitive to the relevance of labels in the immediate and distal choice set and also the number of options in the immediately available choice set. The data were used to motivate computational models of interactive search. An implication of the work presented here is that engineering models that aim to predict the time required by a typical user to search web page structure or which labelled link a user is likely to select for a given goal need to be updated so that they are sensitive to the extent to which people adapt strategy to the features of the context, such as the distractor semantics and number of distractors

[1]  Dwight P. Miller The Depth/Breadth Tradeoff in Hierarchical Computer Menus , 1981 .

[2]  B. Shneiderman Designing the User Interface (3rd Ed.) , 1998 .

[3]  Monika Henzinger,et al.  Analysis of a very large web search engine query log , 1999, SIGF.

[4]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[5]  John R. Anderson,et al.  The Adaptive Character of Thought , 1990 .

[6]  A. Luchins Mechanization in problem solving: The effect of Einstellung. , 1942 .

[7]  Gerald L. Lohse,et al.  A Comparison of Two Process Tracing Methods for Choice Tasks , 1996 .

[8]  S. Payne,et al.  Strategic use of familiarity in display-based problem solving. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[9]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[10]  Anthony J. Hornof,et al.  Link colors guide a search , 2004, CHI EA '04.

[11]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[12]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.

[13]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[14]  Aulikki Hyrskykari,et al.  101 spots, or how do users read menus? , 1998, CHI.

[15]  Peter D. Turney Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL , 2001, ECML.

[16]  Andy Cockburn,et al.  What do web users do? An empirical analysis of web use , 2001, Int. J. Hum. Comput. Stud..

[17]  Robert W. Reeder,et al.  Information scent as a driver of Web behavior graphs: results of a protocol analysis method for Web usability , 2001, CHI.

[18]  Marilyn Hughes Blackmon,et al.  Repairing usability problems identified by the cognitive walkthrough for the web , 2003, CHI '03.

[19]  Rodolfo Soto,et al.  Learning and performing by exploration: label quality measured by latent semantic analysis , 1999, CHI '99.

[20]  Erik Nilsen,et al.  PERCEPTUAL-MOTOR CONTROL IN HUMAN-COMPUTER INTERACTION , 1991, SGCH.

[21]  Paul van Schaik,et al.  The effect of spatial layout of and link colour in web pages on performance in a visual search task and an interactive search task , 2003, Int. J. Hum. Comput. Stud..

[22]  Marita Franzke Exploration and experienced performance with display-based systems , 1994 .

[23]  Abigail Sellen,et al.  How knowledge workers use the web , 2002, CHI.

[24]  Stuart K. Card,et al.  A taxonomic analysis of what world wide web activities significantly impact people's decisions and actions , 2001, CHI Extended Abstracts.

[25]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[26]  S Sheaves,et al.  Personal finance. , 1982, The Canadian dental hygienist.

[27]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[28]  Marita Franzke,et al.  Turning research into practice: characteristics of display-based interaction , 1995, CHI '95.

[29]  Wai-Tat Fu,et al.  Resolving the paradox of the active user: stable suboptimal performance in interactive tasks , 2004, Cogn. Sci..

[30]  T. Landauer Learning and Representing Verbal Meaning , 1998 .

[31]  Mark Levene,et al.  Associating search and navigation behavior through log analysis , 2005, J. Assoc. Inf. Sci. Technol..

[32]  Richard M. Young,et al.  A New Rational Framework for Modelling Exploratory Device Learning … but does it Fit with ACT-R? , 2000 .

[33]  Michael E. Lesk,et al.  Relevance assessments and retrieval system evaluation , 1968, Inf. Storage Retr..

[34]  N. Chater,et al.  Rational models of cognition , 1998 .

[35]  A. Newell Unified Theories of Cognition , 1990 .

[36]  John R. Anderson,et al.  Eye Movements Do Not Reflect Retrieval Processes , 2004, Psychological science.

[37]  Ed H. Chi,et al.  Using information scent to model user information needs and actions and the Web , 2001, CHI.

[38]  Stephen J. Payne,et al.  Adaptively distributing cognition: A decision-making perspective on human - computer interaction , 2001, Behav. Inf. Technol..

[39]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[40]  Ben Shneiderman,et al.  The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface , 1991 .

[41]  Marilyn Hughes Blackmon,et al.  Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs , 2005, CHI.

[42]  Richard M. Young,et al.  A Rational Model of the Effect of Information Scent on the Exploration of Menus , 2004, ICCM.

[43]  Dieter Gollmann,et al.  Computer Security , 1979, Lecture Notes in Computer Science.

[44]  Amanda Spink,et al.  Searching the Web: a survey of EXCITE users , 1999, Internet Res..

[45]  L. Reder,et al.  Another source of individual differences: strategy adaptivity to changing rates of success. , 2001, Journal of experimental psychology. General.

[46]  James N. MacGregor,et al.  Minimizing User Search Time in Menu Retrieval Systems , 1985 .

[47]  B. Turner Society And Culture , 2001 .

[48]  Richard M. Young Rational Analysis of Exploratory Choice , 2001 .

[49]  James N. MacGregor,et al.  Optimizing the Structure of Database Menu Indexes: A Decision Model of Menu Search , 1986 .

[50]  Ed H. Chi,et al.  The scent of a site: a system for analyzing and predicting information scent, usage, and usability of a Web site , 2000, CHI.

[51]  Wai-Tat Fu,et al.  SNIF-ACT: A Model of Information Foraging on the World Wide Web , 2003, User Modeling.

[52]  G. Jekyll Home and garden... , 1900 .

[53]  Dario D. Salvucci An integrated model of eye movements and visual encoding , 2001, Cognitive Systems Research.

[54]  John I. Kiger,et al.  The Depth/Breadth Trade-Off in the Design of Menu-Driven User Interfaces , 1984, Int. J. Man Mach. Stud..

[55]  S. H. Banks,et al.  Security policy , 1990, Comput. Secur..

[56]  Donna Auguste,et al.  Customer Service , 2001, IEEE Internet Comput..

[57]  John R. Anderson,et al.  Eye tracking the visual search of click-down menus , 1999, CHI '99.

[58]  Mark Pinsley,et al.  E‐BUSINESS STRATEGIES , 2000 .

[59]  Jens Riegelsberger,et al.  Could I have the Menu Please? An Eye Tracking Study of Design Conventions , 2004 .

[60]  Michael D. Byrne,et al.  Effects of scent and breadth on use of site-specific search on e-commerce Web sites , 2003, TCHI.

[61]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[62]  Peter Pirolli,et al.  Rational Analyses of Information Foraging on the Web , 2005, Cogn. Sci..

[63]  Avi Parush,et al.  Web navigation structures in cellular phones: the depth/breadth trade-off issue , 2004, Int. J. Hum. Comput. Stud..

[64]  Eric Horvitz,et al.  Patterns of search: analyzing and modeling Web query refinement , 1999 .

[65]  D. Bender,et al.  Vitamins and Minerals , 2003 .

[66]  Craig S. Miller,et al.  Modeling Information Navigation: Implications for Information Architecture , 2004, Hum. Comput. Interact..

[67]  Marilyn Hughes Blackmon,et al.  Cognitive walkthrough for the web , 2002, CHI.

[68]  Saul Greenberg,et al.  How people revisit web pages: empirical findings and implications for the design of history systems , 1997, Int. J. Hum. Comput. Stud..

[69]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[70]  Richard M. Young,et al.  A dual-space model of iteratively deepening exploratory learning , 1996, Int. J. Hum. Comput. Stud..

[71]  John R. Anderson,et al.  Interpretation-based processing: a unified theory of semantic sentence comprehension , 2004, Cogn. Sci..

[72]  Jakob Nielsen,et al.  Designing Web Usability: The Practice of Simplicity , 1999 .

[73]  Hans Chriostian Andersen,et al.  Fairy Tales , 2020, Not Your Penance.

[74]  Mary Czerwinski,et al.  Web page design: implications of memory, structure and scent for information retrieval , 1998, CHI.

[75]  Julie Chen,et al.  The bloodhound project: automating discovery of web usability issues using the InfoScentπ simulator , 2003, CHI '03.

[76]  John E. Laird,et al.  The soar papers : research on integrated intelligence , 1993 .

[77]  Thorsten Joachims,et al.  Eye-tracking analysis of user behavior in WWW search , 2004, SIGIR '04.

[78]  Bernard J. Jansen,et al.  A review of web searching studies and a framework for future research , 2001 .

[79]  Michael D. Byrne,et al.  The tangled Web we wove: a taskonomy of WWW use , 1999, CHI '99.

[80]  M. Clement,et al.  PREVENTION AND TREATMENT , 1944 .

[81]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[82]  John Rieman Learning strategies and exploratory behavior of interactive computer users , 1994 .

[83]  Andrew Howes,et al.  A model of the acquisition of menu knowledge by exploration , 1994, CHI '94.

[84]  Peter Pirolli,et al.  The Use of Proximal Information Scent to Forage for Distal Content on the World Wide Web , 2004 .

[85]  Stanley R. Parkinson,et al.  Computer display menus , 1983 .

[86]  Byron J. Pierce,et al.  Effects of Semantic Similarity, Omission Probability and Number of Alternatives in Computer Menu Search , 1992, Int. J. Man Mach. Stud..

[87]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[88]  Anthony J. Hornof,et al.  Cognitive Strategies for the Visual Search of Hierarchical Computer Displays , 2004, Hum. Comput. Interact..

[89]  Frank E. Ritter,et al.  Model-based evaluation of cell phone menu interaction , 2004, CHI '04.

[90]  Andrew Howes,et al.  An Instance-based Model of the Effect of Previous Choices on the Control of Interactive Search , 2002 .

[91]  John R. Anderson,et al.  History of Success and Current Context in Problem Solving Combined Influences on Operator Selection , 1996, Cognitive Psychology.

[92]  Geoffrey Whitehead,et al.  Transport and Distribution , 1985 .

[93]  H. H. Clark The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. , 1973 .

[94]  L. Reder,et al.  Bringing Together the Psychometric and Strategy Worlds: Predicting Adaptivity in a Dynamic Task , 1999 .

[95]  Wai-Tat Fu,et al.  A user-tracing architecture for modeling interaction with the world wide web , 2002, AVI '02.