From Keyword Search to Exploration: How Result Visualization Aids Discovery on the Web

A key to the Web's success is the power of search. The elegant way in which search results are returned is usually remarkably effective. However, for exploratory search in which users need to learn, discover, and understand novel or complex topics, there is substantial room for improvement. Human computer interaction researchers and web browser designers have developed novel strategies to improve Web search by enabling users to conveniently visualize, manipulate, and organize their Web search results. This monograph offers fresh ways to think about search-related cognitive processes and describes innovative design approaches to browsers and related tools. For instance, while key word search presents users with results for specific information (e.g., what is the capitol of Peru), other methods may let users see and explore the contexts of their requests for information (related or previous work, conflicting information), or the properties that associate groups of information assets (group legal decisions by lead attorney). We also consider the both traditional and novel ways in which these strategies have been evaluated. From our review of cognitive processes, browser design, and evaluations, we reflect on the future opportunities and new paradigms for exploring and interacting with Web search results.

[1]  Yike Guo,et al.  New paradigms in information visualization. , 2000, SIGIR 2000.

[2]  Carol Collier Kuhlthau.  Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[3]  Gary Marchionini,et al.  Effects of structure and interaction style on distinct search tasks , 2007, JCDL '07.

[4]  Susan T. Dumais,et al.  Exploring personal information , 2006, Commun. ACM.

[5]  Steffen Staab,et al.  Semantic Annotation of Images and Videos for Multimedia Analysis , 2005, ESWC.

[6]  Stuart K. Card,et al.  Information foraging in information access environments , 1995, CHI '95.

[7]  Sherry Koshman.  Testing user interaction with a prototype visualization-based information retrieval system , 2005, J. Assoc. Inf. Sci. Technol..

[8]  Susan T. Dumais,et al.  Optimizing search by showing results in context , 2001, CHI.

[9]  Andy Cockburn,et al.  Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments , 2002, CHI.

[10]  Robert S. Taylor.  The process of asking questions , 1962 .

[11]  Ben Shneiderman,et al.  Categorizing web search results into meaningful and stable categories using fast-feature techniques , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[12]  Andrew M. Webb,et al.  combinFormation: a mixed-initiative system for representing collections as compositions of image and text surrogates , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[13]  Preben Hansen,et al.  Conceptual framework for tasks in information studies: Book Reviews , 2005 .

[14]  Mark E. Rorvig,et al.  Introduction and Overview: Visualization, Retrieval, and Knowledge. , 1999 .

[15]  Ben Shneiderman,et al.  Visualizing digital library search results with categorical and hierarchical axes , 2000, DL '00.

[16]  Bryce Allen.  Information space representation in interactive systems: relationship to spatial abilities , 1998, DL '98.

[17]  Andy Cockburn,et al.  An Evaluation of Cone Trees , 2000, BCS HCI.

[18]  Mary Czerwinski,et al.  An initial examination of ease of use for 2D and 3D information visualizations of web content , 2000, Int. J. Hum. Comput. Stud..

[19]  Ryen W. White,et al.  Evaluating advanced search interfaces using established information-seeking models , 2009, J. Assoc. Inf. Sci. Technol..

[20]  Max L. Wilson,et al.  Spatial Consistency and Contextual Cues for Incidental Learning in Browser Design , 2007 .

[21]  Benjamin B. Bederson,et al.  A Study of Search Result Clustering Interfaces : Comparing Textual and Zoomable User Interfaces , 2003 .

[22]  David R. Millen,et al.  Dogear: Social bookmarking in the enterprise , 2006, CHI.

[23]  Allison Woodruff,et al.  Using thumbnails to search the Web , 2001, CHI.

[24]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[25]  Harris Wu,et al.  Harvesting social knowledge from folksonomies , 2006, HYPERTEXT '06.

[26]  Amanda Spink,et al.  Toward a Theoretical Framework for Information Retrieval (IR) Evaluation in an Information Seeking Context , 1999, MIRA.

[27]  Marc M. Sebrechts,et al.  Visualization of search results: a comparative evaluation of text, 2D, and 3D interfaces , 1999, SIGIR '99.

[28]  Mika Käki,et al.  Controlling the complexity in comparing search user interfaces via user studies , 2008, Information Processing & Management.

[29]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[30]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[31]  Mary Czerwinski,et al.  Data mountain: using spatial memory for document management , 1998, UIST '98.

[32]  Hsinchun Chen,et al.  Internet Browsing and Searching: User Evaluations of Category Map and Concept Space Techniques , 1998, J. Am. Soc. Inf. Sci..

[33]  Kiduk Yang,et al.  Information retrieval on the web , 2006, Annu. Rev. Inf. Sci. Technol..

[34]  Susan T. Dumais,et al.  WaveLens: a new view onto Internet search results , 2004, CHI.

[35]  R. Manmatha,et al.  Automatic image annotation and retrieval using cross-media relevance models , 2003, SIGIR.

[36]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[37]  Martin Ebner,et al.  Interaction and Usability of Simulations & Animations: A Case Study of the Flash Technology , 2003, INTERACT.

[38]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[39]  Gary Marchionini,et al.  Finding facts vs. browsing knowledge in hypertext systems , 1988, Computer.

[40]  Mark E. Rorvig,et al.  Introduction and Overview: Visualization, Retrieval, and Knowledge , 1999, J. Am. Soc. Inf. Sci..

[41]  Marcia J. Bates,et al.  Separating the knowledge layers: Cognitive analysis of search knowledge through hierarchical goal decompositions , 2005, ASIST.

[42]  Daniel L. Sherrell,et al.  Communications of the Association for Information Systems , 1999 .

[43]  Frank Keller,et al.  Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics: HLT-NAACL 2004 , 2004, HLT-NAACL 2004.

[44]  Marti A. Hearst,et al.  Cha-Cha: A System for Organizing Intranet Search Results , 1999, USENIX Symposium on Internet Technologies and Systems.

[45]  Ying Feng,et al.  Collaborative visual interfaces to digital libraries , 2002, JCDL '02.

[46]  David E. Kieras,et al.  A validation of the GOMS model methodology in the development of a specialized, commercial software application , 1994, CHI '94.

[47]  D. Scott McCrickard,et al.  Visualizing Search Results using SQWID , 1997 .

[48]  Pertti Vakkari,et al.  Cognition and changes of search terms and tactics during task performance: A longitudinal case study , 2000, RIAO.

[49]  Marti A. Hearst,et al.  Finding the flow in web site search , 2002, CACM.

[50]  Wanda Pratt.  Dynamic organization of search results using the UMLS , 1997, AMIA.

[51]  Gary Marchionini,et al.  Evaluation and evolution of a browse and search interface: relation browser , 2005, DG.O.

[52]  Andreas Hotho,et al.  Information Retrieval in Folksonomies: Search and Ranking , 2006, ESWC.

[53]  Nicholas J. Belkin,et al.  Braque: Design of an Interface to Support User Interaction in Information Retrieval , 1993, Inf. Process. Manag..

[54]  George W. Furnas,et al.  Considerations for information environments and the NaviQue workspace , 1998, DL '98.

[55]  Louis M. Gomez,et al.  Formative design evaluation of superbook , 1989, TOIS.

[56]  Chaomei Chen,et al.  CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature , 2006, J. Assoc. Inf. Sci. Technol..

[57]  Barbara M. Wildemuth,et al.  The effects of domain knowledge on search tactic formulation , 2004, J. Assoc. Inf. Sci. Technol..

[58]  Marcia J. Bates,et al.  Idea tactics , 1980, IEEE Transactions on Professional Communication.

[59]  Carol Collier Kuhlthau,et al.  Inside the search process: Information seeking from the user's perspective , 1991, J. Am. Soc. Inf. Sci..

[60]  Ramesh Sharda,et al.  Clustering-Based Visual Interfaces for Presentation of Web Search Results: An Empirical Investigation , 2005, Inf. Syst. Frontiers.

[61]  Marcia J. Bates,et al.  Where should the person stop and the information search interface start? , 1990, Inf. Process. Manag..

[62]  Marcia J. Bates,et al.  Information search tactics , 1979, J. Am. Soc. Inf. Sci..

[63]  Max L. Wilson,et al.  Preview Cues: Enhancing Access to Multimedia Content , 2004 .

[64]  David Elsweiler,et al.  Towards task-based personal information management evaluations , 2007, SIGIR.

[65]  Katy Borner,et al.  Visible threads: a smart VR interface to digital libraries , 2000, Electronic Imaging.

[66]  Amanda Spink,et al.  A user-centered approach to evaluating human interaction with Web search engines: an exploratory study , 2002, Inf. Process. Manag..

[67]  Deborah Hix,et al.  An empirical evaluation of user interfaces for topic management of Web sites , 1999, CHI '99.

[68]  Preben Hansen,et al.  Work tasks as units for analysis in information seeking and retrieval studies , 2002 .

[69]  Bob J. Wielinga,et al.  The added value of task and ontology-based markup for information retrieval , 2004, J. Assoc. Inf. Sci. Technol..

[70]  Elena García Barriocanal,et al.  User Interface Tactics in Ontology-Based Information Seeking , 2003, PsychNology J..

[71]  Lois Delcambre,et al.  Proceedings of the 2005 National Conference on Digital Government Research, DG.O 2005, Atlanta, Georgia, USA, May 15-18, 2005 , 2005, DG.O.

[72]  Manuel A. Pérez-Quiñones,et al.  Enhancing usability in CITIDEL: multimodal, multilingual, and interactive visualization interfaces , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[73]  Ben Shneiderman,et al.  Supporting exploratory web search with meaningful and stable categorized overviews , 2006 .

[74]  Catherine C. Marshall,et al.  Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries , 2003 .

[75]  Shady Elbassuoni.  Adaptive Personalization of Web Search , 2008 .

[76]  Ben Shneiderman,et al.  Network Visualization by Semantic Substrates , 2006, IEEE Transactions on Visualization and Computer Graphics.

[77]  Yvonne Rogers,et al.  Cognitive strategies in web searching. , 1999 .

[78]  Connor Graham,et al.  Proceedings of OzCHI 2003 , 2003 .

[79]  Ben Shneiderman,et al.  Exploring personal media: A spatial interface supporting user-defined semantic regions , 2006, J. Vis. Lang. Comput..

[80]  Tomek Strzalkowski.  Natural Language Information Retrieval , 1995, Inf. Process. Manag..

[81]  John Stasko,et al.  BEST PAPER: A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations , 2004 .

[82]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[83]  Francis Aguilar,et al.  General Managers in Action , 1987 .

[84]  Ian Taylor,et al.  Three dimensional visualization of the World Wide Web , 1999, CSUR.

[85]  Peiling Wang,et al.  Mining longitudinal web queries: Trends and patterns , 2003, J. Assoc. Inf. Sci. Technol..

[86]  Guoray Cai.  GeoVIBE: A Visual Interface for Geographic Digital Libraries , 2002, Visual Interfaces to Digital Libraries.

[87]  Simone Santini,et al.  Beyond query by example , 1998, MULTIMEDIA '98.

[88]  Raya Fidel,et al.  Moves in online searching , 1985 .

[89]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[90]  G. Marchionini,et al.  Machine learning for information architecture in a large governmental Web site , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[91]  Mary Czerwinski,et al.  Polyarchy visualization: visualizing multiple intersecting hierarchies , 2002, CHI.

[92]  Mark Chignell,et al.  Hierarchical data visualization in desktop virtual reality , 2000 .

[93]  John Allsop,et al.  Microformats: Empowering Your Markup for Web 2.0 , 2007 .

[94]  Alistair G. Sutcliffe,et al.  Authoring animated Web pages using “contact points” , 1999, CHI '99.

[95]  Russell Beale,et al.  Visualising sequences of queries: a new tool for information retrieval , 1997, Proceedings. 1997 IEEE Conference on Information Visualization (Cat. No.97TB100165).

[96]  Max L. Wilson,et al.  Bridging the Gap: Using IR Models for Evaluating Exploratory Search Interfaces , 2007 .

[97]  Susan T. Dumais,et al.  Bringing order to the Web: automatically categorizing search results , 2000, CHI.

[98]  B. Dervin,et al.  Information needs and uses. , 1986 .

[99]  Jock D. Mackinlay,et al.  Cone Trees: animated 3D visualizations of hierarchical information , 1991, CHI.

[100]  Offer Drori,et al.  Using Documents Classification for Displaying Search Results List , 2002 .

[101]  Peter J. Nürnberg,et al.  Proceedings of the seventeenth conference on Hypertext and hypermedia , 2006 .

[102]  Xue Dong Yang,et al.  The Visual Exploration ofWeb Search Results Using HotMap , 2006, Tenth International Conference on Information Visualisation (IV'06).

[103]  Max L. Wilson,et al.  A Validated Framework for Measuring Interface Support for Interactive Information Seeking , 2008 .

[104]  Koichi Takeda,et al.  Information retrieval on the web , 2000, CSUR.

[105]  Gene Golovchinsky,et al.  Queries? Links? Is there a difference? , 1997, CHI.

[106]  Hsinchun Chen,et al.  Internet Browsing and Searching: User Evaluations of Category Map and Concept Space Techniques , 1998, J. Am. Soc. Inf. Sci..

[107]  Ramana Rao,et al.  The Hyperbolic Browser: A Focus + Context Technique for Visualizing Large Hierarchies , 1996, J. Vis. Lang. Comput..

[108]  Donna K. Harman,et al.  The TREC Conferences , 1997, HIM.

[109]  Loren G. Terveen,et al.  Constructing, organizing, and visualizing collections of topically related Web resources , 1999, TCHI.

[110]  Christoph Kunz.  SERGIO - An Interface for context driven Knowledge Retrieval , 2003 .

[111]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[112]  Chaomei Chen,et al.  Web site design with the patron in mind: A step-by-step guide for libraries , 2006 .

[113]  Gary Marchionini,et al.  Previews and overviews in digital libraries: Designing surrogates to support visual information seeking , 2000, J. Am. Soc. Inf. Sci..

[114]  Monica M. C. Schraefel,et al.  mSpace: improving information access to multimedia domains with multimodal exploratory search , 2006, Commun. ACM.

[115]  Marti A. Hearst.  The Use of Categories and Clusters for Organizing Retrieval Results , 1999 .

[116]  Hisham M. Haddad,et al.  Proceedings of the 2002 ACM Symposium on Applied Computing (SAC), March 10-14, 2002, Madrid, Spain , 2002, SAC.

[117]  Calvin N. Moore,et al.  Mooers' Law or Why Some Retrieval Systems Are Used and Others Are Not , 2005 .

[118]  Akrivi Katifori,et al.  Ontology visualization methods—a survey , 2007, CSUR.

[119]  Alistair G. Sutcliffe,et al.  3D or not 3D: Is it Nobler in the Mind? , 1996, BCS HCI.

[120]  Linda Dailey Paulson,et al.  Building Rich Web Applications with Ajax , 2005, Computer.

[121]  Masashi Yamamuro,et al.  A practical query-by-humming system for a large music database , 2000, ACM Multimedia.

[122]  Mika Käki,et al.  Findex: search result categories help users when document ranking fails , 2005, CHI.

[123]  Erkki Sutinen,et al.  Animation of user algorithms on the Web , 1997, Proceedings. 1997 IEEE Symposium on Visual Languages (Cat. No.97TB100180).

[124]  Ben Shneiderman,et al.  BROWSING LARGE ONLINE DATA WITH QUERY PREVIEWS , 2007 .

[125]  Yusef Hassan-Montero,et al.  Improving Tag-Clouds as Visual Information Retrieval Interfaces , 2024, 2401.04947.

[126]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[127]  Antonio Gulli,et al.  The indexable web is more than 11.5 billion pages , 2005, WWW '05.

[128]  David R. Karger,et al.  Exhibit: lightweight structured data publishing , 2007, WWW '07.

[129]  Gary Marchionini,et al.  Visualizing websites using a hierarchical table of contents browser:WebTOC , 1998 .

[130]  Ben Shneiderman,et al.  Sorting out searching: a user-interface framework for text searches , 1998, CACM.

[131]  Monica M. C. Schraefel,et al.  Continuum: designing timelines for hierarchies, relationships and scale , 2007, UIST.

[132]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[133]  Edward A. Fox,et al.  Connecting topics in document collections with stepping stones and pathways , 2005, CIKM '05.

[134]  Marti A. Hearst.  Clustering versus faceted categories for information exploration , 2006, Commun. ACM.

[135]  Andreas Becks,et al.  Benefits of document maps for text access in knowledge management: a comparative study , 2002, SAC '02.

[136]  Kasper Hornbæk,et al.  Side-By-Side Display and Control of Multiple Scenarios: Subjunctive Interfaces for Exploring Multi-Attribute Data , 2003 .

[137]  Desney S. Tan,et al.  Phosphor: explaining transitions in the user interface using afterglow effects , 2006, UIST.

[138]  Ophir Frieder,et al.  Hourly analysis of a very large topically categorized web query log , 2004, SIGIR '04.

[139]  Jarkko Kari,et al.  Evolutionary information seeking: A case study of personal development and Internet searching , 2006, First Monday.

[140]  Alistair G. Sutcliffe,et al.  Towards a cognitive theory of information retrieval , 1998, Interact. Comput..

[141]  Isto Huvila,et al.  Perspectives to the classification of information interactions: the Cool and Belkin faceted classification scheme under scrutiny , 2006, IIiX.

[142]  Ben Shneiderman,et al.  Why Not Make Interfaces Better than 3D Reality? , 2003, IEEE Computer Graphics and Applications.

[143]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[144]  Ben Shneiderman,et al.  Query previews in networked information systems , 1996, Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries,.

[145]  Peter Ingwersen,et al.  Information seeking research needs extension toward tasks and technology , 2004, Inf. Res..

[146]  Brian Detlor,et al.  Web Work: Information Seeking and Knowledge Work on the World Wide Web , 2000 .

[147]  William R. Hersh,et al.  Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries , 2002 .

[148]  Marti A. Hearst,et al.  Nearly-Automated Metadata Hierarchy Creation , 2004, NAACL.

[149]  Yoshiaki Shirai.  3D computer vision and applications , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[150]  Ben Shneiderman,et al.  Interface and data architecture for query preview in networked information systems , 1999, TOIS.

[151]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[152]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[153]  Tamara Munzner,et al.  H3: laying out large directed graphs in 3D hyperbolic space , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[154]  Max L. Wilson,et al.  mSpace: What do Numbers and Totals Mean in a Flexible Semantic Browser , 2006 .

[155]  Offer Drori,et al.  Using document classification for displaying search results lists , 2003, J. Inf. Sci..

[156]  Ben Shneiderman,et al.  Designing information-abundant web sites: issues and recommendations , 1997, Int. J. Hum. Comput. Stud..

[157]  Gary Marchionini,et al.  Machine learning for information architecture in a large governmental website , 2004, JCDL.

[158]  Ian H. Witten,et al.  Proceedings of the third ACM conference on Digital libraries , 1998 .

[159]  David Ellis,et al.  A behavioural model for information retrieval system design , 1989, J. Inf. Sci..

[160]  Ryen W. White,et al.  Finding relevant documents using top ranking sentences: an evaluation of two alternative schemes , 2002, SIGIR '02.

[161]  Mark Steedman,et al.  Example Selection for Bootstrapping Statistical Parsers , 2003, NAACL.

[162]  P. Ingwersen.  Cognitive Information Retrieval. , 1999 .

[163]  Nicholas J. Belkin,et al.  Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems , 1995 .

[164]  Haixia Zhao,et al.  Visualizing Web Search Results , 2002 .