AspecTiles: tile-based visualization of diversified web search results

A diversified search result for an underspecified query generally contains web pages in which there are answers that are relevant to different aspects of the query. In order to help the user locate such relevant answers, we propose a simple extension to the standard Search Engine Result Page (SERP) interface, called AspecTiles. In addition to presenting a ranked list of URLs with their titles and snippets, AspecTiles visualizes the relevance degree of a document to each aspect by means of colored squares ("tiles"). To compare AspecTiles with the standard SERP interface in terms of usefulness, we conducted a user study involving 30 search tasks designed based on the TREC web diversity task topics as well as 32 participants. Our results show that AspecTiles has some advantages in terms of search performance, user behavior, and user satisfaction. First, AspecTiles enables the user to gather relevant information significantly more efficiently than the standard SERP interface for tasks where the user considers several different aspects of the query to be important at the same time (multi-aspect tasks). Second, AspecTiles affects the user's information seeking behavior: with this interface, we observed significantly fewer query reformulations, shorter queries and deeper examinations of ranked lists in multi-aspect tasks. Third, participants of our user study found AspecTiles significantly more useful for finding relevant information and easy to use than the standard SERP interface. These results suggest that simple interfaces like AspecTiles can enhance the search performance and search experience of the user when their queries are underspecified.

[1]  Tetsuya Sakai Evaluation with informational and navigational intents , 2012, WWW.

[2]  Yang Xiang,et al.  Visualizing criminal relationships: comparison of a hyperbolic tree and a hierarchical list , 2005, Decis. Support Syst..

[3]  Paul Over,et al.  The TREC-9 Interactive Track Report , 1999, TREC.

[4]  ShardaRamesh,et al.  Visualization of web spaces , 2007 .

[5]  Thorsten Joachims,et al.  Dynamic ranked retrieval , 2011, WSDM '11.

[6]  Harald Reiterer,et al.  INSYDER: a content-based visual-information-seeking system for the Web , 2005, International Journal on Digital Libraries.

[7]  Craig MacDonald,et al.  Exploiting query reformulations for web search result diversification , 2010, WWW '10.

[8]  Ji-Rong Wen,et al.  Multi-dimensional search result diversification , 2011, WSDM '11.

[9]  Paul Over,et al.  Interactivity at the Text Retrieval Conference (TREC) , 2001, Inf. Process. Manag..

[10]  Tomi Heimonen,et al.  Visualizing query occurrence in search result lists , 2005, Ninth International Conference on Information Visualisation (IV'05).

[11]  Chaomei Chen,et al.  Empirical studies of information visualization: a meta-analysis , 2000, Int. J. Hum. Comput. Stud..

[12]  Xue Dong Yang,et al.  A Comparative User Study of Web Search Interfaces: HotMap, Concept Highlighter, and Google , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[13]  Marti A. Hearst,et al.  TREC 2007 Genomics Track Overview , 2007, TREC.

[14]  Sreenivas Gollapudi,et al.  Diversifying search results , 2009, WSDM '09.

[15]  Yiqun Liu,et al.  Overview of the NTCIR-9 INTENT Task , 2011, NTCIR.

[16]  Andrei Broder,et al.  A taxonomy of web search , 2002, SIGF.

[17]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[18]  Charles L. A. Clarke,et al.  An Effectiveness Measure for Ambiguous and Underspecified Queries , 2009, ICTIR.

[19]  Ramesh Sharda,et al.  Visualization of web spaces: state of the art and future directions , 2007, DATB.

[20]  Michael Chau,et al.  Visualizing web search results using glyphs: Design and evaluation of a flower metaphor , 2011, TMIS.

[21]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[22]  Katsumi Tanaka,et al.  Enhancing credibility judgment of web search results , 2011, CHI.

[23]  Marti A. Hearst TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.