Visual Re-Ranking for Multi-Aspect Information Retrieval

We present visual re-ranking, an interactive visualization technique for multi-aspect information retrieval. In multi-aspect search, the information need of the user consists of more than one aspect or query simultaneously. While visualization and interactive search user interface techniques for improving user interpretation of search results have been proposed, the current research lacks understanding on how useful these are for the user: whether they lead to quantifiable benefits in perceiving the result space and allow faster, and more precise retrieval. Our technique visualizes relevance and document density on a two-dimensional map with respect to the query phrases. Pointing to a location on the map specifies a weight distribution of the relevance to each of the query phrases, according to which search results are re-ranked. User experiments compared our technique to a uni-dimensional search interface with typed query and ranked result list, in perception and retrieval tasks. Visual re-ranking yielded improved accuracy in perception, higher precision in retrieval and overall faster task execution. Our findings demonstrate the utility of visual re-ranking, and can help designing search user interfaces that support multi-aspect search.

[1]  Guy Lebanon,et al.  Visualizing Incomplete and Partially Ranked Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[2]  Jin Zhang,et al.  DARE: Distance and Angle Retrieval Environment: A Tale of the Two Measures , 1999, J. Am. Soc. Inf. Sci..

[3]  Timo Honkela,et al.  WEBSOM - Self-organizing maps of document collections , 1998, Neurocomputing.

[4]  David S. Ebert,et al.  The shape of Shakespeare: visualizing text using implicit surfaces , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[5]  Dorota Glowacka,et al.  Directing exploratory search with interactive intent modeling , 2013, CIKM.

[6]  Dorota Glowacka,et al.  IntentStreams: Smart Parallel Search Streams for Branching Exploratory Search , 2015, IUI.

[7]  Kevin W. Boyack,et al.  Domain visualization using VxInsight® for science and technology management , 2002, J. Assoc. Inf. Sci. Technol..

[8]  Xue Dong Yang,et al.  The Visual Exploration ofWeb Search Results Using HotMap , 2006, Tenth International Conference on Information Visualisation (IV'06).

[9]  Andrew M. Webb,et al.  combinFormation: a mixed-initiative system for representing collections as compositions of image and text surrogates , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[10]  Silvia Miksch,et al.  Visualizing Sets and Set-typed Data: State-of-the-Art and Future Challenges , 2014, EuroVis.

[11]  Anselm Spoerri,et al.  InfoCrystal: a visual tool for information retrieval & management , 1993, CIKM '93.

[12]  W. Bruce Croft,et al.  A Language Modeling Approach to Information Retrieval , 1998, SIGIR Forum.

[13]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[14]  Jiawei Han,et al.  Answering top-k queries with multi-dimensional selections: the ranking cube approach , 2006, VLDB.

[15]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction, 6th Edition , 2016 .

[16]  Deborah Hix,et al.  An empirical evaluation of user interfaces for topic management of Web sites , 1999, CHI '99.

[17]  James J. Thomas,et al.  Visualizing the non-visual: spatial analysis and interaction with information from text documents , 1995, Proceedings of Visualization 1995 Conference.

[18]  Elizabeth G. Hetzler,et al.  Analysis experiences using information visualization , 2004, IEEE Computer Graphics and Applications.

[19]  Piero P. Bonissone,et al.  Multicriteria decision making (mcdm): a framework for research and applications , 2009, IEEE Computational Intelligence Magazine.

[20]  Dunja Mladenic,et al.  Visualization of Text Document Corpus , 2005, Informatica.

[21]  Vijay V. Raghavan,et al.  A critical analysis of vector space model for information retrieval , 1986, J. Am. Soc. Inf. Sci..

[22]  Jin Zhang TOFIR: A tool of facilitating information retrieval - introduce a visual retrieval model , 2001, Inf. Process. Manag..

[23]  George W. Fitzmaurice,et al.  Dynamic Opacity Optimization for Scatter Plots , 2015, CHI.

[24]  Robert R. Korfhage,et al.  Visualization of a Document Collection: The VIBE System , 1993, Inf. Process. Manag..

[25]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[26]  Hanspeter Pfister,et al.  LineUp: Visual Analysis of Multi-Attribute Rankings , 2013, IEEE Transactions on Visualization and Computer Graphics.

[27]  Edward A. Fox,et al.  Connecting topics in document collections with stepping stones and pathways , 2005, CIKM '05.

[28]  S. Robertson The probability ranking principle in IR , 1997 .

[29]  Pak Chung Wong,et al.  TOPIC ISLANDS/sup TM/-a wavelet-based text visualization system , 1998 .

[30]  Ben Shneiderman,et al.  Dynamic queries for visual information seeking , 1994, IEEE Software.

[31]  Samuel Kaski,et al.  Interactive intent modeling , 2014, Commun. ACM.

[32]  Michael Lewis,et al.  Why information retrieval visualizations sometimes fail , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[33]  Ben Shneiderman,et al.  A Rank-by-Feature Framework for Interactive Exploration of Multidimensional Data , 2005, Inf. Vis..

[34]  Pak Chung Wong,et al.  TOPIC ISLANDS/sup TM/-a wavelet-based text visualization system , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[35]  Yi Chang,et al.  Learning to rank with multi-aspect relevance for vertical search , 2012, WSDM '12.

[36]  Wei Chen,et al.  RankExplorer: Visualization of Ranking Changes in Large Time Series Data , 2012, IEEE Transactions on Visualization and Computer Graphics.

[37]  Steve Benford,et al.  VR‐VIBE: A Virtual Environment for Co‐operative Information Retrieval , 1995, Comput. Graph. Forum.

[38]  Marti A. Hearst TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.

[39]  Peter Brusilovsky,et al.  Adaptive Visualization of Search Results: Bringing User Models to Visual Analytics , 2009, Inf. Vis..

[40]  Ben Shneiderman,et al.  Visualizing digital library search results with categorical and hierarchical axes , 2000, DL '00.

[41]  Diogo Cabral,et al.  Designing for Exploratory Search on Touch Devices , 2015, CHI.

[42]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[43]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[44]  Christopher Williamson,et al.  Dynamic queries for information exploration: an implementation and evaluation , 1992, CHI.

[45]  Xue Dong Yang,et al.  Interactive Web Information Retrieval Using WordBars , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[46]  Andreas Kerren,et al.  Text visualization techniques: Taxonomy, visual survey, and community insights , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[47]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[48]  Serdar Tasiran,et al.  TreeJuxtaposer: scalable tree comparison using Focus+Context with guaranteed visibility , 2003, ACM Trans. Graph..

[49]  Robert R. Korfhage,et al.  GUIDO, a visual tool for retrieving documents , 1994, Proceedings of 1994 IEEE Symposium on Visual Languages.

[50]  Ben Shneiderman,et al.  Visual information seeking: tight coupling of dynamic query filters with starfield displays , 1994, CHI '94.

[51]  Wei Song,et al.  Multi-aspect query summarization by composite query , 2012, SIGIR '12.

[52]  Xia Lin,et al.  Map Displays for Information Retrieval , 1997, J. Am. Soc. Inf. Sci..

[53]  Matthew Chalmers,et al.  Bead: explorations in information visualization , 1992, SIGIR '92.

[54]  J Allan,et al.  Readings in information retrieval. , 1998 .

[55]  Kenneth A. Perrine,et al.  Interactive visualization of multiple query results , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..