An evaluation of semantic fisheye views for opportunistic search in an annotated image collection

Visual interfaces are potentially powerful tools for users to explore a representation of a collection and opportunistically discover information that will guide them toward relevant documents. Semantic fisheye views (SFEVs) are focus + context visualization techniques that manage visual complexity by selectively emphasizing and increasing the detail of information related to the user’s focus and deemphasizing or filtering less important information.In this paper we describe a prototype for visualizing an annotated image collection and an experiment to compare the effectiveness of two distinctly different SFEVs for a complex opportunistic search task. The first SFEV calculates relevance based on keyword-content similarity and the second based on conceptual relationships between images derived using WordNet. The results of the experiment suggest that semantic-guided search is significantly more effective than similarity-guided search for discovering and using domain knowledge in a collection.

[1]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[2]  Minh N. Do,et al.  Integrated Browsing and Searching of Large Image Collections , 2000, VISUAL.

[3]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[4]  George A. Miller.  WordNet: A Lexical Database for English , 1992, HLT.

[5]  Marti A. Hearst,et al.  Scatter/gather browsing communicates the topic structure of a very large text collection , 1996, CHI.

[6]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[7]  Marcia J. Bates,et al.  Information search tactics , 1979, J. Am. Soc. Inf. Sci..

[8]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[9]  P. Pu,et al.  Visual Interfaces for Opportunistic Information Seeking , 1987 .

[10]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[11]  Mark D. Apperley,et al.  A review and taxonomy of distortion-oriented presentation techniques , 1994, TCHI.

[12]  Boris Motik,et al.  A Conceptual Modeling Approach for Semantics-Driven Enterprise Applications , 2002, OTM.

[13]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[14]  Benjamin B. Bederson,et al.  PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps , 2001, UIST '01.

[15]  Pearl Pu,et al.  A framework for designing fisheye views to support multiple semantic contexts , 2002, AVI '02.

[16]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[17]  Pearl Pu,et al.  Searching with Semantics: An Interactive Visualization Technique for Exploring an Annotated Image Collection , 2003, OTM Workshops.

[18]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[19]  Frank Paul Janecek.  Interactive semantic fisheye views for information workspaces , 2004 .

[20]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[21]  Peter Ingwersen,et al.  Polyrepresentation of information needs and semantic entities: elements of a cognitive theory for information retrieval interaction , 1994, SIGIR '94.

[22]  Issei Fujishiro,et al.  The elements of graphing data , 2005, The Visual Computer.

[23]  Manojit Sarkar,et al.  Graphical fisheye views , 1994, CACM.

[24]  Stuart K. Card,et al.  The cost structure of sensemaking , 1993, INTERCHI.

[25]  Marcia J. Bates,et al.  Separating the knowledge layers: Cognitive analysis of search knowledge through hierarchical goal decompositions , 2005, ASIST.

[26]  Ed H. Chi,et al.  Using information scent to model user information needs and actions and the Web , 2001, CHI.

[27]  A. T. Schreiber,et al.  Semantic Annotation of Image Collections , 2003 .

[28]  Christopher Olston,et al.  ScentTrails: Integrating browsing and searching on the Web , 2003, TCHI.

[29]  George W. Furnas,et al.  Considerations for information environments and the NaviQue workspace , 1998, DL '98.

[30]  Peter Pirolli,et al.  Computational models of information scent-following in a very large browsable text collection , 1997, CHI.

[31]  Kerry Rodden,et al.  Does organisation by similarity assist image browsing? , 2001, CHI.