Search strategies in content-based image retrieval

This paper describes two studies that looked at users' ability to formulate visual queries with a Content-Based Image Retrieval system that uses dominant image colour as the primary indexing key. The first experiment examined users' performance with two visual search tools, a sketch tool and a structured browsing tool, with different types of image query. The results showed that while users were able to successfully search on the basis of colour, and were able to formulate visual queries, their ability to do so was affected by search task type. Search task type was also shown to be related to search tool choice. However, the results of study two showed that while users were able to complete all of the tasks, there was evidence to suggest that a degree of compromise was present in the users' choice of image that was largely due to problems relating to query formulation.

[1]  Joemon M. Jose,et al.  Spatial querying for image retrieval: a user-oriented evaluation , 1998, SIGIR '98.

[2]  Susanne Ornager The newspaper image database: empirical supported analysis of users' typology and word association clusters , 1995, SIGIR '95.

[3]  Colin C. Venters,et al.  Query by Visual Example: Assessing the Usability of Content-Based Image Retrieval System User Interfaces , 2001, IEEE Pacific Rim Conference on Multimedia.

[4]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  John Tait,et al.  Evaluating a content based image retrieval system , 2001, SIGIR '01.

[6]  Peter G. B. Enser,et al.  Progress in Documentation Pictorial Information Retrieval , 1995, J. Documentation.

[7]  Raya Fidel,et al.  The image retrieval task: implications for the design and evaluation of image databases , 1997, New Rev. Hypermedia Multim..

[8]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[9]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[10]  Simone Santini,et al.  Integrated browsing and querying for image databases , 2000, IEEE MultiMedia.

[11]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[12]  Kerry Rodden,et al.  Does organisation by similarity assist image browsing? , 2001, CHI.

[13]  M. Markkula,et al.  Searching for Photos - Journalists' Practices in Pictorial IR , 1998 .

[14]  Simone Santini,et al.  Exploratory Image Databases: Content-Based Retrieval , 2001 .

[15]  Shih-Fu Chang,et al.  The holy grail of content-based media analysis , 2002 .

[16]  R. Arnheim,et al.  Art and Visual Perception: A Psychology of the Creative Eye. , 1956 .

[17]  Simone Santini,et al.  In search of information in visual media , 1997, CACM.

[18]  Carlo Tomasi,et al.  Perceptual metrics for image database navigation , 1999 .

[19]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.