Does organisation by similarity assist image browsing?

In current systems for browsing image collections, users are presented with sets of thumbnail images arranged in some default order on the screen. We are investigating whether it benefits users to have sets of thumbnails arranged according to their mutual similarity, so images that are alike are placed together. There are, of course, many possible definitions of “similarity”: so far we have explored measurements based on low-level visual features, and on the textual captions assigned to the images. Here we describe two experiments, both involving designers as the participants, examining whether similarity-based arrangements of the candidate images are helpful for a picture selection task. Firstly, the two types of similarity-based arrangement were informally compared. Then, an arrangement based on visual similarity was more formally compared with a control of a random arrangement. We believe this work should be of interest to anyone designing a system that involves presenting sets of images to users.

[1]  Sharon Garber,et al.  The art of search: a study of art directors , 1992, CHI.

[2]  Peter Ingwersen,et al.  The development of a method for the evaluation of interactive information retrieval systems , 1997, J. Documentation.

[3]  Kerry Rodden,et al.  Evaluating a Visualisation of Image Similarity. , 1999 .

[4]  Kerry Rodden,et al.  Evaluating a visualisation of image similarity as a tool for image browsing , 1999, Proceedings 1999 IEEE Symposium on Information Visualization (InfoVis'99).

[5]  James Allan,et al.  Improving Interactive Retrieval by Combining Ranked List and Clustering , 2000, RIAO.

[6]  James Allan,et al.  Aspect windows, 3-D visualizations, and indirect comparisons of information retrieval systems , 1998, SIGIR '98.

[7]  Leonidas J. Guibas,et al.  Adaptive Color-Image Embeddings for Database Navigation , 1998, ACCV.

[8]  Mary Czerwinski,et al.  Spatial ability and visual navigation: an Empirical Study , 1997, New Rev. Hypermedia Multim..

[9]  Kerry Rodden,et al.  Evaluating a visualisation of image similarity (poster abstract) , 1999, SIGIR '99.

[10]  Benjamin B. Bederson,et al.  Does zooming improve image browsing? , 1999, DL '99.

[11]  Amanda Clare,et al.  ANVIL: a System for the Retrieval of Captioned Images using NLP Techniques , 2001 .

[12]  Wojciech Basalaj Proximity visualisation of abstract data , 2001 .

[13]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[14]  Joemon M. Jose,et al.  Spatial querying for image retrieval: a user-oriented evaluation , 1998, SIGIR '98.

[15]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[16]  Matthew Chalmers,et al.  Adding imageability features to information displays , 1996, UIST '96.