Filter Image Browsing: Interactive Image Retrieval by Using Database Overviews

Human-computer interaction is a decisive factor in effective content-based access to large image repositories. In current image retrieval systems the user refines his query by selecting example images from a relevance ranking. Since the top ranked images are all similar, user feedback often results in rearrangement of the presented images only.For better incorporation of user interaction in the retrieval process, we have developed the Filter Image Browsing method. It also uses feedback through image selection. However, it is based on differences between images rather than similarities. Filter Image Browsing presents overviews of relevant parts of the database to users. Through interaction users then zoom in on parts of the image collection. By repeatedly limiting the information space, the user quickly ends up with a small amount of relevant images. The method can easily be extended for the retrieval of multimedia objects.For evaluation of the Filter Image Browsing retrieval concept, a user simulation is applied to a pictorial database containing 10,000 images acquired from the World Wide Web by a search robot. The simulation incorporates uncertainty in the definition of the information need by users. Results show Filter Image Browsing outperforms plain interactive similarity ranking in required effort from the user. Also, the method produces predictable results for retrieval sessions, so that the user quickly knows if a successful session is possible at all. Furthermore, the simulations show the overview techniques are suited for applications such as hand-held devices where screen space is limited.

[1]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[2]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[3]  Haim Levkowitz,et al.  GLHS: A Generalized Lightness, Hue, and Saturation Color Model , 1993, CVGIP Graph. Model. Image Process..

[4]  William I. Grosky,et al.  Multimedia information systems , 1994, IEEE MultiMedia.

[5]  Rohini K. Srihari,et al.  Automatic Indexing and Content-Based Retrieval of Captioned Images , 1995, Computer.

[6]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[7]  M. Worring,et al.  Hyperdocument generation using OCR and icon detection , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[8]  Ingemar J. Cox,et al.  Target testing and the PicHunter Bayesian multimedia retrieval system , 1996, Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries,.

[9]  Th. Gevers,et al.  Color Image Invariant Segmentation and Retrieval , 1996 .

[10]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[11]  Ramesh Jain,et al.  Infoscopes: Multimedia Information Systems , 1996 .

[12]  Ingemar J. Cox,et al.  PicHunter: Bayesian relevance feedback for image retrieval , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  Shih-Fu Chang,et al.  Image and video search engine for the World Wide Web , 1997, Electronic Imaging.

[14]  Shih-Fu Chang,et al.  Visually Searching the Web for Content , 1997, IEEE Multim..

[15]  Marco La Cascia,et al.  Image Digestion and Relevance Feedback in the ImageRover WWW Search Engine , 1997 .

[16]  Ronald Fagin,et al.  Incorporating User Preferences in Multimedia Queries , 1997, ICDT.

[17]  Leonidas J. Guibas,et al.  Adaptive Color-Image Embeddings for Database Navigation , 1998, ACCV.

[18]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[19]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[20]  Marcel Worring,et al.  Content Based Hypertext Creation in Text/Figure Databases , 1998, Image Databases and Multi-Media Search.

[21]  Simone Santini,et al.  Beyond query by example , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[22]  Daniel Tretter,et al.  A Web-Based Secure System for the Distributed Printing of Documents and Images , 1998, J. Vis. Commun. Image Represent..

[23]  Jaime G. Carbonell,et al.  The Use of MMR and Diversity-Based Reranking in Document Reranking and Summarization , 1998 .

[24]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[25]  Marcel Worring,et al.  Filter Image Browsing - Exploiting Interaction in Image Retrieval , 1999, VISUAL.

[26]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.