Interactive Exploration for Image Retrieval

We present a new version of our content-based image retrieval system RETIN. It is based on adaptive quantization of the color space, together with new features aiming at representing the spatial relationship between colors. Color analysis is also extended to texture. Using these powerful indexes, an original interactive retrieval strategy is introduced. The process is based on two steps for handling the retrieval of very large image categories. First, a controlled exploration method of the database is presented. Second, a relevance feedback method based on statistical learning is proposed. All the steps are evaluated by experiments on a generalist database.

[1]  Murat Kunt,et al.  Content-based retrieval from image databases: current solutions and future directions , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Luigi Cinque,et al.  Color-based image retrieval using spatial-chromatic histograms , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[3]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[4]  Ben A. M. Schouten,et al.  Show Me What You Mean! Pariss: A CBIR-Interface that Learns by Example , 2000, VISUAL.

[5]  Gianluigi CIOCCA.  COLOR IN DATABASES: INDEXATION AND SIMILARITY , 2000 .

[6]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[7]  Raimondo Schettini,et al.  Color-based image retrieval using spatial-chromatic histograms , 2001, Image Vis. Comput..

[8]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  John R. Smith,et al.  Image Classification and Querying Using Composite Region Templates , 1999, Comput. Vis. Image Underst..

[10]  Matthieu Cord,et al.  Discriminative Classification vs Modeling Methods in CBIR , 2004 .

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  Reiner Lenz,et al.  PCA-based representation of color distributions for color-based image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[13]  Matthieu Cord,et al.  RETIN AL: an active learning strategy for image category retrieval , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[14]  Daphne Koller,et al.  Active learning: theory and applications , 2001 .

[15]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[16]  Gerard Salton,et al.  The SMART Retrieval System—Experiments in Automatic Document Processing , 1971 .

[17]  Matthieu Cord,et al.  Semantic kernel updating for content-based image retrieval , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[18]  B. S. Manjunath,et al.  Browsing large satellite and aerial photographs , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[19]  Matthieu Cord,et al.  Back-propagation algorithm for relevance feedback in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  John P. Eakins,et al.  Towards intelligent image retrieval , 2002, Pattern Recognit..

[21]  Thomas S. Huang,et al.  Optimizing learning in image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[22]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Roberto Brunelli,et al.  Histograms analysis for image retrieval , 2001, Pattern Recognit..

[24]  Joshua R. Smith,et al.  Image retrieval evaluation , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[25]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[26]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[27]  J. J. Rocchio,et al.  Relevance feedback in information retrieval , 1971 .

[28]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[29]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[30]  Alberto Del Bimbo,et al.  Weighted walkthroughs between extended entities for retrieval by spatial arrangement , 2003, IEEE Trans. Multim..

[31]  Michael J. Swain,et al.  The capacity of color histogram indexing , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Matthieu Cord,et al.  RETIN: A Content-Based Image Indexing and Retrieval System , 2001, Pattern Analysis & Applications.

[33]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Donald Geman,et al.  A Stochastic Feedback Model for Image Retrieval , 1999 .

[35]  Christos Faloutsos,et al.  MindReader: Querying Databases Through Multiple Examples , 1998, VLDB.

[36]  Jérome Fournier,et al.  Exploration and search-by-similarity in CBIR , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).

[37]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[38]  T.S. Huang,et al.  A relevance feedback architecture for content-based multimedia information retrieval systems , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[39]  Edward Y. Chang,et al.  Statistical learning for effective visual information retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[40]  Nicu Sebe,et al.  Extended performance graphs for cluster retrieval , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  B. S. Manjunath,et al.  Image indexing using a texture dictionary , 1995, Other Conferences.

[42]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..