The utilization of human color categorization for content-based image retrieval

We present the concept of intelligent Content-Based Image Retrieval (iCBIR), which incorporates knowledge concerning human cognition in system development. The present research focuses on the utilization of color categories (or focal colors) for CBIR purposes, in particularly considered to be useful for query-by-heart purposes. However, this research explores its potential use for query-by-example purposes. Their use was validated for the field of CBIR by two experiments (26 subjects; stimuli: 4 times the 216 W3C web-safe colors) and one question ("mention ten colors"). Based on the experimental results a Color LookUp Table (CLUT) was defined. This CLUT was used to segment the HSI color space into the 11 color categories. With that a new color quantization method was introduced making a 11 bin color histogram configuration possible. This was compared with three other histogram configurations of 64, 166, and 4096 bins. Combined with the intersection and the quadratic distance measure we defined seven color matching systems. An experimentally founded benchmark for CBIR systems was implemented (1680 queries were performed measuring relevance and satisfaction). The 11 bin histogram configuration did have an average performance. A promising result since it was a naive implementation and is still a topic of development.

[1]  E. R. Heider Universals in color naming and memory. , 1972, Journal of experimental psychology.

[2]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[4]  Robert L. Goldstone Effects of Categorization on Color Perception , 1995 .

[5]  Kuo-Chin Fan,et al.  Efficient matching of large-size histograms , 2004, Pattern Recognit. Lett..

[6]  Louis Vuurpijl,et al.  Vind(x): using the user through cooperative annotation , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[7]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[8]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[9]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[10]  Enrique Coiras,et al.  Hexadecagonal region growing , 1998, Pattern Recognit. Lett..

[11]  Louis Vuurpijl,et al.  New use for the pen: outline-based image queries , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[12]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[13]  Michael S. Lew Next-Generation Web Searches for Visual Content , 2000, Computer.

[14]  Theories, technologies, instrumentalities of color: Anthropological and historiographic perspectives , 2003 .

[15]  L. Arend,et al.  Simultaneous color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[16]  Angelika Schulz Interfacedesign - die visuelle Gestaltung interaktiver Computeranwendungen , 1998 .

[17]  Ingemar J. Cox,et al.  PicHunter: Bayesian relevance feedback for image retrieval , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[18]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[19]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[20]  Louis Vuurpijl,et al.  Modeling human color categorization: Color discrimination and color memory , 2003 .

[21]  S. McKee,et al.  Quantitative studies in retinex theory a comparison between theoretical predictions and observer responses to the “color mondrian” experiments , 1976, Vision Research.

[22]  Louis Vuurpijl,et al.  Content-Based Image Retrieval: Color-selection exploited , 2002 .

[23]  Nicolaos Ikonomakis,et al.  Region-based color image segmentation scheme , 1998, Electronic Imaging.

[24]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[26]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Shih-Fu Chang,et al.  Single color extraction and image query , 1995, Proceedings., International Conference on Image Processing.