Learning Color Names for Real-World Applications

Color names are required in real-world applications such as image retrieval and image annotation. Traditionally, they are learned from a collection of labeled color chips. These color chips are labeled with color names within a well-defined experimental setup by human test subjects. However, naming colors in real-world images differs significantly from this experimental setting. In this paper, we investigate how color names learned from color chips compare to color names learned from real-world images. To avoid hand labeling real-world images with color names, we use Google image to collect a data set. Due to the limitations of Google image, this data set contains a substantial quantity of wrongly labeled data. We propose several variants of the PLSA model to learn color names from this noisy data. Experimental results show that color names learned from real-world images significantly outperform color names learned from labeled color chips for both image retrieval and image annotation.

[1]  A. Mojsilovi A Computational Model for Color Naming and Describing Color Composition of Images , 2022 .

[2]  Gloria Menegaz,et al.  A Discrete Model for Color Naming , 2007, EURASIP J. Adv. Signal Process..

[3]  Bill Triggs,et al.  Region Classification with Markov Field Aspect Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  H. S. Straight Color Categories in Thought and Language , 2003 .

[5]  Jean-Pierre Menu,et al.  Cognitive aspects of color , 1995, Electronic Imaging.

[6]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[7]  Luc Van Gool,et al.  Modeling scenes with local descriptors and latent aspects , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  D. Conway An Experimental Comparison of Three Natural Language Colour Naming Models , 1992 .

[9]  Cordelia Schmid,et al.  Learning Color Names from Real-World Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Nathan Moroney,et al.  Unconstrained web-based color naming experiment , 2003, IS&T/SPIE Electronic Imaging.

[11]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[12]  Andrew Zisserman,et al.  Learning Visual Attributes , 2007, NIPS.

[13]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[14]  Alexei A. Efros,et al.  Discovering objects and their location in images , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  J.M. Boi,et al.  Semantics Driven Resampling of the OSA-UCS , 2007, 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007).

[16]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[17]  L. Steels,et al.  coordinating perceptually grounded categories through language: a case study for colour , 2005, Behavioral and Brain Sciences.

[18]  Brian V. Funt,et al.  Is Machine Colour Constancy Good Enough? , 1998, ECCV.

[19]  Keiji Yanai,et al.  Image region entropy: a measure of "visualness" of web images associated with one concept , 2005, MULTIMEDIA '05.

[20]  Ying Liu,et al.  Region-Based Image Retrieval with High-Level Semantic Color Names , 2005, 11th International Multimedia Modelling Conference.

[21]  Lewis D. Griffin,et al.  Optimality of the basic colour categories for classification , 2006, Journal of The Royal Society Interface.

[22]  P. Kay Basic Color Terms: Their Universality and Evolution , 1969 .

[23]  J. Lammens A computational model of color perception and color naming , 1995 .

[24]  C. L. Hardin,et al.  Color categories in thought and language: Author index , 1997 .

[25]  Daniel Gatica-Perez,et al.  On image auto-annotation with latent space models , 2003, ACM Multimedia.

[26]  Robert Benavente,et al.  A data set for fuzzy colour naming , 2006 .

[27]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[28]  Frédéric Jurie,et al.  Latent mixture vocabularies for object categorization and segmentation , 2006, Image Vis. Comput..

[29]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  M. Vanrell,et al.  Parametric fuzzy sets for automatic color naming. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Pietro Perona,et al.  Learning object categories from Google's image search , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.