Beyond Eleven Color Names for Image Understanding

Color description is one of the fundamental problems of image understanding. One of the popular ways to represent colors is by means of color names. Most existing work on color names focuses on only the eleven basic color terms of the English language. This could be limiting the discriminative power of these representations, and representations based on more color names are expected to perform better. However, there exists no clear strategy to choose additional color names. We collect a dataset of 28 additional color names. To ensure that the resulting color representation has high discriminative power we propose a method to order the additional color names according to their complementary nature with the basic color names. This allows us to compute color name representations with high discriminative power of arbitrary length. In the experiments we show that these new color name descriptors outperform the existing color name descriptor on the task of visual tracking, person re-identification and image classification.

[1]  Glenn Healey,et al.  Segmenting images using normalized color , 1992, IEEE Trans. Syst. Man Cybern..

[2]  Julia Sturges,et al.  Locating basic colours in the munsell space , 1995 .

[3]  Fahad Shahbaz Khan,et al.  Modulating Shape Features by Color Attention for Object Recognition , 2012, International Journal of Computer Vision.

[4]  Thomas Hofmann,et al.  Probabilistic latent semantic indexing , 1999, SIGIR '99.

[5]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[7]  Jing Liu,et al.  Color names learning using convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[8]  Shengcai Liao,et al.  Salient Color Names for Person Re-identification , 2014, ECCV.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[11]  C. Alejandro Parraga,et al.  NICE: A Computational Solution to Close the Gap from Colour Perception to Colour Categorization , 2016, PloS one.

[12]  Bernt Schiele,et al.  Comprehensive Colour Image Normalization , 1998, ECCV.

[13]  Heinrich Zollinger,et al.  Why just turquoise? Remarks on the evolution of color terms , 1984 .

[14]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Fahad Shahbaz Khan,et al.  Discriminative Color Descriptors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ko Nishino,et al.  Discovering Perceptual Attributes in a Deep Local Material Recognition Network , 2016, ArXiv.

[17]  H. S. Straight.  Color Categories in Thought and Language , 2003 .

[18]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Aleksandra Mojsilovic,et al.  A computational model for color naming and describing color composition of images , 2005, IEEE Transactions on Image Processing.

[20]  Fahad Shahbaz Khan,et al.  Portmanteau Vocabularies for Multi-Cue Image Representation , 2011, NIPS.

[21]  Cong Phuoc Huynh,et al.  A Solution of the Dichromatic Model for Multispectral Photometric Invariance , 2010, International Journal of Computer Vision.

[22]  Cordelia Schmid,et al.  Applying Color Names to Image Description , 2007, 2007 IEEE International Conference on Image Processing.

[23]  Jianke Zhu,et al.  A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration , 2014, ECCV Workshops.

[24]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Kenneth Low Kelly,et al.  Color: Universal Language and Dictionary of Names , 2018 .

[26]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[27]  Arnold W. M. Smeulders,et al.  Color Based Object Recognition , 1997, ICIAP.

[28]  Zhe Chen,et al.  MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Robert Benavente,et al.  A data set for fuzzy colour naming , 2006 .

[30]  Ying Liu,et al.  Region-Based Image Retrieval with High-Level Semantic Color Names , 2005, 11th International Multimedia Modelling Conference.

[31]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[32]  Yan Wang,et al.  On Branded Handbag Recognition , 2016, IEEE Transactions on Multimedia.

[33]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[34]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[35]  Michael Felsberg,et al.  Coloring Action Recognition in Still Images , 2013, International Journal of Computer Vision.

[36]  C. L. Hardin,et al.  Color categories in thought and language: Author index , 1997 .

[37]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Fahad Shahbaz Khan,et al.  Color attributes for object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  香川高弘.  Locating Basic Colors in the OSA Space , 1987 .

[41]  Robert Benavente,et al.  Psychophysical Measurements to Model Intercolor Regions of Color-Naming Space , 2009 .

[42]  Fahad Shahbaz Khan,et al.  An Overview of Color Name Applications in Computer Vision , 2015, CCIW.

[43]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[44]  Ming-Hsuan Yang,et al.  An Ensemble Color Model for Human Re-identification , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[45]  Lindsay W. MacDonald,et al.  Augmenting basic colour terms in english , 2016 .

[46]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[47]  M. Vanrell,et al.  Parametric fuzzy sets for automatic color naming. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.