Color Semantics for Image Indexing

We propose a color-based image descriptor that can be used for image indexing based on high-level semantic concepts. The descriptor is based on Kobayashi’s Color Image Scale, which is a system that includes 130 basic colors combined in 1170 three-color combinations. Each combination is labeled with one of 180 high-level semantic concepts, like ”elegant”, ”romantic”, ”provocative”, etc. Moreover, words are located in a twodimensional semantic space, and arranged into groups based on perceived similarity. From a modified approach for statistical analysis of images, involving transformations of ordinary RGBhistograms, a semantic image descriptor is derived, containing semantic information about both color combinations and single colors in the image. We show how the descriptor can be translated into different levels of semantic information, and used in indexing of multi-colored images. Intended applications are, for instance, image labeling and retrieval.

[1]  Michael H. Brill,et al.  Color appearance models , 1998 .

[2]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[3]  R. Lenz,et al.  Color emotions for multi‐colored images , 2011 .

[4]  Hun-Woo Yoo,et al.  Visual-Based Emotional Descriptor and Feedback Mechanism for Image Retrieval , 2006, J. Inf. Sci. Eng..

[5]  Shigenobu Kobayashi,et al.  Color Image Scale , 1992 .

[6]  Alberto Del Bimbo,et al.  Sensations and psychological effects in color image database , 1997, Proceedings of International Conference on Image Processing.

[7]  O. Sorkine,et al.  Color harmonization , 2006, SIGGRAPH 2006.

[8]  Sung-Bae Cho,et al.  A human-oriented image retrieval system using interactive genetic algorithm , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[9]  Alberto Del Bimbo,et al.  Image retrieval by color semantics , 1999, Multimedia Systems.

[10]  Joonwhoan Lee,et al.  Emotional Evaluation of Color Patterns Based on Rough Sets , 2007, 2007 International Symposium on Information Technology Convergence (ISITC 2007).

[11]  Yu Ying-lin,et al.  Image Retrieval by Emotional Semantics: A Study of Emotional Space and Feature Extraction , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[12]  Alberto Del Bimbo,et al.  Image Retrieval by Color Semantics with Incomplete Knowledge , 1998, J. Am. Soc. Inf. Sci..

[13]  James Ze Wang,et al.  Learning the consensus on visual quality for next-generation image management , 2007, ACM Multimedia.

[14]  Wei-Ning Wang,et al.  Image emotional semantic query based on color semantic description , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[15]  James Ze Wang,et al.  Studying Aesthetics in Photographic Images Using a Computational Approach , 2006, ECCV.

[16]  James Ze Wang,et al.  Algorithmic inferencing of aesthetics and emotion in natural images: An exposition , 2008, 2008 15th IEEE International Conference on Image Processing.

[17]  Seong-Yong Hong.  COLOR IMAGE SEMANTIC INFORMATION RETRIEVAL SYSTEM USING HUMAN SENSATION AND EMOTION , 2006 .

[18]  Shigenobu Kobayashi,et al.  The aim and method of the color image scale , 2009 .

[19]  Mark D. Fairchild,et al.  Color Appearance Models , 1997, Computer Vision, A Reference Guide.