A Fuzzy Color-Based Approach for Understanding Animated Movies Content in the Indexing Task

This paper proposes a method for detecting and analyzing the color techniques used in the animated movies. Each animated movie uses a specific color palette which makes its color distribution one major feature in analyzing the movie content. The color palette is specially tuned by the author in order to convey certain feelings or to express artistic concepts. Deriving semantic or symbolic information from the color concepts or the visual impression induced by the movie should be an ideal way of accessing its content in a content-based retrieval system. The proposed approach is carried out in two steps. The first processing step is the low-level analysis. The movie color content gets represented with several global statistical parameters computed from the movie global weighted color histogram. The second step is the symbolic representation of the movie content. The numerical parameters obtained from the first step are converted into meaningful linguistic concepts through a fuzzy system. They concern mainly the predominant hues of the movie, some of Itten's color contrasts and harmony schemes, color relationships and color richness. We use the proposed linguistic concepts to link to given animated movies according to their color techniques. In order to make the retrieval task easier, we also propose to represent color properties in a graphical manner which is similar to the color gamut representation. Several tests have been conducted on an animated movie database.

[1]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[2]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[3]  Charalambos Strouthopoulos,et al.  Adaptive color reduction , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Jianping Fan,et al.  Concept-oriented indexing of video databases: toward semantic sensitive retrieval and browsing , 2004, IEEE Transactions on Image Processing.

[5]  Bunyarit Uyyanonvara,et al.  Novel fast color reduction algorithm for time-constrained applications , 2005, J. Vis. Commun. Image Represent..

[6]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[7]  Faber Birren Principles of color;: A review of past traditions and modern theories of color harmony , 1969 .

[8]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  P. Kay,et al.  Resolving the question of color naming universals , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[10]  María Vanrell,et al.  Fuzzy Colour Naming Based on Sigmoid Membership Functions , 2004, CGIV.

[11]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[12]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[13]  Christophe Marsala,et al.  Discovering knowledge for better video indexing based on colors , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[14]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[15]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  L. Wang,et al.  Fuzzy systems are universal approximators , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[17]  Patrick Lambert,et al.  Fuzzy Semantic Action and Color Characterization of Animation Movies in the Video Indexing Task Context , 2006, Adaptive Multimedia Retrieval.

[18]  Milind R. Naphade,et al.  Extracting semantics from audio-visual content: the final frontier in multimedia retrieval , 2002, IEEE Trans. Neural Networks.

[19]  M. Pawlewski,et al.  Motion-based classification of cartoons , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[20]  Thierry Carron,et al.  Symbolic fusion of luminance-hue-chroma features for region segmentation , 1999, Pattern Recognit..

[21]  Juan Manuel Górriz,et al.  Effective Speech/Pause Discrimination Combining Noise Suppression and Fuzzy Logic Rules , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[22]  J. E. Jackson A User's Guide to Principal Components , 1991 .

[23]  Patrick Lambert,et al.  Improved Cut Detection for the Segmentation of Animation Movies , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[24]  D. Coquin,et al.  Color-based semantic characterization of cartoons , 2005, International Symposium on Signals, Circuits and Systems, 2005. ISSCS 2005..

[25]  Patrick Lambert,et al.  Color-Based Content Retrieval of Animation Movies: A Study , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[26]  J. Itten The art of color : the subjective experience and objective rationale of color , 1973 .

[27]  Alberto Del Bimbo,et al.  Semantics in Visual Information Retrieval , 1999, IEEE Multim..

[28]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[29]  Patrick Lambert,et al.  Fuzzy Color-Based Semantic Characterization of Animation Movies , 2006, CGIV.

[30]  Ling Guan,et al.  Retrieval for color artistry concepts , 2004, IEEE Transactions on Image Processing.

[31]  Bo-Yeong Kang,et al.  Semantic Indexing and Fuzzy Relevance Model in Information Retrieval , 2005, Computational Intelligence for Modelling and Prediction.

[32]  József Dombi,et al.  The approximation of piecewise linear membership functions and lukasiewicz operators , 2005, Fuzzy Sets Syst..