Fuzzy Semantic Action and Color Characterization of Animation Movies in the Video Indexing Task Context

This paper presents a fuzzy statistical approach for the semantic content characterization of the animation movies. The movie action content and color properties play an important role in the understanding of the movie content, being related to the artistic signature of the author. That is why the proposed approach is carried out by analyzing several statistical parameters which are computed both from the movie shot distribution and the global color distribution. The first category of parameters represents the movie mean shot change speed, the transition ratio and the action ratio while the second category represents the color properties in terms of color intensity, warmth, saturation and color relationships. The semantic content characterizations are achieved from the low-level parameters using a fuzzy representation approach. Hence, the movie content is described in terms of action, mystery, explosivity, predominant hues, color contrasts and the color harmony schemes. Several experimental tests were performed on an animation movie database. Moreover, a classification test was conducted to prove the discriminating power of the proposed semantic descriptions for their prospective use as semantic indexes in a content-based video retrieval system.

[1]  Patrick Lambert,et al.  Fuzzy Color-Based Semantic Characterization of Animation Movies , 2006, CGIV.

[2]  Ling Guan,et al.  Retrieval for color artistry concepts , 2004, IEEE Transactions on Image Processing.

[3]  J. E. Jackson A User's Guide to Principal Components , 1991 .

[4]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[5]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[6]  J. Itten The art of color : the subjective experience and objective rationale of color , 1973 .

[7]  Alberto Del Bimbo,et al.  Semantics in Visual Information Retrieval , 1999, IEEE Multim..

[8]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  Michael J. Witbrock,et al.  Story segmentation and detection of commercials in broadcast news video , 1998, Proceedings IEEE International Forum on Research and Technology Advances in Digital Libraries -ADL'98-.

[10]  Faber Birren Principles of color;: A review of past traditions and modern theories of color harmony , 1969 .

[11]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[12]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[13]  Patrick Lambert,et al.  Improved Cut Detection for the Segmentation of Animation Movies , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[14]  D. Coquin,et al.  Color-based semantic characterization of cartoons , 2005, International Symposium on Signals, Circuits and Systems, 2005. ISSCS 2005..

[15]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[16]  J. Edward Jackson,et al.  A User's Guide to Principal Components: Jackson/User's Guide to Principal Components , 2004 .

[17]  Wolfgang Effelsberg,et al.  On the detection and recognition of television commercials , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.