Animated movie genre detection using symbolic fusion of text and image descriptors

This paper addresses the automatic movie genre classification in the specific case of animated movies. Two types of information are used. The first one are movie synopsis. For each genre, a symbolic representation of a thematic intensity is extracted from synopsis. Addressed visually, movie content is described with symbolic representations of different mid-level color and activity features. A fusion between the text and image descriptions is performed using a set of symbolic rules conveying human expertise. The approach is tested on a set of 107 animated movies in order to estimate their ”drama” character. It is observed that the text-image fusion achieves a precision up to 78% and a recall of 44%.

[1]  Laurent Foulloy,et al.  The aggregation of complementary information via fuzzy sensors , 1996 .

[2]  Ponnuthurai N. Suganthan,et al.  An Accumulation Algorithm for Video Shot Boundary Detection , 2004, Multimedia Tools and Applications.

[3]  Hussein M. Abdel-Wahab,et al.  Adaptive Key Frames Selection Algorithms for Summarizing Video Data , 2002, JCIS.

[4]  Thomas Sikora,et al.  Cartoon-recognition using video & audio descriptors , 2005, 2005 13th European Signal Processing Conference.

[5]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  M. Pawlewski,et al.  Motion-based classification of cartoons , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[7]  Alberto Messina,et al.  Parallel neural networks for multimodal video genre classification , 2008, Multimedia Tools and Applications.

[8]  Patrick Lambert,et al.  Fuzzy Semantic Action and Color Characterization of Animation Movies in the Video Indexing Task Context , 2006, Adaptive Multimedia Retrieval.

[9]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.

[10]  James M. Rehg,et al.  Movie genre classification via scene categorization , 2010, ACM Multimedia.