Classifying documentary, music, news and animated genres with temporal, color and contour information

In this paper we address the issue of automatic video genre classification and propose three categories of content descriptors. At temporal level, video content is described in terms of visual rhythm, action content and amount of gradual transitions. Further, colors are globally described using statistics of color distribution, elementary hues, color properties and relationship. Finally, structural information is extracted at image level and histograms are built to describe overall contour features and their relations. The proposed descriptors were used to classify four of the most common video genres, thus: animated movies, documentaries, music clips and newscast. Experimental tests conducted on more than 67 hours of video footage prove the high efficiency of these features. We achieve an average correct detection ratio up to 95%, while the precision and recall ratios are up to 98% and 100%, respectively.

[1]  Kuo-Chin Fan,et al.  A motion-tolerant dissolve detection algorithm , 2005, IEEE Transactions on Multimedia.

[2]  Mark Pawlewski,et al.  Video genre classification using dynamics , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[3]  Patrick Lambert,et al.  Improved Cut Detection for the Segmentation of Animation Movies , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[4]  Patrick Lambert,et al.  Highlighting action content in animated movies , 2009, 2009 International Symposium on Signals, Circuits and Systems.

[5]  Paul Over,et al.  High-level feature detection from video in TRECVid: a 5-year retrospective of achievements , 2009 .

[6]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[7]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.

[8]  Alberto Messina,et al.  Parallel neural networks for multimodal video genre classification , 2008, Multimedia Tools and Applications.

[9]  Patrick Lambert,et al.  A Fuzzy Color-Based Approach for Understanding Animated Movies Content in the Indexing Task , 2008, EURASIP J. Image Video Process..

[10]  Christoph Rasche,et al.  An Approach to the Parameterization of Structure for Fast Categorization , 2010, International Journal of Computer Vision.

[11]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).