A Contour-Color-Action Approach to Automatic Classification of Several Common Video Genres

We address the issue of automatic video genre retrieval. We propose three categories of content descriptors, extracted at temporal, color and structural level. At temporal level, video content is described with visual rhythm, action content and amount of gradual transitions. Colors are globally described with statistics of color distribution, elementary hues, color properties and relationship. Finally, structural information is extracted at image level and histograms are built to describe contour segments and their relations. The proposed parameters are used to classify 7 common video genres, namely: animated movies/cartoons, commercials, documentaries, movies, music clips, news and sports. Experimental tests using several classification techniques and more than 91 hours of video footage prove the potential of these parameters to the indexing task: despite the similarity in semantic content of several genres, we achieve detection ratios ranging between 80−100%.

[1]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Ian Witten,et al.  Data Mining , 2000 .

[4]  Patrick Lambert,et al.  Fuzzy Semantic Action and Color Characterization of Animation Movies in the Video Indexing Task Context , 2006, Adaptive Multimedia Retrieval.

[5]  Mark Pawlewski,et al.  Video genre classification using dynamics , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[6]  Paul Over,et al.  High-level feature detection from video in TRECVid: a 5-year retrospective of achievements , 2009 .

[7]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[8]  Patrick Lambert,et al.  Highlighting action content in animated movies , 2009, 2009 International Symposium on Signals, Circuits and Systems.

[9]  Patrick Lambert,et al.  Improved Cut Detection for the Segmentation of Animation Movies , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[10]  Wei-Ta Chu,et al.  Action movies segmentation and summarization based on tempo analysis , 2004, MIR '04.

[11]  Patrick Lambert,et al.  A Fuzzy Color-Based Approach for Understanding Animated Movies Content in the Indexing Task , 2008, EURASIP J. Image Video Process..

[12]  Chih-Wen Su,et al.  A motion-tolerant dissolve detection algorithm , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[13]  Christoph Rasche,et al.  An Approach to the Parameterization of Structure for Fast Categorization , 2010, International Journal of Computer Vision.

[14]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Alberto Messina,et al.  Parallel neural networks for multimodal video genre classification , 2008, Multimedia Tools and Applications.