An automatic system for real-time video-genres detection using high-level-descriptors and a set of classifiers

We present a new approach for classifying MPEG-2 video sequences as dasiacartoonpsila, dasiacommercialpsila, dasiamusicpsila, dasianewspsila or dasiasportpsila by analyzing specific, high-level audio-visual features of consecutive frames in real-time. This is part of the well-known video-genre-classification problem, where popular TV-broadcast genres are studied. Such applications have also been discussed in the context of MPEG-7 [1]. In our method the extracted features are logically combined using a set of classifiers to produce a reliable recognition. The results demonstrate a high identification rate based on a large representative collection of 100 video sequences (20 sequences per genre) gathered from free digital TV-broadcasting in Europe.

[1]  Thomas Sikora,et al.  Recognizing Commercials in Real-Time using Three Visual Descriptors and a Decision-Tree , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[2]  Arjen P. de Vries,et al.  Detecting cartoons: a case study in automatic video-genre classification , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[3]  Noel E. O'Connor,et al.  Audio and video processing for automatic TV advertisement detection , 2001 .

[4]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[5]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.

[6]  Thomas Sikora,et al.  Extensible Platform for Multimedia Analysis (XPMA) , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[7]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Zhu Liu,et al.  Classification TV programs based on audio information using hidden Markov model , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[9]  Noel Murphy,et al.  Automatic TV advertisement detection from MPEG bitstream , 2002, Pattern Recognit..

[10]  Thomas Sikora,et al.  Cartoon-recognition using video & audio descriptors , 2005, 2005 13th European Signal Processing Conference.

[11]  Ba Tu Truong,et al.  Automatic genre identification for content-based video categorization , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[12]  M. Pawlewski,et al.  Motion-based classification of cartoons , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[13]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[14]  Yongmin Li,et al.  Video classification using spatial-temporal features and PCA , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[15]  John S. D. Mason,et al.  Video genre verification using both acoustic and visual modes , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..