A modified sports genre categorization framework based on close-up view pre-detection

In this paper a modified sports genre categorization framework is presented. The view type of close-up is detected as domain knowledge before categorization on large scale database. Close-up views occupy more than 1/3 of the duration of a sport match depending on its genre, and appears almost the same in various genres, which largely affected the performance of sports genre categorization. The presented framework is formed into two levels, a skin-tone based human detector are performed on all the key-frames to identify the close-up views in the first level. The second level is based on bag-of-word (BOW) model using Scale Invariant Feature Transform (SIFT) and Support Vector Machine (SVM) with close-ups detected in the first level. In training part, codebook is generated without close-ups according to the annotation; while in the testing part, the scores of close-ups pre-detected in the first level are calculated in low weights to make late fusion. Experiments on a dataset of 10 sports genres with 300 hours of videos from TV and Internet to ensure diversity have proven the improvements on the robustness and efficiency using our modified framework on sports genre categorization in both TV and Internet applications.

[1]  Qi Tian,et al.  A unified framework for semantic shot classification in sports video , 2002, IEEE Transactions on Multimedia.

[2]  Ling-yu Duan,et al.  Automatic sports genre categorization and view-type classification over large-scale dataset , 2009, ACM Multimedia.

[3]  Bingbing Ni,et al.  Building descriptive and discriminative visual codebook for large-scale image applications , 2010, Multimedia Tools and Applications.

[4]  A. Murat Tekalp,et al.  Automatic Soccer Video Analysis and Summarization , 2003, IS&T/SPIE Electronic Imaging.

[5]  Dong Wang,et al.  THU and ICRC at TRECVID 2007 , 2007, TRECVID.

[6]  Kevin Curran,et al.  A skin tone detection algorithm for an adaptive approach to steganography , 2009, Signal Process..

[7]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  David S. Doermann,et al.  Sports video classification using HMMS , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[9]  Chng Eng Siong,et al.  Automatic Sports Video Genre Classification using Pseudo-2D-HMM , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Josef Kittler,et al.  Hierarchical decision making scheme for sports video categorisation with temporal post-processing , 2004, CVPR 2004.

[11]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.