Semantic Shot Classification in Soccer Videos via Playfield Ratio and Object Size Considerations

This paper presents a semantic shot classification algorithm for soccer videos. Generally, each shot within a match video is assigned either a far or close up-view class label. Initially, the playfield region for each frame within a shot is identified through low-level color image processing. An additional property is then considered namely the largest object size overlapping the playfield. Class labels are then accordingly assigned to each frame based on carefully constructed rule-sets. Majority voting is finally performed where the dominant frame labels within each shot is used as the ultimate class label. Experiments conducted on six soccer matches with varying camera shooting styles have been very promising, where the additional consideration of largest object size is able to significantly reduce the number of misclassifications.

[1]  Xueming Qian,et al.  HMM based soccer video event detection using enhanced mid-level semantic , 2011, Multimedia Tools and Applications.

[2]  Shih-Fu Chang,et al.  Algorithms and system for segmentation and structure analysis in soccer video , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[3]  Chung-Lin Huang,et al.  Semantic analysis of soccer video using dynamic Bayesian network , 2006, IEEE Transactions on Multimedia.

[4]  Alfian Abdul Halin,et al.  Event Detection in Soccer Videos through Text-based Localization and Audiovisual Analysis , 2012 .

[5]  J. Todd Book Review: Digital image processing (second edition). By R. C. Gonzalez and P. Wintz, Addison-Wesley, 1987. 503 pp. Price: £29.95. (ISBN 0-201-11026-1) , 1988 .

[6]  Wanqing Li,et al.  Soccer Video Shot Classification Based on Color Characterization Using Dominant Sets Clustering , 2009, PCM.

[7]  K. Plataniotis,et al.  Color Image Processing and Applications , 2000 .

[8]  Zhicheng Wei,et al.  A Novel Soccer Video Summarization Model Based on Video Time Density Function , 2012 .

[9]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[10]  Min Chen,et al.  A decision tree-based multimodal data mining framework for soccer goal detection , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  Changsheng Xu,et al.  A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video , 2008, IEEE Transactions on Multimedia.

[12]  Larry S. Davis,et al.  A Logic Framework for Sports Video Summarization Using Text-Based Semantic Annotation , 2008, 2008 Third International Workshop on Semantic Media Adaptation and Personalization.

[13]  Kim Hyun Sook Automatic Classification of Offensive Patterns for Soccer Game Highlights Using Neural Networks , 2002 .

[14]  Min Chen,et al.  Semantic event detection via multimodal data mining , 2006, IEEE Signal Processing Magazine.

[15]  Xueming Qian,et al.  Soccer Video Event Detection by Fusing Middle Level Visual Semantics of an Event Clip , 2010, PCM.

[16]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Mahmood Fathy,et al.  A Low Cost Algorithm for Expected Goal Events Detection in Broadcast Soccer Video , 2010, J. Digit. Content Technol. its Appl..