A Logic Framework for Sports Video Summarization Using Text-Based Semantic Annotation

Detection of semantic events in sports videos is an essential step towards video summarization. A large volume of research has been conducted for automatic semantic event detection and summarization of sports videos. In this paper we present a novel sports video summarization framework using a combination of text, video and logic analysis. Parse trees are used to analyze structured and free-style text webcasting of sports games and extract the game¿s semantic events, such as goals and penalties in soccer games. Semantic events are then hierarchically arranged before being passed to a logic processing engine. The logic engine receives the summary preferences from the user and subsequently parses the event hierarchy to generate the game¿s summary according to the user¿s preferences. The proposed framework was applied to both soccer and basketball videos. We achieved an average accuracy of 98.6% and 100% on soccer and basketball videos, respectively.

[1]  Yu Hen Hu,et al.  Event-Based Segmentation of Sports Video Using Motion Entropy , 2007, ISM 2007.

[2]  Changsheng Xu,et al.  Semantic Event Extraction from Basketball Games using Multi-Modal Analysis , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[3]  Yu Hen Hu,et al.  Event-Based Segmentation of Sports Video Using Motion Entropy , 2007, Ninth IEEE International Symposium on Multimedia (ISM 2007).

[4]  Changsheng Xu,et al.  Live sports event detection based on broadcast video and web-casting text , 2006, MM '06.

[5]  Amnon Meyers,et al.  Multi-Pass Multi-Strategy NLP , 2003 .

[6]  Shih-Fu Chang,et al.  Event detection in baseball video using superimposed caption recognition , 2002, MULTIMEDIA '02.

[7]  Changsheng Xu,et al.  A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video , 2008, IEEE Transactions on Multimedia.

[8]  Patrick Bouthemy,et al.  Unsupervised soccer video abstraction based on pitch, dominant color and camera motion analysis , 2004, MULTIMEDIA '04.

[9]  Wen Gao,et al.  Exciting event detection in broadcast soccer video with mid-level description and incremental learning , 2005, MULTIMEDIA '05.

[10]  Yi-Ping Phoebe Chen,et al.  The power of play-break for automatic detection and browsing of self-consumable sport video highlights , 2004, MIR '04.

[11]  Qingming Huang,et al.  Highlight Summarization in Sports Video Based on Replay Detection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[12]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[13]  Noboru Babaguchi,et al.  Intermodal collaboration: a strategy for semantic content analysis for broadcasted sports video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).