A content-based broadcasted sports video retrieval system using multiple modalities: SportBR

In this paper, an advanced content-based broadcasted sports video retrieval system, SportBR, is proposed. Its main features include event-based sports video browsing and keyword-based sports video retrieval. The paper first defines the framework of our system, and then introduces a novel approach that integrates multimodal analysis, such as visual streams analysis, speech recognition, speech signal processing and text extraction to realize event-based video clips selection. The experimental results for sports video of world cup football games indicate that multimodal analysis is effective. The system is proved to be helpful and effective for understanding the sports video content.

[1]  Tat-Seng Chua,et al.  Retrieval of News Video Using Video Sequence Matching , 2005, 11th International Multimedia Modelling Conference.

[2]  Yoshiaki Shirai,et al.  Tracking players and a ball in soccer games , 1999, Proceedings. 1999 IEEE/SICE/RSJ. International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI'99 (Cat. No.99TH8480).

[3]  Ming-yu Chen,et al.  Multi-modal classification in digital news libraries , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[4]  Noboru Babaguchi,et al.  Personalized abstraction of broadcasted American football video by highlight selection , 2004, IEEE Transactions on Multimedia.

[5]  Riccardo Leonardi,et al.  Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  HongJiang Zhang,et al.  Automatic parsing of TV soccer programs , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[7]  Wang Wei Automatic Parsing of News Video Using Multimodal Analysis , 2001 .

[8]  D. Skellern,et al.  An open-systems approach to video on demand , 1994, IEEE Communications Magazine.

[9]  Huayong Liu,et al.  Content-based news video story segmentation and video retrieval , 2002, Other Conferences.