Flexible soccer video summarization in compressed domain

Due to vast amount of archived video content around the world, flexible and efficient soccer video summarization systems are required. In this paper, we present an efficient yet accurate framework for soccer video summarization in encoded MPEG videos. A novel logo transition detection method based on spatio-temporal template is proposed. Semantic features along with replays and audio activity are exploited for summary generation based on user defined parameters and rank based video summarization scheme. We conducted objective and subjective evaluations on ten hours of broadcast soccer videos. Rank correlation measures are used for objective video summary evaluation. Our system achieved satisfactory accuracy and speed of nearly two times faster than real-time.

[1]  Hossam M. Zawbaa,et al.  Soccer video summarization using enhanced logo detection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Yi-Ping Phoebe Chen,et al.  Highlights for more complete sports video summarization , 2004, IEEE MultiMedia.

[3]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[4]  Yi-Hua Zhou,et al.  An SVM-based soccer video shot classification , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[5]  Qingming Huang,et al.  Highlight Summarization in Sports Video Based on Replay Detection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[6]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[7]  Hamid Reza Pourreza,et al.  An Effective Slow-Motion Detection Approach for Compressed Soccer Videos , 2012 .

[8]  Hamid Reza Pourreza,et al.  Robust GME in encoded MPEG video , 2011, MoMM '11.

[9]  Aboul Ella Hassanien,et al.  SVM-based soccer video summarization system , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.

[10]  Keiichiro Hoashi,et al.  Shot Boundary Determination on MPEC Compressed Domain and Story Segmentation Experiments for TRECVID 2003 , 2003, TRECVID.

[11]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[12]  Qingming Huang,et al.  Summarization in Soccer Video based on Goalmouth Detection , 2006 .

[13]  Changsheng Xu,et al.  A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video , 2008, IEEE Transactions on Multimedia.

[14]  Larry S. Davis,et al.  A Logic Framework for Sports Video Summarization Using Text-Based Semantic Annotation , 2008, 2008 Third International Workshop on Semantic Media Adaptation and Personalization.

[15]  Dian Tjondronegoro,et al.  Integrating Highlights for More Complete Sports Video Summarization , 2004 .

[16]  Noel E. O'Connor,et al.  Event detection in field sports video using audio-visual features and a support vector Machine , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Riccardo Leonardi,et al.  Semantic Indexing of Multimedia Documents , 2002, IEEE Multim..

[18]  Peter J. L. van Beek,et al.  Detection of slow-motion replay segments in sports video for highlights generation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[19]  Wei Hu,et al.  A Reliable Logo and Replay Detector for Sports Video , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[20]  Yifan Zhang,et al.  Highlight ranking for sports video browsing , 2005, MULTIMEDIA '05.

[21]  Thomas Sikora,et al.  Trends and Perspectives in Image and Video Coding , 2005, Proceedings of the IEEE.

[22]  Bo Han,et al.  Enhanced Sports Video Shot Boundary Detection Based on Middle Level Features and a Unified Model , 2007, IEEE Transactions on Consumer Electronics.

[23]  Qingming Huang,et al.  Replay Detection Based on Semi-automatic Logo Template Sequence Extraction in Sports Video , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[24]  Baoxin Li,et al.  A general framework for sports video summarization with its application to soccer , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[25]  Qingming Huang,et al.  A framework for flexible summarization of racquet sports video using multiple modalities , 2009, Comput. Vis. Image Underst..

[26]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[27]  Jianhua Li,et al.  A Novel Shot Edge Detection Algorithm based on Chi-square Histogram and Macro-block Statistics , 2008, 2008 International Symposium on Information Science and Engineering.

[28]  C. Rosenberger,et al.  Comparative study of metrics for evaluation of object localisation by bounding boxes. , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).