Hierarchical modeling and adaptive clustering for real-time summarization of rush videos in trecvid'08

In this paper, our techniques used in TRECVID'08 on BBC rush summarization are described. Firstly, rush videos are hierarchical modeled using formal language description. Then, shot detection and V-unit determination are applied for video structuring; junk frames within the model are also effectively removed. Thirdly, adaptive clustering is employed to group shots into clusters to remove retakes. Then, each selected shot is ranked according to its length and sum of activity level for summarization. Competitive results have proved the effectiveness and efficiency of our techniques fully implemented in compressed-domain.

[1]  Paul Over,et al.  The trecvid 2008 BBC rushes summarization evaluation , 2008, TVS '08.

[2]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[3]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimal video summary generation , 2005, IEEE Transactions on Image Processing.

[4]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[5]  Juan Chen,et al.  Determination of Shot Boundary in MPEG Videos for TRECVID 2007 , 2007, TRECVID.

[6]  Siddheswar Ray,et al.  Determination of Number of Clusters in K-Means Clustering and Application in Colour Image Segmentation , 2000 .

[7]  Ahmed K. Elmagarmid,et al.  InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval , 2005, IEEE Transactions on Multimedia.

[8]  Chong-Wah Ngo,et al.  Automatic video summarization by graph modeling , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Michael R. Lyu,et al.  Video summarization by video structure analysis and graph optimization , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[10]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[11]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[12]  Nathalie Guyader,et al.  Video Summarization Based on Camera Motion and a Subjective Evaluation Method , 2007, EURASIP J. Image Video Process..

[13]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[14]  Yue Gao,et al.  THU-ICRC at rush summarization of TRECVID 2007 , 2007, TVS '07.

[15]  A. Murat Tekalp,et al.  Two-stage hierarchical video summary extraction to match low-level user browsing preferences , 2003, IEEE Trans. Multim..