Split-screen dynamically accelerated video summaries

In this paper, we describe our approach to the TRECVID 2007 BBC Rushes Summarization task. Our processing is composed of several steps. First the video is segmented into shots. Then, one-second video segments are clustered into similarity classes. The most important non-redundant shots are selected such that they maximize the coverage of those similarity classes. Then shots are dynamically accelerated according to their motion activity to maximize the content per time unit. Finally they are optimally grouped by sets of four to be presented using split-screen display. The summaries produced have been evaluated in the TRECVID campaign. We present a first attempt at automating the evaluation process.

[1]  Praveen Sankuratri,et al.  Computation of Motion Activity Descriptors in Video Segments , 2002 .

[2]  Wolfgang Effelsberg,et al.  Abstracting Digital Movies Automatically , 1996, J. Vis. Commun. Image Represent..

[3]  Yihong Gong.  Summarizing Audiovisual Contents of a Video Program , 2003, EURASIP J. Adv. Signal Process..

[4]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..

[5]  SangKeun Lee,et al.  An application for interactive video abstraction , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Hugh E. Williams,et al.  RMIT University at TRECVID 2004 , 2004, TRECVID.

[7]  Paul Over,et al.  The trecvid 2007 BBC rushes summarization evaluation pilot , 2007, TVS '07.

[8]  Chong-Wah Ngo,et al.  Automatic video summarization by graph modeling , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Michael R. Lyu,et al.  Video summarization by video structure analysis and graph optimization , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[10]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[12]  Hugh E. Williams,et al.  RMIT University at TREC 2004 , 2004, TREC.

[13]  Benoit Huet,et al.  Automatic video summarization , 2006 .

[14]  Jonathan Foote,et al.  Summarizing video using non-negative similarity matrix factorization , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[15]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[16]  Xin Liu,et al.  Summarizing video by minimizing visual content redundancies , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..