Automatically estimating number of scenes for rushes summarization

This paper describes our video summarization system using a model selection technique to estimate the optimal number of scenes for a summary. It uses a minimum description length as a model selection criterion and carries out two-stage estimation. First, we estimate the number of scenes in each shot, and then we estimate the number of scenes in a whole video clip. We model a set of scenes with a Gaussian mixture model, where the mixture component is assumed to represent one scene. Our system was evaluated in the TRECVID 2008 rushes summarization task, where the test video set was unedited materials provided by the BBC. Our scores were about the same as the average of all the participants for the eight evaluation measures.

[1]  Koichi Shinoda,et al.  Automatic Score Scene Detection for Baseball Video , 2008, LKR.

[2]  Zhu Liu,et al.  AT&T Research at TRECVID 2010 , 2010, TRECVID.

[3]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  Yiannis Kompatsiaris,et al.  COST292 experimental framework for TRECVID2008 , 2008, TRECVID.

[6]  Koichi Shinoda,et al.  TokyoTech's TRECVID2006 Notebook , 2006, TRECVID.

[7]  H. Akaike.  A new look at the statistical model identification , 1974 .

[8]  Chong-Wah Ngo,et al.  Rushes video summarization by object and event understanding , 2007, TVS '07.

[9]  Chong-Wah Ngo,et al.  Moving-object detection, association, and selection in home videos , 2007, IEEE Transactions on Multimedia.

[10]  Yiannis Kompatsiaris,et al.  The COST292 experimental framework for TRECVID 2007 , 2007, TRECVID.

[11]  J. Rissanen.  A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[12]  Koichi Shinoda,et al.  TokyoTech's TRECVID2007 Notebook , 2007, TRECVID.

[13]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[14]  Paul Over,et al.  The trecvid 2008 BBC rushes summarization evaluation , 2008, TVS '08.

[15]  Yung-Yu Chuang,et al.  NTU TRECVID-2007 fast rushes summarization system , 2007, TVS '07.

[16]  David C. Gibbon,et al.  AT&T Research at TRECVID 2006 , 2006, TRECVID.

[17]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.