Automatically Discovering Unknown Short Video Repeats

In this paper we propose an efficient and robust method to automatically discover unknown short video repeats with arbitrary lengths, from a few seconds to a few minutes, from large video databases or streams. The proposed method consists of non-uniform video segmentation, self-similarity analysis, locality sensitive hashing, and video repeat boundary refinement. In order to achieve efficient and accurate processing feature extraction and similarity measure are performed at two levels: video frame level and video segment level. Experiments are conducted on 12 hour CNN/ABC news, and 12 hour documentaries (Discovery and National Geography), high recall and precision of 98% - 99% have been achieved. Video repeats' boundaries can be located within several frames. Applying the proposed method for video structure analysis is also briefly discussed.

[1]  Cormac Herley,et al.  Extracting repeats from media streams , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  J. David Schaffer,et al.  Evolvable visual commercial detector , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Baoxin Li,et al.  Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transitions , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Qi Tian,et al.  A color fingerprint of video shot for content identification , 2004, MULTIMEDIA '04.

[5]  John M. Gauch,et al.  Real time repeated video sequence identification , 2004, Comput. Vis. Image Underst..

[6]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[7]  Sen-Ching S. Cheung,et al.  Mining arbitrary-length repeated patterns in television broadcast , 2005, IEEE International Conference on Image Processing 2005.

[8]  Jonathan Foote,et al.  Scene boundary detection via video self-similarity analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[9]  Wei Xiong,et al.  Query by video clip , 1999, Multimedia Systems.

[10]  Wolfgang Effelsberg,et al.  On the detection and recognition of television commercials , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[11]  Qi Tian,et al.  Efficient Short Video Repeat Identification With Application to News Video Structure Analysis , 2007, IEEE Transactions on Multimedia.