A modification of retake detection using simple signature and LCS algorithm

Rushes videos consist of two types of content: the useless content and the redundant content (retakes). Then, automatic retake detection is more challenging due to the difficulty of eliminating repetitive takes, that are usually have different lengths and motion patterns. To overcome this challenge, previous approaches represent video segments using a longer string which is converted from SIFT matching, or a combination of different features. However, these require a large computational time and do not assist in improving a performance. In this work, we introduce a simple signature (global feature) to represent video segments because of its simplicity and effectiveness. The similarity between each pair of signature sequences was determined by using the Longest Common Subsequence algorithm (LCS). A simple retake detection was then used to detect a retake. This proposed was applied to the TRECVID BBC Rushed 2007 and 2008. The results showed that using a simple signature provides a high degree of accuracy, and reduces a computation time in feature extraction and LCS matching.

[1]  Ling Shao,et al.  Learning Short Binary Codes for Large-scale Image Retrieval , 2017, IEEE Transactions on Image Processing.

[2]  Xiaoru Yuan,et al.  Comparative visualization of vector field ensembles based on longest common subsequence , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[3]  S. Satoh,et al.  Sequence Matching Based Automatic Retake Detection Framework for Rushes Video , 2015 .

[4]  Eckehard G. Steinbach,et al.  Camera-based indoor positioning using scalable streaming of compressed binary image signatures , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[5]  Qi Tian,et al.  Visual word expansion and BSIFT verification for large-scale image search , 2013, Multimedia Systems.

[6]  Duy-Dinh Le,et al.  A Classification-Based Approach for Retake and Scene Detection in Rushes Video , 2013, ICONIP.

[7]  Shin'ichi Satoh,et al.  Ultrahigh-Speed TV Commercial Detection, Extraction, and Matching , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Sheau-Farn Max Liang,et al.  Assessing suitability of similarity coefficients in measuring human mental models , 2012, 2012 Southeast Asian Network of Ergonomics Societies Conference (SEANES).

[9]  Duy-Dinh Le,et al.  Improving Retake Detection by Adding Motion Feature , 2011, ICIAP.

[10]  Shin'ichi Satoh,et al.  Commercial film detection and identification based on a dual-stage temporal recurrence hashing algorithm , 2010, VLS-MCMR '10.

[11]  Bernard Mérialdo,et al.  Rushes video summarization and evaluation , 2009, Multimedia Tools and Applications.

[12]  Werner Bailer,et al.  A distance measure for repeated takes of one scene , 2008, The Visual Computer.

[13]  Paul Over,et al.  The trecvid 2008 BBC rushes summarization evaluation , 2008, TVS '08.

[14]  Frédéric Truchetet,et al.  Fast image retrieval using hierarchical binary signatures , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[15]  Xiaofang Zhou,et al.  Video matching using binary signature , 2005, 2005 International Symposium on Intelligent Signal Processing and Communication Systems.