A Novel Retake Detection Using LCS and SIFT Algorithm

In this paper, a method to determine retake in rushes videos is proposed. This method first divides the video into shots, and then each shot that contains a single color, color bar or clapper board is eliminated. In each remaining shot, the similarity between consecutive frames is calculated using a SIFT matching algorithm and then converted into a string sequence. The similarity between two sequence is evaluated by the Longest Common Subsequence algorithm (LCS). This proposed SIFT - LCS based method was applied to the TRECVID BBC rushes videos of 2007 and 2008 as a competence test. The results support the notion that the proposed method provides a reasonably high degree of accuracy, and identifies the likely causes of poor accuracy for further improvements.

[1]  Keiji Yanai,et al.  Rushes summarization based on color, motion and face , 2008, TVS '08.

[2]  Nicu Sebe,et al.  Multimedia Content Analysis and Mining, International Workshop, MCAM 2007, Weihai, China, June 30 - July 1, 2007, Proceedings , 2007, MCAM.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Duy-Dinh Le,et al.  Rushes summarization using different redundancy elimination approaches , 2008, TVS '08.

[5]  Buddhadeb Sau,et al.  Locating Objects in a Sensor Grid , 2004, IWDC.

[6]  Werner Bailer,et al.  A distance measure for repeated takes of one scene , 2008, The Visual Computer.

[7]  David G. Lowe,et al.  Local feature view clustering for 3D object recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Nikolas P. Galatsanos,et al.  Video rushes summarization using spectral clustering and sequence alignment , 2008, TVS '08.

[9]  Werner Bailer,et al.  Detecting and Clustering Multiple Takes of One Scene , 2008, MMM.

[10]  Quanfu Fan,et al.  Matching slides to presentation videos using SIFT and scene background matching , 2006, MIR '06.

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Dong Xu,et al.  Near duplicate image identification with patially Aligned Pyramid Matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Nobuyuki Yagi,et al.  Video rushes summarization utilizing retake characteristics , 2008, TVS '08.

[14]  Werner Bailer.  A Comparison of Distance Measures for Clustering Video Sequences , 2008, 2008 19th International Workshop on Database and Expert Systems Applications.

[15]  Clinton DeW. Van Siclen.  Information measure of location precision , 1998, Appl. Math. Comput..

[16]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Javier Ruiz-del-Solar,et al.  Applying SIFT Descriptors to Stellar Image Matching , 2008, CIARP.

[18]  Werner Bailer,et al.  Object Re-detection Using SIFT and MPEG-7 Color Descriptors , 2007, MCAM.

[19]  José Francisco Martínez-Trinidad,et al.  Progress in Pattern Recognition, Image Analysis and Applications, 12th Iberoamericann Congress on Pattern Recognition, CIARP 2007, Valparaiso, Chile, November 13-16, 2007, Proceedings , 2008, CIARP.

[20]  Sajal K. Das,et al.  Distributed Computing - IWDC 2004, 6th International Workshop, Kolkata, India, December 27-30, 2004, Proceedings , 2004, IWDC.