Rapid Cut Detection on Compressed Video

The temporal segmentation of a video sequence is one of the most important aspects for video processing, analysis, indexing, and retrieval. Most of existing techniques to address the problem of identifying the boundary between consecutive shots have focused on the uncompressed domain. However, decoding and analyzing of a video sequence are two extremely time-consuming tasks. Since video data are usually available in compressed form, it is desirable to directly process video material without decoding. In this paper, we present a novel approach for video cut detection that works in the compressed domain. The proposed method is based on both exploiting visual features extracted from the video stream and on using a simple and fast algorithm to detect the video transitions. Experiments on a real-world video dataset with several genres show that our approach presents high accuracy relative to the state-of-the-art solutions and in a computational time that makes it suitable for online usage.

[1]  Hugo Bastos de Paula,et al.  A New Dissimilarity Measure for Cut Detection Using Bipartite Graph Matching , 2009, Int. J. Semantic Comput..

[2]  Jurandy Almeida,et al.  Comparison of video sequences with histograms of motion patterns , 2011, 2011 18th IEEE International Conference on Image Processing.

[3]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[4]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[6]  Prosenjit Bose,et al.  Feature-based cut detection with automatic threshold selection , 2006, TRECVID.

[7]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[8]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[9]  Young-Min Kim,et al.  Fast Scene Change Detection using Direct Feature Extraction from MPEG Compressed Videos , 2000, IEEE Trans. Multim..

[10]  Jurandy Almeida,et al.  Making colors worth more than a thousand words , 2008, SAC '08.

[11]  Jurandy Almeida,et al.  Robust Estimation of Camera Motion Using Optical Flow Models , 2009, ISVC.

[12]  Francisco Nivando Bezerra,et al.  Using string matching to detect video transitions , 2006, Pattern Analysis and Applications.

[13]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[14]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.

[15]  Wolfgang Effelsberg,et al.  The MoCA Project - Movie Content Analysis Research at the University of Mannheim , 1998, GI Jahrestagung.

[16]  N. J. Leite,et al.  Estimation of Camera Parameters in Video Sequences with a Large Amount of Scene Motion , 2010 .

[17]  Allan Kuchinsky,et al.  Quality is in the eye of the beholder: meeting users' requirements for Internet quality of service , 2000, CHI.