Efficient key-frame extraction and video analysis

Content-based video indexing and retrieval has its foundations in the analyses of the prime video temporal structures. Consequently, technologies for video segmentation and key-frame extraction have become crucial for the development of advanced digital video systems. Conventional algorithms for video partitioning and key-frame extraction are mainly implemented autonomously. By focusing the analysis on compressed video features, this paper introduces a real-time algorithm for scene change detection and key-frame extraction that generates frame difference metrics by analysing the statistics of the macro-block features extracted from an MPEG compressed stream. The key-frame extraction method is implemented using difference metrics in curve simplification by means of a discrete contour evolution algorithm. This approach resulted in a fast and robust algorithm. Results of computer simulations are reported.

[1]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[2]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[3]  Janko Calic,et al.  Towards real-time shot detection in the mpeg compressed domain , 2001 .

[4]  Irena Koprinska,et al.  Detecting and classifying video shot boundaries in MPEG compressed sequences , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[5]  Longin Jan Latecki,et al.  Convexity Rule for Shape Decomposition Based on Discrete Contour Evolution , 1999, Comput. Vis. Image Underst..

[6]  Joan L. Mitchell,et al.  MPEG Video Compression Standard , 1996, Springer US.

[7]  Christos Faloutsos,et al.  Compressed-domain video indexing techniques using DCT and motion vector information in MPEG video , 1997, Electronic Imaging.

[8]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[9]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[10]  Young-Min Kim,et al.  Fast Scene Change Detection using Direct Feature Extraction from MPEG Compressed Videos , 2000, IEEE Trans. Multim..

[11]  Janko Calic,et al.  Temporal Segmentation of MPEG Video Streams , 2002, EURASIP J. Adv. Signal Process..

[12]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[13]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[14]  Ishwar K. Sethi,et al.  MDC: a software tool for developing MPEG applications , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[15]  Hong-Jiang Zhang,et al.  Content-based video browsing and retrieval , 1999 .

[16]  Ruben Gonzalez,et al.  Hypermedia Data Modeling, Coding, And Semiotics , 1997, Proceedings of the IEEE.