Temporal video segmentation for real-time key frame extraction

The extensive amount of media coverage today, generates difficulties in identifying and selecting desired information. Browsing and retrieval systems become more and more necessary in order to support users with powerful and easy-to-use tools for searching, browsing and summarization of information content. The starting point for these tasks in video browsing and retrieval systems is the low level analysis of video content, especially the segmentation of video content into shots. This paper presents a fast and efficient way to detect shot changes using only the temporal distribution of macroblock types in MPEG compressed video. The notion of a dominant reference frame is introduced here. A dominant frame denotes the reference frame (I or P) used as prediction reference for most of the macroblocks from a subsequent B frame.

[1]  Kyoungro Yoon,et al.  Dissolve transition detection algorithm using spatio-temporal distribution of MPEG macro-block types (poster session) , 2000, ACM Multimedia.

[2]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[3]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[4]  Didier J. Le Gall,et al.  The MPEG video compression standard , 1991, Compcon.

[5]  Ishwar K. Sethi,et al.  MDC: a software tool for developing MPEG applications , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  Janko Calic,et al.  Temporal Segmentation of MPEG Video Streams , 2002, EURASIP J. Adv. Signal Process..

[7]  Hong-Jiang Zhang,et al.  Content-based video browsing and retrieval , 1999 .

[8]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[9]  Young-Min Kim,et al.  Fast scene change detection using direct feature extraction from MPEG compressed videos , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[11]  Janko Calic,et al.  Towards real-time shot detection in the mpeg compressed domain , 2001 .

[12]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[13]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[14]  Alan F. Smeaton,et al.  News story segmentation in the Fischlar video indexing system , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[15]  Christos Faloutsos,et al.  Compressed-domain video indexing techniques using DCT and motion vector information in MPEG video , 1997, Electronic Imaging.

[16]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[17]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..