Temporal Segmentation of MPEG Video Streams

Many algorithms for temporal video partitioning rely on the analysis of uncompressed video features. Since the information relevant to the partitioning process can be extracted directly from the MPEG compressed stream, higher efficiency can be achieved utilizing information from the MPEG compressed domain. This paper introduces a real-time algorithm for scene change detection that analyses the statistics of the macroblock features extracted directly from the MPEG stream. A method for extraction of the continuous frame difference that transforms the 3D video stream into a 1D curve is presented. This transform is then further employed to extract temporal units within the analysed video sequence. Results of computer simulations are reported.

[1]  Hong-Jiang Zhang,et al.  Content-based video browsing and retrieval , 1999 .

[2]  F. Arman,et al.  A Statistical Approach to Scene Change Detection , 1995 .

[3]  Young-Min Kim,et al.  Fast scene change detection using direct feature extraction from MPEG compressed videos , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[5]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[6]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[7]  Ishwar K. Sethi,et al.  MDC: a software tool for developing MPEG applications , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[9]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[10]  Arding Hsu,et al.  Feature management for large video databases , 1993, Electronic Imaging.

[11]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[12]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[13]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[14]  Nilesh V. Patel,et al.  Statistical approach to scene change detection , 1995, Electronic Imaging.

[15]  Christos Faloutsos,et al.  Compressed-domain video indexing techniques using DCT and motion vector information in MPEG video , 1997, Electronic Imaging.

[16]  Janko Calic,et al.  Efficient key-frame extraction and video analysis , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[17]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[18]  Didier J. Le Gall,et al.  The MPEG video compression standard , 1991, Compcon.