MPEG-2 Compressed-Domain Algorithms for Video Analysis

This paper presents new algorithms for extracting metadata from video sequences in the MPEG-2 compressed domain. Three algorithms for efficient low-level metadata extraction in preprocessing stages are described. The first algorithm detects camera motion using the motion vector field of an MPEG-2 video. The second method extends the idea of motion detection to a limited region of interest, yielding an efficient algorithm to track objects inside video sequences. The third algorithm performs a cut detection using macroblock types and motion vectors.

[1]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gozde Bozdagi Akar,et al.  Preprocessing tool for compressed video editing , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[3]  Thomas S. Huang,et al.  Fast camera motion analysis in MPEG domain , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[4]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[5]  Christos Faloutsos,et al.  Feature Normalization for Video Indexing and Retrieval , 1996 .

[6]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[7]  Takeo Kanade,et al.  Rotation Invariant Neural Network-Based Face Detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[9]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[10]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[11]  Janko Calic,et al.  Towards real-time shot detection in the mpeg compressed domain , 2001 .

[12]  Dorin Comaniciu,et al.  Mean shift analysis and applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Javed I. Khan,et al.  Motion based object tracking in MPEG-2 stream for perceptual region discriminating rate transcoding , 2001, MULTIMEDIA '01.

[14]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[15]  Aljoscha Smolic,et al.  Low-complexity global motion estimation from P-frame motion vectors for MPEG-7 applications , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[16]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[17]  Edward J. Delp,et al.  A fast algorithm for video parsing using MPEG compressed sequences , 1995, Proceedings., International Conference on Image Processing.

[18]  Boon-Lock Yeo,et al.  On the extraction of DC sequence from MPEG compressed video , 1995, Proceedings., International Conference on Image Processing.

[19]  Shih-Fu Chang,et al.  Manipulation and Compositing of MC-DCT Compressed Video , 1995, IEEE J. Sel. Areas Commun..

[20]  Shih-Fu Chang,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997, IEEE Trans. Circuits Syst. Video Technol..

[21]  Chandrika Kamath,et al.  Block Matching for Object Tracking , 2003 .

[22]  Konan Minato-ku.  CAMERA MOTION ESTIMATION USING FEATURE POINTS IN MPEG COMPRESSED DOMAIN , 2000 .

[23]  Azriel Rosenfeld,et al.  Compressed Domain Video Segmentation , 1996 .