Empirical study of partial decoding for fast browsing of MPEG-2 compressed videos

Following a series of successful launch of MPEG standards on video compression, their applications reveal ever increasing needs for their content access without full decompression or in their compressed format. To this end, we further investigated a number of partial decoding schemes to address the issue of efficient content access to compressed video streams. By controlling the number of DCT coefficients involved in the inverse DCT, a number of partial decoding schemes can be designed featuring fast processing speed and low computing cost. By controlling the size of video frames, visually perceptual quality can be adjusted to suit various application including thumbnail image browsing, low resolution image processing, head tracking, skin detection, face recognition, and object segmentation etc. where full resolution frames are often not necessarily required. While achieving improved computing cost and processing speed, our work also features in: (i) reasonably good image quality for content browsing; (ii) compatibility with original MPEG-2 bit streams; and (iii) enormous potential for further application of MPEG-2 in video content management, content-based video frame retrieval, compressed video editing, and low bit-rate video communication such as those involving mobile phones and telephone networks etc. In addition, extensive experiments were carried out and reported to support our design.

[1]  J. Jiang A Generalised 1-D Approach for Parallel Computation of N × N DCT , 1998 .

[2]  Athanassios N. Skodras Direct transform to transform computation , 1999, IEEE Signal Processing Letters.

[3]  Bo Shen,et al.  Direct feature extraction from compressed images , 1996, Electronic Imaging.

[4]  John E. Hershey,et al.  Feature cueing in the discrete cosine transform domain , 1994, J. Electronic Imaging.

[5]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[6]  Gerhard Rigoll,et al.  Recognition of JPEG compressed face images based on statistical methods , 2000, Image Vis. Comput..

[7]  Robert Reeves,et al.  Texture characterization of compressed aerial images using DCT coefficients , 1997, Electronic Imaging.

[8]  Jianmin Jiang,et al.  An efficient image indexing algorithm in JPEG compressed domain , 2001, ICCE. International Conference on Consumer Electronics (IEEE Cat. No.01CH37182).

[9]  Michael Shneier,et al.  Exploiting the JPEG Compression Scheme for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..