Motion-compensated layered video coding for playback scalability

We propose a multilayered video coding scheme based on motion estimation which enables a decoder to dynamically change its temporal and spatial resolution during playback. In the proposed scheme, a new motion-prediction structure with a temporal hierarchy of frames is adopted to afford temporal resolution scalability and the wavelet decomposition with a new intra-update algorithm is used to offer spatial scalability. Experimental results show that the proposed scheme exhibits a higher compression ratio than conditional replenishment schemes because it further reduces the temporal redundancy using motion estimation. Also the proposed intra-update technique enables adaptation to dynamic change of spatial resolution with the effective follow-up of prediction in the decoder while preventing the large peaks in bit rate. Therefore, the proposed scheme is expected to be effectively used in heterogeneous environments such as the Internet, ATM, and wireless networks where dynamic scalability and interoperability are required.

[1]  Martin Vetterli,et al.  Interpolative multiresolution coding of advance television with compatible subchannels , 1991, IEEE Trans. Circuits Syst. Video Technol..

[2]  Wai-tian Tan,et al.  Real time software implementation of scalable video codec , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[3]  John W. Woods,et al.  Subband Image Coding , 1990 .

[4]  John W. Woods,et al.  Subband coding of images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[5]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[6]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[7]  Bernd Girod,et al.  Scalable video transmission for the Internet , 1997, Comput. Networks ISDN Syst..

[8]  Zixiang Xiong,et al.  Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT) , 2000, IEEE Trans. Circuits Syst. Video Technol..

[9]  Steven McCanne,et al.  Low-Complexity Video Coding for Receiver-Driven Layered Multicast , 1997, IEEE J. Sel. Areas Commun..

[10]  Michael T. Orchard,et al.  A comparative study of DCT- and wavelet-based image coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[11]  Jo Yew Tham,et al.  Highly scalable wavelet-based video codec for very low bit-rate environment , 1998, IEEE J. Sel. Areas Commun..

[12]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[13]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[14]  Jörn Ostermann,et al.  Image and video coding-emerging standards and beyond , 1998, IEEE Trans. Circuits Syst. Video Technol..

[15]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[16]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[17]  Kenneth Rose,et al.  Towards optimal scalability in predictive video coding , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[18]  F. W. Mounts A video encoding system with conditional picture-element replenishment , 1969 .

[19]  Edward J. Delp,et al.  Wavelet based rate scalable video compression , 1999, IEEE Trans. Circuits Syst. Video Technol..

[20]  Mohammed Ghanbari,et al.  Two-layer coding of video signals for VBR networks , 1989, IEEE J. Sel. Areas Commun..

[21]  Michael T. Orchard,et al.  Comparative study of DCT and wavelet-based coding , 1997, Optics & Photonics.

[22]  Ya-Qin Zhang,et al.  Multiscale Video Representation Using Multiresolution Motion Compensation and Wavelet Decomposition , 1993, IEEE J. Sel. Areas Commun..

[23]  Hayder Radha,et al.  Scalable Internet video using MPEG-4 , 1999, Signal Process. Image Commun..

[24]  John W. Woods,et al.  Motion-compensated 3-D subband coding of video , 1999, IEEE Trans. Image Process..

[25]  Thomas Sikora,et al.  MPEG digital video-coding standards , 1997, IEEE Signal Process. Mag..

[26]  Wilson C. Chung,et al.  Rate-distortion-constrained subband video coding , 1999, IEEE Trans. Image Process..