Scalable video coding using motion-compensated temporal filtering and intra-band wavelet based compression

Scalable video compression is a crucial task that allows for high flexibility of video streams to different networks in various applications. Current video coding techniques exploit temporal correlation using motion-compensated predictive or filtering approaches. Particularly, motion-compensated temporal filtering (MCTF) is a useful framework for scalable video compression schemes. In this paper, we propose a new scalable video coding method that combines open-loop motion-compensated prediction with an embedded intra-band wavelet based compression. Our major objective is to provide a wavelet based video coding system that circumvents the drawbacks of conventional closed-loop prediction systems, without sacrificing compression performance. To improve the coding efficiency, we adaptively weight the target bitrate according to the temporal frame position in the temporal pyramid. Comparisons with state-of-the-art scalable video coding solutions confirm an overall coding efficiency gain of the proposed method specially at high bitrates.

[1]  John W. Woods,et al.  Embedded video coding using invertible motion compensated 3-D subband/wavelet filter bank , 2001, Signal Process. Image Commun..

[2]  Mihaela van der Schaar,et al.  In-band motion compensated temporal filtering , 2004, Signal Process. Image Commun..

[3]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[4]  Shih-Ta Hsiang,et al.  Embedded image coding using zeroblocks of subband/wavelet coefficients and context modeling , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[5]  Michel Barlaud,et al.  A model-based motion compensated video coder with JPEG2000 compatibility , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Feng Wu,et al.  A Cross-Resolution Leaky Prediction Scheme for In-Band Wavelet Video Coding With Spatial Scalability , 2008, IEEE Trans. Circuits Syst. Video Technol..

[8]  David S. Taubman,et al.  High performance scalable image compression with EBCOT. , 2000, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[9]  Jo Yew Tham,et al.  Highly scalable wavelet-based video codec for very low bit-rate environment , 1998, IEEE J. Sel. Areas Commun..

[10]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[12]  Peter Schelkens,et al.  Comparison between "t+2D" and "2D+t" architectures with advanced motion compensated temporal filtering , 2004 .

[13]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[14]  David S. Taubman,et al.  Highly scalable video compression using a lifting-based 3D wavelet transform with deformable mesh motion compensation , 2002, ICIP.

[15]  Feng Wu,et al.  Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder , 2004 .

[16]  John W. Woods,et al.  Enhanced MC-EZBC Scalable Video Coder , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  M. Wien,et al.  The Scalable Video Coding Extension of the H.264/AVC Standard [Standards in a Nutshell] , 2008, IEEE Signal Processing Magazine.

[18]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[19]  Zixiang Xiong,et al.  Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT) , 2000, IEEE Trans. Circuits Syst. Video Technol..

[20]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[21]  Hsueh-Ming Hang,et al.  Motion information scalability for MC-EZBC , 2004, Signal Process. Image Commun..

[22]  Peter Schelkens,et al.  Wavelet Coding of Volumetric Medical Datasets , 2003, IEEE Trans. Medical Imaging.

[23]  John W. Woods,et al.  Bidirectional MC-EZBC with lifting implementation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Aous Thabit Naman,et al.  JPEG2000-Based Scalable Interactive Video (JSIV) With Motion Compensation , 2011, IEEE Transactions on Image Processing.

[25]  William A. Pearlman,et al.  Three-dimensional subband coding of video using the zero-tree method , 1996, Other Conferences.

[26]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[27]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[28]  Paul Dan Cristea,et al.  Wavelet image compression - the quadtree coding approach , 1999, IEEE Transactions on Information Technology in Biomedicine.