Subband Coupling Aware Rate Allocation for Spatial Scalability in 3-D Wavelet Video Coding

The motion compensated temporal filtering (MCTF) technique, which is extensively used in 3-D wavelet video coding schemes nowadays, leads to signal coupling among various spatial subbands because motion alignment is introduced in the temporal filtering. Using all spatial subbands as a reference enables MCTF to fully take advantage of temporal correlation across frames but inevitably brings drifting problem in supporting spatial scalability. This paper first analyzes the signal coupling phenomenon and then proposes a quantitative model to describe signal propagation across spatial subbands during the MCTF process. The signal propagation is modeled for a single MC step based on the shifting effect of wavelet synthesis filters and then it is extended to multilevel MCTF. This model is called subband coupling aware signal propagation (SCASP) model in this paper. Based on the model, we further propose a subband coupling aware rate allocation scheme as one possible solution to the above dilemma in supporting spatial scalability. To find the optimal rate allocation among all subbands for a specified reconstruction resolution, the SCASP model is used to approximate the reconstruction process and derive the synthesis gain of each subband with regard to that reconstruction. Experimental results have fully demonstrated the advantages of our proposed rate allocation scheme in improving both objective and subjective qualities of reconstructed low-resolution video, especially at middle bit rates and high bit rates.

[1]  Zixiang Xiong,et al.  Three-dimensional embedded subband coding with optimized truncation , 2001 .

[2]  Feng Wu,et al.  Exploiting temporal correlation with adaptive block-size motion alignment for 3D wavelet coding , 2004, IS&T/SPIE Electronic Imaging.

[3]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Mihaela van der Schaar,et al.  Fully scalable 3D overcomplete wavelet video coding using adaptive motion compensated temporal filtering , 2003, Visual Communications and Image Processing.

[5]  Feng Wu,et al.  Advanced motion threading for 3D wavelet video coding , 2004, Signal Process. Image Commun..

[6]  Feng Wu,et al.  Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder , 2004 .

[7]  Gunnar Karlsson,et al.  Three dimensional sub-band coding of video , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[8]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[9]  Shipeng Li,et al.  Motion compensated lifting wavelet and its application in video coding , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[10]  David S. Taubman,et al.  Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression , 2003, IEEE Trans. Image Process..

[11]  David S. Taubman,et al.  Motion-compensated highly scalable video compression using an adaptive 3D wavelet transform based on lifting , 2001, ICIP.

[12]  Xin Li,et al.  Scalable video compression via overcomplete motion compensated wavelet coding , 2004, Signal Process. Image Commun..

[13]  David S. Taubman,et al.  Perceptual mappings for visual quality enhancement in scalable video compression , 2005, IEEE International Conference on Image Processing 2005.

[14]  Jens-Rainer Ohm,et al.  Transition filtering and optimized quantization in interframe wavelet video coding , 2003, Visual Communications and Image Processing.

[15]  Markus Flierl,et al.  Video coding with motion-compensated lifted wavelet transforms , 2004, Signal Process. Image Commun..

[16]  David S. Taubman,et al.  Spatial scalability and compression efficiency within a flexible motion compensated 3D-DWT , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[17]  John W. Woods,et al.  Bidirectional MC-EZBC with lifting implementation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Nariman Farvardin,et al.  Three-dimensional subband coding of video , 1995, IEEE Trans. Image Process..

[19]  David S. Taubman,et al.  High performance scalable image compression with EBCOT , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[20]  Aditya Mavlankar,et al.  DISTORTION PREDICTION FOR MOTION-COMPENSATED LIFTED HAAR WAVELET TRANSFORM AND ITS APPLICATION TO RATE ALLOCATION , 2000 .

[21]  Li Song,et al.  Content adaptive update for lifting-based motion-compensated temporal filtering , 2005 .

[22]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[24]  Mihaela van der Schaar,et al.  Complete-to-overcomplete discrete wavelet transforms for scalable video coding with MCTF , 2003, Visual Communications and Image Processing.

[25]  I. Daubechies,et al.  Factoring wavelet transforms into lifting steps , 1998 .

[26]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[27]  Feng Wu,et al.  Barbell lifting wavelet transform for highly scalable video coding , 2004 .

[28]  Feng Wu,et al.  Studies on spatial scalable frameworks for motion aligned 3D wavelet video coding , 2005, Visual Communications and Image Processing.

[29]  David S. Taubman,et al.  A flexible structure for fully scalable motion-compensated 3-D DWT with emphasis on the impact of spatial scalability , 2006, IEEE Transactions on Image Processing.

[30]  Zixiang Xiong,et al.  Three-dimensional wavelet coding of video with global motion compensation , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[31]  Claudia Mayer Motion compensated in-band prediction for wavelet-based spatially scalable video coding , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[32]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[33]  Feng Wu,et al.  Optimal subband rate allocation for spatial scalability in 3D wavelet video coding with motion aligned temporal filtering , 2005, Visual Communications and Image Processing.

[34]  Mihaela van der Schaar,et al.  In-band motion compensated temporal filtering , 2004, Signal Process. Image Commun..

[35]  John W. Woods,et al.  Motion-compensated 3-D subband coding of video , 1999, IEEE Trans. Image Process..

[36]  Peter Schelkens,et al.  Complete-to-overcomplete discrete wavelet transforms: theory and applications , 2005, IEEE Transactions on Signal Processing.

[37]  Hyun Wook Park,et al.  Motion estimation using low-band-shift method for wavelet-based moving-picture coding , 2000, IEEE Trans. Image Process..