All-phase motion compensated prediction in the wavelet domain for high performance video coding

This paper presents a novel framework of motion compensated prediction (MCP) techniques in the wavelet domain for high performance video coding. Our analysis reveals fundamental limitations with previous ad-hoc wavelet-based video coders from the motion accuracy point of view. We demonstrate that the phase associated with any wavelet transform carries critical information of the motion accuracy and we propose to restore the motion accuracy by considering the wavelet coefficients of the previous frame with all different phases. Our all-phase MCP approach can be viewed as predicting the wavelet coefficients from an over-complete expansion of the previous frame. Experimental results have shown that restoration of motion accuracy in the wavelet domain can dramatically improve the efficiency of MCP. The video coder (MCP-WT) built upon the MCP of wavelet coefficients has achieved 2 to 3 dB gain over existing the MPEG-2 coder at the bit rate of 1 to 9 Mbps. Moreover, MCP techniques in the wavelet domain offer a promising new ground for developing efficient scalable video coders.

[1]  Xin Li,et al.  Blind image quality assessment , 2002, Proceedings. International Conference on Image Processing.

[2]  Xin Li.  On exploiting phase constraint with image wavelet coefficients , 2002, Proceedings. International Conference on Image Processing.

[3]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[4]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[5]  Xin Li.  New directions in video coding , 2003, Visual Communications and Image Processing.

[6]  Hyun Wook Park,et al.  Motion estimation using low-band-shift method for wavelet-based moving-picture coding , 2000, IEEE Trans. Image Process..

[7]  Xin Li,et al.  Transparent and robust audio data hiding in subband domain , 2000, Proceedings International Conference on Information Technology: Coding and Computing (Cat. No.PR00540).

[8]  Michael T. Orchard,et al.  Edge directed prediction for lossless compression of natural images , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  Xin Li,et al.  High-performance resolution-scalable video coding via all-phase motion-compensated prediction of wavelet coefficients , 2002, IS&T/SPIE Electronic Imaging.

[10]  John W. Woods,et al.  Motion-compensated 3-D subband coding of video , 1999, IEEE Trans. Image Process..

[11]  William A. Pearlman,et al.  An image multiresolution representation for lossless and lossy compression , 1996, IEEE Trans. Image Process..

[12]  Xin Li.  New results of phase shifting in the wavelet space , 2003, IEEE Signal Processing Letters.

[13]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[14]  Jelena Kovacevic,et al.  Deinterlacing by successive approximation , 1997, IEEE Trans. Image Process..

[15]  Michael T. Orchard,et al.  Multiresolution framework for backward motion compensation , 1995, Electronic Imaging.

[16]  Xin Li,et al.  Efficient motion field representation in the wavelet domain , 2002, Proceedings. International Conference on Image Processing.

[17]  Xin Li,et al.  Block-based segmentation and adaptive coding for visually lossless compression of scanned documents , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[18]  Xin Li,et al.  Transparent and robust audio data hiding in cepstrum domain , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[19]  Xin Li.  A Fast and Efficient Topological Coding Algorithm for Compound Images , 2003, EURASIP J. Adv. Signal Process..

[20]  Xin Li,et al.  Rate-distortion optimized image coding via least square estimation quantization (LS-EQ) , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[21]  Michael T. Orchard,et al.  Spatially adaptive image denoising under overcomplete expansion , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[22]  Xin Li,et al.  On the study of lossless compression of computer generated compound images , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[23]  Bernd Girod,et al.  Motion-compensating prediction with fractional-pel accuracy , 1993, IEEE Trans. Commun..

[24]  Xin Li.  On exploiting geometric constraint of image wavelet coefficients , 2003, IEEE Trans. Image Process..