Motion Compensation Via Redundant-Wavelet Multihypothesis

Multihypothesis motion compensation has been widely used in video coding with previous attention focused on techniques employing predictions that are diverse spatially or temporally. In this paper, the multihypothesis concept is extended into the transform domain by using a redundant wavelet transform to produce multiple predictions that are diverse in transform phase. The corresponding multiple-phase inverse transform implicitly combines the phase-diverse predictions into a single spatial-domain prediction for motion compensation. The performance advantage of this redundant-wavelet-multihypothesis approach is investigated analytically, invoking the fact that the multiple-phase inverse involves a projection that significantly reduces the power of a dense-motion residual modeled as additive noise. The analysis shows that redundant-wavelet multihypothesis is capable of up to a 7-dB reduction in prediction-residual variance over an equivalent single-phase, single-hypothesis approach. Experimental results substantiate the performance advantage for a block-based implementation

[1]  Peter Schelkens,et al.  Wavelet-based fine granularity scalable video coding with in-band prediction , 2002 .

[2]  Markus Flierl,et al.  Rate-constrained multihypothesis prediction for motion-compensated video compression , 2002, IEEE Trans. Circuits Syst. Video Technol..

[3]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[4]  Bernd Girod,et al.  Motion-compensating prediction with fractional-pel accuracy , 1993, IEEE Trans. Commun..

[5]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[6]  S. Mallat A wavelet tour of signal processing , 1998 .

[7]  P. Dutilleux An Implementation of the “algorithme à trous” to Compute the Wavelet Transform , 1989 .

[8]  Thomas Wiegand,et al.  Long-term memory motion-compensated prediction , 1999, IEEE Trans. Circuits Syst. Video Technol..

[9]  Hyun Wook Park,et al.  Adaptive 3-D median filtering for restoration of an image sequence corrupted by impulse noise , 2001, Signal Process. Image Commun..

[10]  M. Ohta,et al.  An overlapped block motion compensation for high quality motion picture coding , 1992, [Proceedings] 1992 IEEE International Symposium on Circuits and Systems.

[11]  Richard Kronland-Martinet,et al.  A real-time algorithm for signal analysis with the help of the wavelet transform , 1989 .

[12]  Xin Li,et al.  High-performance resolution-scalable video coding via all-phase motion-compensated prediction of wavelet coefficients , 2002, IS&T/SPIE Electronic Imaging.

[13]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[14]  Bernd Girod,et al.  The Efficiency of Motion-Compensating Prediction for Hybrid Coding of Video Sequences , 1987, IEEE J. Sel. Areas Commun..

[15]  Yonghui Wang,et al.  Multihypothesis motion compensation in the redundant wavelet domain , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Peter Schelkens,et al.  WAVELET-BASED FULLY-SCALABLE VIDEO CODING WITH IN-BAND PREDICTION , 2002 .

[17]  Peter Schelkens,et al.  Scalable wavelet video-coding with in-band prediction - implementation and experimental results , 2002, Proceedings. International Conference on Image Processing.

[18]  Pierre Moulin,et al.  Multiscale modeling and estimation of motion fields for video coding , 1997, IEEE Trans. Image Process..

[19]  James E. Fowler QccPack: an open-source software library for quantization, compression, and coding , 2000, Proceedings DCC 2000. Data Compression Conference.

[20]  Yonghui Wang,et al.  Mesh-based motion estimation and compensation in the wavelet domain using a redundant transform , 2002, Proceedings. International Conference on Image Processing.

[21]  Bernd Girod,et al.  Efficiency analysis of multihypothesis motion-compensated prediction for video coding , 2000, IEEE Trans. Image Process..

[22]  J. E. Fowler,et al.  The redundant discrete wavelet transform and additive noise , 2005, IEEE Signal Processing Letters.

[23]  James E. Fowler,et al.  Analysis of redundant-wavelet multihypothesis for motion compensation , 2006, Data Compression Conference (DCC'06).

[24]  Hyun Wook Park,et al.  Motion estimation using low-band-shift method for wavelet-based moving-picture coding , 2000, IEEE Trans. Image Process..

[25]  Xin Li,et al.  All-phase motion compensated prediction in the wavelet domain for high performance video coding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[26]  Yonghui Wang,et al.  3-D video coding with redundant-wavelet multihypothesis , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..

[28]  Eero P. Simoncelli,et al.  Differentiation of discrete multidimensional signals , 2004, IEEE Transactions on Image Processing.

[29]  James E. Fowler QccPack: an open-source software library for quantization, compression, and coding , 2000, SPIE Optics + Photonics.

[30]  Hyun Wook Park,et al.  Wavelet-based moving-picture coding using shift-invariant motion estimation in wavelet domain , 2001, Signal Process. Image Commun..

[31]  Ph. Tchamitchian,et al.  Wavelets: Time-Frequency Methods and Phase Space , 1992 .

[32]  James E. Fowler,et al.  Video coding with MC-EZBC and redundant-wavelet multihypothesis , 2005, IEEE International Conference on Image Processing 2005.

[33]  Gary J. Sullivan,et al.  Multi-hypothesis motion compensation for low bit-rate video coding , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.