Mesh-based motion models for wavelet video coding

Discrete wavelet transforms, implemented using lifting along motion trajectories, are effective and efficient temporal decomposition tools that facilitate video compression competitive with the current standards. As recently shown, however, in order that a lifting-based motion-compensated wavelet transform be equivalent to its transversal (standard) implementation, motion transformation must be invertible and motion composition between frames must be well-defined. In this paper, we discuss various mesh-based motion models that satisfy requirements of invertibility and composition, and thus are suitable for use in motion-compensated lifting-based wavelet transforms. We propose a new mesh configuration that preserves regularity of the mesh structure but provides better motion compensation compared to previously-reported mesh topologies, particularly in the proximity of image boundaries. Our results show that an improvement in motion compensation and overall compression performance is possible with only a fractional increase in motion overhead bit-rate.

[1]  Hiroshi Harashima,et al.  Motion compensation based on spatial transformations , 1994, IEEE Trans. Circuits Syst. Video Technol..

[2]  Fons A. M. L. Bruekers,et al.  New Networks for Perfect Inversion and Perfect Reconstruction , 1992, IEEE J. Sel. Areas Commun..

[3]  Henk J. A. M. Heijmans,et al.  Nonlinear multiresolution signal decomposition schemes. I. Morphological pyramids , 2000, IEEE Trans. Image Process..

[4]  David S. Taubman,et al.  Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression , 2003, IEEE Trans. Image Process..

[5]  Shih-Ta Hsiang,et al.  Embedded image coding using zeroblocks of subband/wavelet coefficients and context modeling , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[6]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[7]  Henk J. A. M. Heijmans,et al.  Nonlinear multiresolution signal decomposition schemes. II. Morphological wavelets , 2000, IEEE Trans. Image Process..

[8]  W. Sweldens The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[9]  A. Murat Tekalp,et al.  Tracking Motion and Intensity Variations Using Hierarchical 2-D Mesh Modeling for Synthetic Object Transfiguration , 1996, CVGIP Graph. Model. Image Process..

[10]  Janusz Konrad Transversal versus lifting approach to motion-compensated temporal discrete wavelet transform of image sequences: equivalence and tradeoffs , 2004, IS&T/SPIE Electronic Imaging.

[11]  Yücel Altunbasak,et al.  A fast parametric motion estimation algorithm with illumination and lens distortion correction , 2003, IEEE Trans. Image Process..