Multiscale Video Representation Using Multiresolution Motion Compensation and Wavelet Decomposition

A multiscale video representation using wavelet decomposition and variable-block-size multiresolution motion estimation (MRME) is presented. The multiresolution/multifrequency nature of the discrete wavelet transform makes it an ideal tool for representing video sources with different resolutions and scan formats. The proposed variable-block-size MRME scheme utilizes motion correlation among different scaled subbands and adapts to their importance at different layers. The algorithm is well suited for interframe HDTV coding applications and facilitates conversions and interactions between different video coding standards. Four scenarios for the proposed motion-compensated coding schemes are compared. A pel-recursive motion estimation scheme is implemented in a multiresolution form. The proposed approach appears suitable for the broadcast environment where various standards may coexist simultaneously. >

[1]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[2]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[3]  Jelena Kovacevic,et al.  Perfect Reconstruction Filter Banks for Hdtv Representation and Coding* , 1989 .

[4]  Martin Vetterli,et al.  Interpolative multiresolution coding of advance television with compatible subchannels , 1991, IEEE Trans. Circuits Syst. Video Technol..

[5]  Edward H. Adelson,et al.  Orthogonal Pyramid Transforms For Image Coding. , 1987, Other Conferences.

[6]  Peter J. Burt,et al.  Multiresolution Techniques For Image Representation, Analysis, And 'Smart' Transmission , 1989, Other Conferences.

[7]  Martin Vetterli,et al.  Wavelets and filter banks: relationships and new results , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[8]  M. Vetterli Multi-dimensional sub-band coding: Some theory and algorithms , 1984 .

[9]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[10]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[11]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[12]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[13]  William R. Zettler,et al.  Application of compactly supported wavelets to image compression , 1990, Other Conferences.

[14]  Sohail Zafar,et al.  Motion-compensated wavelet transform coding for color video compression , 1992, IEEE Trans. Circuits Syst. Video Technol..

[15]  Andrew B. Watson,et al.  The cortex transform: rapid computation of simulated neural images , 1987 .

[16]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[17]  John W. Woods,et al.  Subband Image Coding , 1990 .

[18]  C. Labit,et al.  Laplacian pyramid versus wavelet decomposition for image sequence coding , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[19]  John W. Woods,et al.  A filter based bit allocation scheme for subband compression of HDTV , 1992, IEEE Trans. Image Process..

[20]  Y.-Q. Zhang,et al.  Predictive block-matching motion estimation for TV coding. II. Inter-frame prediction , 1991, IEEE Transactions on Broadcasting.

[21]  A.N. Akansu,et al.  The Binomial QMF-Wavelet Transform for Multiresolution Signal Decomposition , 1993, IEEE Trans. Signal Process..

[22]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[23]  Andrew Lippman,et al.  Scalable open-architecture television , 1992 .

[24]  John W. Woods,et al.  Subband coding of images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[25]  Michel Barlaud,et al.  Image coding using vector quantization in the wavelet transform domain , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[26]  Y.-Q. Zhang,et al.  Predictive block-matching motion estimation for TV coding. I. Inter-block prediction , 1991, IEEE Transactions on Broadcasting.

[27]  William K. Pratt,et al.  Scene Adaptive Coder , 1984, IEEE Trans. Commun..

[28]  Ming Lei Liou,et al.  Overview of the p×64 kbit/s video coding standard , 1991, CACM.

[29]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  K. R. Rao,et al.  New Techniques in PEL-Recursive Motion Compensation , 1984, ICC.