Video coding with quad-trees and adaptive vector quantization

This paper presents recent progress of our ongoing research evaluating the prospects of adaptive vector quantization (AVQ) for very-low-bitrate video coding. In contrast to conventional state-of-the-art video coding based on entropy coding of motion compensated residual frames in the frequency domain, adaptive vector quantization offers the potential to adapt its codebooks to the changing statistics of image sequences. The basic building blocks of our current AVQ video codec are (1) block-based coding in the wavelet domain where wavelet coefficients correspond to (overlapping) spatial regions, (2) hierarchical organization of the wavelet coefficients using quad-tree structures, (3) three way coding mode decision for each block (block replenishment, product code vector quantization, new VQ block with codebook update), and (4) rigorous rate/distortion optimization for all coding choices (image partition and block coding mode). This video codec does not apply motion compensation, however. A comparison with standard transform coding (H.263) shows that inspite of the improvements of our coder over previously published AVQ video coders it still shows a performance gap of about 1 dB for some test sequences. We conclude that motion compensation is essential also for codecs based on AVQ. First preliminary tests show that AVQ coders that incorporate motion compensation can become competitive with standard transform coding.

[1]  Sanjit K. Mitra,et al.  Image-adaptive vector quantization in an entropy-constrained framework , 1997, IEEE Trans. Image Process..

[2]  Hannes Hartenstein,et al.  A video codec based on R/D-optimized adaptive vector quantization , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[3]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[4]  James E. Fowler,et al.  Adaptive vector quantization using generalized threshold replenishment , 1997, Proceedings DCC '97. Data Compression Conference.

[5]  Morris Goldberg,et al.  Image Compression Using Adaptive Vector Quantization , 1986, IEEE Trans. Commun..

[6]  Khalid Sayood,et al.  Online compression of video sequences using adaptive VQ codebooks , 1994, Proceedings of IEEE Data Compression Conference (DCC'94).

[7]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[8]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[9]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[10]  Dietmar Saupe,et al.  Real-time very low bit rate video coding with adaptive mean-removed vector quantization , 1997, Proceedings of International Conference on Image Processing.

[11]  Dietmar Saupe,et al.  Rate-distortion based video coding with adaptive mean-removed vector quantization , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).