A theoretical high-rate analysis of causal versus unitary online transform coding

Backward adaptive or "online" transform coding (TC) of Gaussian sources is investigated. The Karhunen-Loe/spl grave/ve transform (KLT, unitary approach) and the causal transform (CT, causal approach) are compared in this context. When the covariance matrix R_/sub x/ of the source is used in the TC scheme, KLT and CT present similar coding gains at high rates. The aim of this study is to model analytically the behavior of these two coding structures when the ideal TC scheme gets perturbed, that is, when only a perturbed value R_/sub x/+/spl Delta/R is known at the encoder. In the online TC schemes considered here, this estimate is used to compute both the transform and the bit assignment. /spl Delta/R is caused by two noise sources: estimation noise (finite set of available data at the encoder) and quantization noise (quantized data at the decoder). Furthermore, not only does the transformation itself get perturbed, but also the bit assignment does as well. In this framework, theoretical expressions for the coding gains in both the unitary and the causal cases are derived under the high-rate assumption.

[1]  M. Effros,et al.  Weighted universal transform coding: universal image compression with the Karhunen-Loeve transform , 1995, Proceedings., International Conference on Image Processing.

[2]  Robert Bregovic,et al.  Multirate Systems and Filter Banks , 2002 .

[3]  Michelle Effros.  Rate-Distortion Bounds for Fixed- and Variable-Rate Multi-Resolution Source Codes , 1997 .

[4]  See-May Phoong,et al.  PLT versus KLT [transforms] , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[5]  K. H. Barratt.  Digital Coding of Waveforms , 1985 .

[6]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[7]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[8]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[9]  Vivek K. Goyal,et al.  Transform coding with backward adaptive updates , 2000, IEEE Trans. Inf. Theory.

[10]  P. Levy.  Processus stochastiques et mouvement brownien , 1948 .

[11]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[12]  Dirk T. M. Slock,et al.  On the suboptimality of orthogonal transforms for single- or multi-stage lossless transform coding , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[13]  Kari Karhunen,et al.  Über lineare Methoden in der Wahrscheinlichkeitsrechnung , 1947 .

[14]  Michelle Effros,et al.  Suboptimality of the Karhunen-Loeve transform for transform coding , 2003, IEEE Transactions on Information Theory.

[15]  Amir K. Khandani,et al.  Sequential Vector Decorrelation Technique , 2001 .

[16]  See-May Phoong,et al.  Prediction-based lower triangular transform , 2000, IEEE Trans. Signal Process..

[17]  Ecole Nationale Sup.  CAUSAL LOSSY AND LOSSLESS CODING OF VECTORIAL SIGNALS , 2003 .

[18]  Michelle Effros,et al.  A vector quantization approach to universal noiseless coding and quantization , 1996, IEEE Trans. Inf. Theory.

[19]  Michelle Effros.  Universal multiresolution source codes , 2001, IEEE Trans. Inf. Theory.

[20]  Vivek K. Goyal,et al.  Theoretical foundations of transform coding , 2001, IEEE Signal Process. Mag..

[21]  Michelle Effros,et al.  Suboptimality of the Karhunen-Loève Transform for Transform Coding , 2004, IEEE Trans. Inf. Theory.

[22]  Dirk T. M. Slock,et al.  Analysis of quantization noise feedback in causal transform coding , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  David L. Neuhoff,et al.  Fixed rate universal block source coding with a fidelity criterion , 1975, IEEE Trans. Inf. Theory.

[24]  A. Habibi,et al.  A Unified Representation of Differential Pulse-Code Modulation (DPCM) and Transform Coding Systems , 1974, IEEE Trans. Commun..

[25]  Dirk T M Slock,et al.  Codage DPCM vectoriel et application au codage de la parole en bande élargie , 2000 .