Adaptive run-length/Golomb-Rice encoding of quantized generalized Gaussian sources with unknown statistics

We present a simple and efficient entropy coder that combines run-length and Golomb-Rice encoders. The encoder automatically switches between the two modes according to simple rules that adjust the encoding parameters based on the previous output codeword, and the decoder tracks such changes. This adaptive run-length/Golomb-Rice (RLGR) coder has a fast learning rate, making it suitable for many practical applications, which usually involve encoding small source blocks. We study the encoding of generalized Gaussian (GG) sources after quantization with uniform scalar quantizers with deadzone, which are good source models in multimedia data compression, for example. We show that, for a wide range of source parameters, the RLGR encoder has a performance close to that of the optimal Golomb-Rice and exp-Golomb coders designed with knowledge of the source statistics, and in some cases the RLGR coder improves coding efficiency by 20% or more.

[1]  Jukka Teuhola,et al.  A Compression Method for Clustered Bit-Vectors , 1978, Inf. Process. Lett..

[2]  G. Blelloch Introduction to Data Compression * , 2022 .

[3]  Youzhi Xu,et al.  Hybrid Golomb codes for a group of quantised GG sources , 2003 .

[4]  Henrique S. Malvar Fast progressive wavelet coding , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[5]  David C. van Voorhis,et al.  Optimal source codes for geometrically distributed integer alphabets (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[6]  Guillermo Sapiro,et al.  The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS , 2000, IEEE Trans. Image Process..

[7]  John D. Villasenor,et al.  Structured Prefix Codes for Quantized Low-Shape-Parameter Generalized Gaussian Sources , 1999, IEEE Trans. Inf. Theory.

[8]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[9]  Neri Merhav,et al.  Optimal prefix codes for sources with two-sided geometric distributions , 2000, IEEE Trans. Inf. Theory.

[10]  Gary J. Sullivan,et al.  On embedded scalar quantization , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Susanto Rahardja,et al.  A statistics study of the MDCT coefficient distribution for audio , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[12]  Anastasis A. Sofokleous,et al.  Review: H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia , 2005, Comput. J..

[13]  Thomas R. Fischer,et al.  Comparison of generalized Gaussian and Laplacian modeling in DCT image coding , 1995, IEEE Signal Processing Letters.