Symbol coding of Laplacian distributed prediction residuals

Predictive coding schemes, proposed in the literature, essentially model the residuals with discrete distributions. However, real-valued residuals can arise in predictive coding, for example, from the usage of an r order linear predictor specified by r real-valued coefficients. In this paper, we propose a symbol-by-symbol coding scheme for the Laplace distribution, which closely models the distribution of real-valued residuals in practice. To efficiently exploit the real-valued predictions at a given precision, the proposed scheme essentially combines the process of residual computation and coding, in contrast to conventional schemes that separate these two processes. In the context of adaptive predictive coding framework, where the source statistics must be learnt from the data, the proposed scheme has the advantage of lower 'model cost' as it involves learning only one parameter. In this paper, we also analyze the proposed parametric coding scheme to establish the relationship between the optimal value of the coding parameter and the scale parameter of the Laplace distribution. Our experimental results demonstrated the compression efficiency and computational simplicity of the proposed scheme in adaptive coding of residuals against the widely used arithmetic coding, Rice-Golomb coding, and the Merhav-Seroussi-Weinberger scheme adopted in JPEG-LS.

[1]  K. Krishnamoorthy Handbook of statistical distributions with applications , 2006 .

[2]  Guillermo Sapiro,et al.  The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS , 2000, IEEE Trans. Image Process..

[3]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[4]  R. F. Rice,et al.  Some practical universal noiseless coding techniques, part 2 , 1983 .

[5]  Nasir D. Memon,et al.  Context-based, adaptive, lossless image coding , 1997, IEEE Trans. Commun..

[6]  Jorma Rissanen,et al.  Universal coding, information, prediction, and estimation , 1984, IEEE Trans. Inf. Theory.

[7]  Michael T. Orchard,et al.  Edge-directed prediction for lossless compression of natural images , 2001, IEEE Trans. Image Process..

[8]  Solomon W. Golomb,et al.  Run-length encodings (Corresp.) , 1966, IEEE Trans. Inf. Theory.

[9]  Neri Merhav,et al.  Coding of sources with two-sided geometric distributions and unknown parameters , 2000, IEEE Trans. Inf. Theory.

[10]  Frederic Dufaux,et al.  Entropy criterion for optimal bit allocation between motion and prediction error information , 1993, Other Conferences.

[11]  Jelena Nikolic,et al.  An adaptive waveform coding algorithm and its application in speech coding , 2012, Digit. Signal Process..

[12]  Jelena Nikolic,et al.  Optimization of multiple region quantizer for Laplacian source , 2014, Digit. Signal Process..

[13]  John B. O'Neal,et al.  Entropy coding in speech and television differential PCM systems (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[14]  Jeffrey Scott Vitter,et al.  New methods for lossless image compression using arithmetic coding , 1991, [1991] Proceedings. Data Compression Conference.

[15]  Takehiro Moriya,et al.  The MPEG-4 Audio Lossless Coding (ALS) Standard - Technology and Applications , 2005 .

[16]  Tomasz J. Kozubowski,et al.  A discrete analogue of the Laplace distribution , 2006 .

[17]  David C. van Voorhis,et al.  Optimal source codes for geometrically distributed integer alphabets (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[18]  Neri Merhav,et al.  Optimal prefix codes for sources with two-sided geometric distributions , 2000, IEEE Trans. Inf. Theory.

[19]  Mortuza Ali,et al.  Predictive Coding of Integers with Real-Valued Predictions , 2013, 2013 Data Compression Conference.