Lagrangian Optimization of Two-Description Scalar Quantizers

In this paper, we study the problem of optimal design of balanced two-description fixed-rate scalar quantizer (2DSQ) under the constraint of convex codecells. Using a graph-based approach to model the problem, we show that the minimum expected distortion of the 2DSQ is a convex function of the number of codecells in the side quantizers. This property allows the problem to be solved by Lagrangian minimization for which the optimal Lagrangian multiplier exists. Given a trial multiplier, we exploit a monotonicity of the objective function, and develop a simple and fast dynamic programming technique to solve the parameterized problem. To further improve the algorithm efficiency, we propose an RD-guided search strategy to find the optimal Lagrangian multiplier. In our experiments on distributions of interest for signal compression applications the proposed algorithm improves the speed of the fastest algorithm so far, by a factor of O(K/logK), where K is the number of codecells in each side quantizer. We also assess the impact on the optimality of the convex codecell constraint. Using a published performance analysis of 2DSQ at high rates, we show that asymptotically this constraint does not preclude optimality for L 2 distortion measure, when channels have a higher than 0.12 loss rate.

[1]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[2]  A. Wyner,et al.  Source coding for multiple descriptions , 1980, The Bell System Technical Journal.

[3]  Michelle Effros,et al.  Codecell contiguity in optimal fixed-rate and entropy-constrained network scalar quantizers , 2002, Proceedings DCC 2002. Data Compression Conference.

[4]  L. Ozarow,et al.  On a source-coding problem with two channels and three receivers , 1980, The Bell System Technical Journal.

[5]  Vinay A. Vaishampayan,et al.  Asymptotic Analysis of Multiple Description Quantizers , 1998, IEEE Trans. Inf. Theory.

[6]  R. Ladner Entropy-constrained Vector Quantization , 2000 .

[7]  Sorina Dumitrescu,et al.  Optimal Two-Description Scalar Quantizer Design , 2004, Algorithmica.

[8]  Robert M. Gray A Lagrangian formulation of fixed-rate quantization , 2005, Data Compression Conference.

[9]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[10]  Jaroslaw Domaszewicz,et al.  Design of entropy-constrained multiple-description scalar quantizers , 1994, IEEE Trans. Inf. Theory.

[11]  W. R. Bennett,et al.  Spectra of quantized signals , 1948, Bell Syst. Tech. J..

[12]  Rudolf Ahlswede,et al.  The rate-distortion region for multiple descriptions without excess rate , 1985, IEEE Trans. Inf. Theory.

[13]  V. Algazi,et al.  Useful Approximations to Optimum Quantization , 1966 .

[14]  Sorina Dumitrescu,et al.  Fast algorithms for optimal two-description scalar quantizer design , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[15]  Vinay A. Vaishampayan,et al.  Design of multiple description scalar quantizers , 1993, IEEE Trans. Inf. Theory.

[16]  Kaizhong Zhang,et al.  Quantizer monotonicities and globally optimal scalar quantizer design , 1993, IEEE Trans. Inf. Theory.

[17]  H. Witsenhausen,et al.  Source coding for multiple descriptions II: A binary source , 1981, The Bell System Technical Journal.

[18]  Xiaolin Wu,et al.  Optimal Quantization by Matrix Searching , 1991, J. Algorithms.

[19]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[20]  Harvey J. Everett Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[21]  Sorina Dumitrescu,et al.  Algorithms for optimal multi-resolution quantization , 2004, J. Algorithms.

[22]  Alok Aggarwal,et al.  Finding a minimum-weightk-link path in graphs with the concave Monge property and applications , 1994, Discret. Comput. Geom..

[23]  Toby Berger,et al.  New results in binary multiple descriptions , 1987, IEEE Trans. Inf. Theory.

[24]  Michelle Effros,et al.  Quantization as histogram segmentation: globally optimal scalar quantizer design in network systems , 2002, Proceedings DCC 2002. Data Compression Conference.

[25]  Abbas El Gamal,et al.  Achievable rates for multiple descriptions , 1982, IEEE Trans. Inf. Theory.

[26]  James A. Bucklew,et al.  Multidimensional asymptotic quantization theory with r th power distortion measures , 1982, IEEE Trans. Inf. Theory.