A Lagrangian formulation of Zador's entropy-constrained quantization theorem

Zador's (1963, 1966) classic result for the asymptotic high-rate behavior of entropy-constrained vector quantization is recast in a Lagrangian form which better matches the Lloyd algorithm used to optimize such quantizers. The equivalence of the two formulations is shown and the result is proved for source distributions that are absolutely continuous with respect to the Lebesgue measure which satisfy an entropy condition, thereby generalizing the conditions stated by Zador under which the result holds.

[1]  R. Ladner.  Entropy-constrained Vector Quantization , 2000 .

[2]  R. Gray.  Entropy and Information Theory , 1990, Springer New York.

[3]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[4]  Stephen P. Boyd,et al.  Determinant Maximization with Linear Matrix Inequality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[5]  Robert M. Gray,et al.  On Zador's entropy-constrained quantization theorem , 2001, Proceedings DCC 2001. Data Compression Conference.

[6]  R. M. Dudley,et al.  Real Analysis and Probability , 1989 .

[7]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[8]  Dudley,et al.  Real Analysis and Probability: Measurability: Borel Isomorphism and Analytic Sets , 2002 .

[9]  Robert M. Gray,et al.  A Lagrangian formulation of high rate quantization , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[10]  S. Graf,et al.  Foundations of Quantization for Probability Distributions , 2000 .

[11]  James A. Bucklew,et al.  Multidimensional asymptotic quantization theory with r th power distortion measures , 1982, IEEE Trans. Inf. Theory.

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[14]  Paul L. Zador,et al.  Asymptotic quantization error of continuous signals and the quantization dimension , 1982, IEEE Trans. Inf. Theory.

[15]  P. Zador.  DEVELOPMENT AND EVALUATION OF PROCEDURES FOR QUANTIZING MULTIVARIATE DISTRIBUTIONS , 1963 .

[16]  T. Broadbent.  Measure and Integral , 1957, Nature.

[17]  David J. Sakrison,et al.  Worst sources and robust codes for difference distortion measures , 1975, IEEE Trans. Inf. Theory.