On quantizer distortion and the upper bound for exponential entropy

A sharp upper bound is derived for the exponential entropy in the class of absolutely continuous distributions with specific standard deviation and an exact description of the extremal distributions. This result is interpreted as determining the least favorable cases for certain methods of quantization of analog sources. It is known that for a large class of quantizers (both zero-memory and vector) the rth power distortion, as well as some other distortion criteria, are bounded below by a constant, depending on r, multiplied by a certain integral of the source's probability density. It is pointed out that this bound can be rewritten in terms of the exponential entropy. The exponential entropy measures the quantitative extent or range of the source distribution. This fact gives a physical interpretation of the indicated limits of quantizer performance, further elucidated by the main result. >

[1]  Allen Gersho,et al.  Asymptotically optimal block quantization , 1979, IEEE Trans. Inf. Theory.

[2]  Richard E. Blahut,et al.  Principles and practice of information theory , 1987 .

[3]  Thomas J. Lynch,et al.  Data compression techniques and applications , 1985 .

[4]  PETER ELIAS,et al.  Bounds on performance of optimum quantizers , 1970, IEEE Trans. Inf. Theory.

[5]  L. Campbell,et al.  Exponential entropy as a measure of extent of a distribution , 1966 .

[6]  Neil L. Gerr,et al.  A simple class of asymptotically optimal quantizers , 1983, IEEE Trans. Inf. Theory.

[7]  Jaak Peetre,et al.  General Beckenbach's inequality with applications , 1989 .

[8]  Robert M. Gray,et al.  Asymptotically optimal quantizers (Corresp.) , 1977, IEEE Trans. Inf. Theory.

[9]  Lars-Erik Persson,et al.  Some properties of generalized exponential entropies with applications to data compression , 1992, Inf. Sci..

[10]  James A. Bucklew,et al.  Properties of minimum mean squared error block quantizers , 1982, IEEE Trans. Inf. Theory.

[11]  P. Elias BOUNDS AND ASYMPTOTES FOR THE PERFORMANCE' OF MULTIVARIATE QUANTIZERS , 1970 .

[12]  James A. Bucklew,et al.  Multidimensional asymptotic quantization theory with r th power distortion measures , 1982, IEEE Trans. Inf. Theory.

[13]  Sigeiti Moriguti,et al.  A Lower Bound for a Probability Moment of any Absolutely Continuous Distribution with Finite Variance , 1952 .

[14]  S. Golomb,et al.  The information generating function of a probability distribution (Corresp.) , 1966, IEEE Trans. Inf. Theory.