Low Rate Uniform Scalar Quantization of Memoryless Gaussian Sources

The low-rate (<;1 bits per sample) operational rate-distortion performance of uniform scalar quantizers for the memoryless Gaussian source is studied. Approximate analytical expressions for the operational rate-distortion function are derived, and the accuracy of the derived function is verified through simulation. It is shown that in the zero-rate limit the derived operational rate-distortion function is first-order optimal with respect to the Shannon lower bound. The derived function is used to study the performance of uniform scalar quantizers for the Gaussian Wyner-Ziv problem. Lastly, the derived low-rate rate-distortion function is used to provide improved low-rate bit allocation for jointly Gaussian vectors.

[1]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[2]  P. Noll,et al.  Bounds on Quantizer Performance in the Low Bit-Rate Region , 1978, IEEE Trans. Commun..

[3]  Herbert Gish,et al.  Asymptotically efficient quantizing , 1968, IEEE Trans. Inf. Theory.

[4]  Nariman Farvardin,et al.  Optimum quantizer performance for a class of non-Gaussian memoryless sources , 1984, IEEE Trans. Inf. Theory.

[5]  David L. Neuhoff,et al.  Performance of low rate entropy-constrained scalar quantizers , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[6]  Toby Berger Optimum quantizers and permutation codes , 1972, IEEE Trans. Inf. Theory.

[7]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[8]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.