Optimal binary index assignments for a class of equiprobable scalar and vector quantizers

The problem of scalar and vector quantization in conjunction with a noisy binary symmetric channel is considered. The issue is the assignment of the shortest possible distinct binary sequences to quantization levels or vectors so as to minimize the mean-squared error caused by channel errors. By formulating the assignment as a matrix (or vector in the scalar case) and showing that the mean-squared error due to channel errors is determined by the projections of its columns onto the eigenspaces of the multidimensional channel transition matrix, a class of source/quantizer pairs is identified for which the optimal index assignment has a simple and natural form. Among other things, this provides a simpler and more accessible proof of the result of Crimmins et al. (1969) that the natural binary code is an optimal index assignment for the uniform scalar quantizer and uniform source. It also provides a potentially useful approach to further developments in source-channel coding.

[1]  K. H. Barratt Digital Coding of Waveforms , 1985 .

[2]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[3]  David G. Messerschmitt,et al.  Quantizing for maximum output entropy (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[4]  D. J. Goodman,et al.  Using simulated annealing to design digital transmission codes for analogue sources , 1988 .

[5]  Ian T. Young,et al.  On weighted PCM (Corresp.) , 1965, IEEE Trans. Inf. Theory.

[6]  Allen Gersho,et al.  Pseudo-Gray coding , 1990, IEEE Trans. Commun..

[7]  Steven W. McLaughlin,et al.  Source-channel coding of analog data for digital magnetic recording , 1994 .

[8]  Nam C. Phamdo,et al.  A unified approach to tree-structured and multistage vector quantization for noisy channels , 1993, IEEE Trans. Inf. Theory.

[9]  G. Ben-David,et al.  On the Performance of a Vector-Quantizer under Channel Errors , 1992 .

[10]  Lane A. Hemaspaandra,et al.  Using simulated annealing to design good codes , 1987, IEEE Trans. Inf. Theory.

[11]  Richard L. Frost,et al.  Vector quantizers with direct sum codebooks , 1993, IEEE Trans. Inf. Theory.

[12]  Biing-Hwang Juang,et al.  Multiple stage vector quantization for speech coding , 1982, ICASSP.

[13]  D. G. Childers Noise in Digital-to-Analog Conversion Due to Bit Errors , 1965, IEEE Transactions on Space Electronics and Telemetry.

[14]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[15]  K. Zeger,et al.  Zero redundancy channel coding in vector quantisation , 1987 .

[16]  Edward Bedrosian Weighted PCM , 1958, IRE Trans. Inf. Theory.

[17]  George C. Clark,et al.  Reconstruction error in waveform transmission (Corresp.) , 1967, IEEE Trans. Inf. Theory.

[18]  Petter Knagenhjelm Competitive Learning in Robust Communication , 1993 .

[19]  Thomas R. Crimmins,et al.  Minimization of mean-square error for data transmitted via group codes , 1969, IEEE Trans. Inf. Theory.

[20]  L. H. Harper Optimal Assignments of Numbers to Vertices , 1964 .