Robust vector quantization for noisy channels using soft decision and sequential decoding

This paper considers the optimization of a vector quantizer whose indices are transmitted over a channel with known noise statistics (pdf). A decoder is introduced which uses a linear combination of VQ codebook entries with weights depending on the received signal. Rather than using a received index to select an entry in the codebook (which implies a hard decision on the index), the decoder uses the received signal and the channel statistics to weight the codebook entries in order to produce a good reconstructed signal. Borrowing a term used in digital communications, we will say that the optimal decoder uses a “soft” decision rule. The corresponding approach will be called Soft Decision Vector Quantization (SDVQ). It is shown that SDVQ achieves a significant performance improvement over both the source optimized VQ and the channel optimized VQ (the latter is based on known channel transition probabilities). For correlated sources, it is shown that SDVQ performance can be further improved by using sequential decoding. Results are presented for an AR(1) source and for speech line spectral pair (LSP) parameter quantization at 24 bits/frame.

[1]  W.C.Y. Lee,et al.  Estimate of local average power of a mobile radio signal , 1985, IEEE Transactions on Vehicular Technology.

[2]  Khalid Sayood,et al.  Use of residual redundancy in the design of joint source/channel coders , 1991, IEEE Trans. Commun..

[3]  P. Wintz,et al.  Quantizing for Noisy Channels , 1969 .

[4]  Vladimir Cuperman,et al.  Sequential reconstruction of vector quantized signals transmitted over Rayleigh fading channels , 1994, Proceedings of ICC/SUPERCOMM'94 - 1994 International Conference on Communications.

[5]  Nariman Farvardin,et al.  A study of vector quantization for noisy channels , 1990, IEEE Trans. Inf. Theory.

[6]  John H. Lodge,et al.  TCMP-a modulation and coding strategy for Rician fading channels , 1989, IEEE J. Sel. Areas Commun..

[7]  D. J. Goodman,et al.  Combined source and channel coding for variable-bit-rate speech transmission , 1983, The Bell System Technical Journal.

[8]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[9]  Robert M. Gray,et al.  Joint source and noisy channel trellis encoding , 1981, IEEE Trans. Inf. Theory.

[10]  Lane A. Hemaspaandra,et al.  Using simulated annealing to design good codes , 1987, IEEE Trans. Inf. Theory.

[11]  C.G. Gerlach A probabilistic framework for optimum speech extrapolation in digital mobile radio , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  J. W. Modestino,et al.  Combined Source-Channel Coding of Images , 1978, IEEE Trans. Commun..

[13]  Allen Gersho,et al.  Pseudo-Gray coding , 1990, IEEE Trans. Commun..

[14]  NARIMAN FARVARDIN,et al.  Optimal quantizer design for noisy channels: An approach to combined source - channel coding , 1987, IEEE Trans. Inf. Theory.

[15]  Petter Knagenhjelm,et al.  How good is your index assignment? , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Roar Hagen,et al.  Robust vector quantization in spectral coding , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Nuggehally Sampath Jayant,et al.  Robust vector quantization for noisy channels , 1988 .

[18]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[19]  N. Rydbeck,et al.  Analysis of Digital Errors in Nonlinear PCM Systems , 1976, IEEE Trans. Commun..

[20]  Vladimir Cuperman,et al.  Joint source and channel coding using a non-linear receiver , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[21]  K. Zeger,et al.  Zero redundancy channel coding in vector quantisation , 1987 .

[22]  William A. Gardner Structural characterization of locally optimum detectors in terms of locally optimum estimators and correlators , 1982, IEEE Trans. Inf. Theory.

[23]  G. Robert Redinbo,et al.  The optimum mean-square estimate for decoding binary block codes , 1974, IEEE Trans. Inf. Theory.

[24]  Thomas R. Fischer Joint trellis coded quantization/modulation , 1991, IEEE Trans. Commun..

[25]  Robert M. Gray,et al.  The design of joint source and channel trellis waveform coders , 1987, IEEE Trans. Inf. Theory.

[26]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.