Bounds on the performance of vector-quantizers under channel errors

Vector quantization (VQ) is an effective and widely known method for low-bit-rate communication of speech and image signals. A common assumption in the design of VQ-based communication systems is that the compressed digital information is transmitted through a perfect channel. Under this assumption, quantization distortion is the only factor in output signal fidelity. Moreover, the assignment of channel symbols to the VQ reconstruction vectors is of no importance. However, under physical channels, errors may be present, causing degradation in overall system performance. In such a case, the effect of channel errors on the coding system performance depends on the index assignment of the reconstruction vectors. The index assignment problem is a special case of the Quadratic Assignment Problem (QAP) and is known to be NP-complete. For a VQ with N reconstruction vectors there are N! possible assignments, meaning that an exhaustive search over all possible assignments is practically impossible. To help the VQ designer, we present in this correspondence lower and upper bounds on the performance of VQ systems under channel errors, over all possible assignments. The bounds coincide with a general bound for the QAP. Nevertheless, the proposed derivation allows us to compare the bounds with published results on VQ index assignment. A related expression for the average performance is also given and discussed. Special cases and numerical examples are given in which the bounds and average performance are compared with index assignments obtained by known algorithms.

[1]  Mikael Skoglund,et al.  On channel-constrained vector quantization and index assignment for discrete memoryless channels , 1999, IEEE Trans. Inf. Theory.

[2]  W. D. Hershberger,et al.  Principles of communication systems , 1955 .

[3]  Franz Rendl,et al.  A New Lower Bound Via Projection for the Quadratic Assignment Problem , 1992, Math. Oper. Res..

[4]  David L. Neuhoff,et al.  The Optimality of the Natural Binary Code , 1992, Coding And Quantization.

[5]  Franz Rendl,et al.  Applications of parametric programming and eigenvalue maximization to the quadratic assignment problem , 1992, Math. Program..

[6]  NARIMAN FARVARDIN,et al.  Optimal quantizer design for noisy channels: An approach to combined source - channel coding , 1987, IEEE Trans. Inf. Theory.

[7]  David L. Neuhoff,et al.  Optimal binary index assignments for a class of equiprobable scalar and vector quantizers , 1995, IEEE Trans. Inf. Theory.

[8]  Erik Agrell,et al.  The Hadamard transform-a tool for index assignment , 1996, IEEE Trans. Inf. Theory.

[9]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[10]  Jeng-Shyang Pan,et al.  Comparison study on VQ codevector index assignment , 1998, ICSLP.

[11]  Thomas R. Crimmins,et al.  Minimization of mean-square error for data transmitted via group codes , 1969, IEEE Trans. Inf. Theory.

[12]  Panos M. Pardalos,et al.  The Quadratic Assignment Problem: A Survey and Recent Developments , 1993, Quadratic Assignment and Related Problems.

[13]  Allen Gersho,et al.  Vector quantizer design for memoryless noisy channels , 1988, IEEE International Conference on Communications, - Spanning the Universe..

[14]  F. R. Gantmakher The Theory of Matrices , 1984 .

[15]  Noam Nisan,et al.  Randomness is Linear in Space , 1996, J. Comput. Syst. Sci..

[16]  K. H. Barratt Digital Coding of Waveforms , 1985 .

[17]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[18]  Allen Gersho,et al.  Pseudo-Gray coding , 1990, IEEE Trans. Commun..

[19]  Petter Knagenhjelm,et al.  How good is your index assignment? , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  P. Gilmore Optimal and Suboptimal Algorithms for the Quadratic Assignment Problem , 1962 .

[21]  G. Ben-David,et al.  On the Performance of a Vector-Quantizer under Channel Errors , 1992 .

[22]  G. Ben-David,et al.  Simple adaptation of vector-quantizers to combat channel errors , 1994, Proceedings of IEEE 6th Digital Signal Processing Workshop.

[23]  K. Zeger,et al.  Asymptotic Bounds on Optimal Noisy Channel QuantizationVia Random Coding , 1994 .

[24]  R. Burkard Quadratic Assignment Problems , 1984 .

[25]  Nariman Farvardin,et al.  A study of vector quantization for noisy channels , 1990, IEEE Trans. Inf. Theory.

[26]  Gavin C. Cawley,et al.  A fast index assignment method for robust vector quantisation of image data , 1997, Proceedings of International Conference on Image Processing.

[27]  Kenneth Zeger,et al.  Randomly Chosen Index Assignments Are Asymptotically Bad for Uniform Sources , 1999, IEEE Trans. Inf. Theory.

[28]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[29]  Kenneth M. Hall An r-Dimensional Quadratic Placement Algorithm , 1970 .