A new learning approach based on equidistortion principle for optimal vector quantizer design

The authors theoretically derive a basic principle called the equidistortion principle for the design of optimal vector quantizers. This principle can be regarded as a extension of Gersho's theory (1979). A new learning algorithm is presented with a selection mechanism based on this principle. Since no probabilistic model is assumed in deriving the principle, the associated algorithm, unlike conventional algorithms, can minimize distortion without a particular initialization procedure, even when the input data cluster in a number of regions in the input vector space. The optimality of the algorithm is demonstrated and the experimental results on real speech data are shown.<<ETX>>

[1]  Stanley C. Ahalt,et al.  Competitive learning algorithms for vector quantization , 1990, Neural Networks.

[2]  Robert Hecht-Nielsen,et al.  Applications of counterpropagation networks , 1988, Neural Networks.

[3]  Allen Gersho,et al.  Asymptotically optimal block quantization , 1979, IEEE Trans. Inf. Theory.

[4]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[5]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[6]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[7]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[8]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[9]  Duane DeSieno,et al.  Adding a conscience to competitive learning , 1988, IEEE 1988 International Conference on Neural Networks.