Vector Quantization for Multiple Classes

Abstract Vector quantization algorithms have long been used to find a finite set of exemplars which represent a data set to within an a priori error tolerance. Such a representation is essential in codebook-based data compression and transmission. The present study considers the situation where the data to be encoded consists of subclasses. The codebook must provide information compression within the several subclasses, however, minimization of interclass errors is of equal importance. We present modifications to a basic vector quanitization algorithm which adapts it to the multiclass vector quantizing setting. We then explore the behavior of the modified algorithm on selected benchmark applications. We show, in particular, that overlapping subclasses can be accommodated by the algorithm.

[1]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[2]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[3]  W. Millar,et al.  Binary search trees for vector quantisation , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[6]  Wei Liu,et al.  Efficient exemplars for classifier design , 1995 .

[7]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[8]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[9]  William Equitz,et al.  A new vector quantization clustering algorithm , 1989, IEEE Trans. Acoust. Speech Signal Process..

[10]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[11]  Wei Liu,et al.  Fuzzy HMC Classifiers , 1996, Inf. Sci..

[12]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..