Modified K-means algorithm for vector quantizer design

The K-means algorithm is widely used in vector quantizer (VQ) design and clustering analysis. In VQ context, this algorithm iteratively updates an initial codebook and converges to a locally optimal codebook in certain conditions. It iteratively satisfies each of the two necessary conditions for an optimal quantizer; the nearest neighbor condition for the partition and centroid condition for the codevectors. In this letter, we propose a new algorithm for both vector quantizer design and clustering analysis as an alternative to the conventional K-means algorithm. The algorithm is almost the same as the K-means algorithm except for a modification at codebook updating step. It does not satisfy the centroid condition iteratively, but asymptotically satisfies it as the number of iterations increases. Experimental results show that the algorithm converges to a better locally optimal codebook with an accelerated convergence speed.

[1]  Allen Gersho,et al.  Globally optimal vector quantizer design by stochastic relaxation , 1992, IEEE Trans. Signal Process..

[2]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[3]  C.-C. Jay Kuo,et al.  A new initialization technique for generalized Lloyd iteration , 1994, IEEE Signal Processing Letters.

[4]  Sing-Tze Bow,et al.  Pattern recognition and image preprocessing , 1992 .

[5]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[7]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..