Improved K-means Algorithm Using Initialization Technique Based on Edge-Mean Grid for Image Vector Quantizer Design

The K-means algorithm is famous as a traditional data clustering technique, which is also effective in the field of codebook design for Vector Quantization (VQ) based data compression. The main disadvantage of the conventional K-means algorithm is that the convergence speed and the quality of the generated codebook depend on the initial codebook. Many researchers have been devoted to improving the initial codebook, but their algorithms either do not make full use of the features of the training vectors or need high extra computational load. This paper presents an efficient initialization technique based on the edge-mean grid generated by an edge classifier as well as even grouping of sorted means. On the one hand, the training vectors are sorted in the descending order according to their mean values. On the other hand, the training vectors are classified into 8 categories based on the edge classifier, and the number of initial codewords generated from each category is proportional to the number of training vectors in this category. The mean-sorted training vectors in each category is evenly grouped into several groups with the number of groups equaling the number of codewords to be generated from the category. Thus, an edge-mean grid is obtained with many groups, and each group generates one initial codeword that is just the middle training vector in the group. Experimental results show that, compared with the random selection and the existing norm-sorted and meansorted grouping strategies, our initialization technique converges to a better codebook with a faster convergence speed.

[1]  A. Vasuki,et al.  A review of vector quantization techniques , 2006, IEEE Potentials.

[2]  Hossein Nezamabadi-pour,et al.  An effective codebook initialization technique for LBG algorithm using subtractive clustering , 2014, 2014 Iranian Conference on Intelligent Systems (ICIS).

[3]  H. A. S. Leitão,et al.  PSO Algorithm Applied to Codebook Design for Channel-Optimized Vector Quantization , 2015, IEEE Latin America Transactions.

[4]  Yi-Ching Liaw,et al.  A fast VQ codebook generation algorithm using codeword displacement , 2008, Pattern Recognit..

[5]  Daeryong Lee,et al.  Modified K-means algorithm for vector quantizer design , 1997, IEEE Signal Processing Letters.

[6]  Tzu-Chuen Lu,et al.  A Survey of VQ Codebook Generation , 2010, J. Inf. Hiding Multim. Signal Process..

[7]  Jeng-Shyang Pan,et al.  A new vector quantization image coding algorithm based on the extension of the bound for Minkowski metric , 1998, Pattern Recognit..

[8]  S. X. Chen,et al.  Initial codebook method of vector quantisation in Hadamard domain , 2010 .

[9]  Kuldip K. Paliwal,et al.  Comments on "modified K-means algorithm for vector quantizer design" , 2000, IEEE Trans. Image Process..

[10]  Shize Guo,et al.  Image Retrieval Based on Structured Local Binary Kirsch Pattern , 2013, IEICE Trans. Inf. Syst..

[11]  Antonio Petraglia,et al.  CMOS Imager With Focal-Plane Analog Image Compression Combining DPCM and VQ , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  William Equitz,et al.  A new vector quantization clustering algorithm , 1989, IEEE Trans. Acoust. Speech Signal Process..

[13]  Jeng-Shyang Pan,et al.  Fast clustering algorithms for vector quantization , 1996, Pattern Recognit..

[14]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[15]  Chuan Qin,et al.  Reversible data hiding in VQ index table with lossless coding and adaptive switching mechanism , 2016, Signal Process..

[16]  Fa-Xin Yu,et al.  Colour image retrieval using pattern co-occurrence matrices based on BTC and VQ , 2011 .

[17]  Chen Shan-xue Initial codebook algorithm of vector quantizaton , 2010 .

[18]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[19]  Chin-Chen Chang,et al.  Fast codebook search algorithms based on tree-structured vector quantization , 2006, Pattern Recognition Letters.

[20]  C.-C. Jay Kuo,et al.  A new initialization technique for generalized Lloyd iteration , 1994, IEEE Signal Processing Letters.