A fast VQ codebook generation algorithm via pattern reduction

In this paper, we present a simple but fast codebook generation algorithm, called PREGLA (Pattern Reduction Enhanced GLA). The proposed algorithm is fundamentally different from the previous approaches in that the previous approaches focus on reducing the size of the codebook whereas the proposed algorithm focuses on using pattern reduction to reduce the computation time. The proposed algorithm is motivated by the observation that input vectors that are ''static'' during the training process can be considered as part of the final solutions and thus can be compressed and removed to eliminate the redundant computations at the later iterations of the training process. To evaluate the performance of the proposed algorithm, we compare the proposed algorithm with ''efficient'' state-of-the-art GLA or GLA-based algorithms such as Codeword Displacement, Nearest Partition Set Search, Fast Vector Quantization Algorithm, Law of Cosines, and standard GLA. Our experimental results indicate that the proposed algorithm can reduce the computation time from 29.45% up to about 77.98% compared to those of standard GLA and other fast GLA-based algorithms alone.

[1]  Guobin Shen,et al.  Adaptive vector quantization with codebook updating based on locality and history , 2003, IEEE Trans. Image Process..

[2]  Mauricio Kugler,et al.  Using a chain of LVQ neural networks for pattern recognition of EEG signals related to intermittent photic-stimulation , 2002, VII Brazilian Symposium on Neural Networks, 2002. SBRN 2002. Proceedings..

[3]  Bhabatosh Chanda,et al.  Design of vector quantizer for image compression using self-organizing feature map and surface fitting , 2004, IEEE Transactions on Image Processing.

[4]  M. Omair Ahmad,et al.  Competitive splitting for codebook initialization , 2004, IEEE Signal Processing Letters.

[5]  Shen-En Qian,et al.  Hyperspectral data compression using a fast vector quantization algorithm , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Chin-Chen Chang,et al.  Fast codebook search algorithms based on tree-structured vector quantization , 2006, Pattern Recognition Letters.

[7]  Chu-Sing Yang,et al.  A Time efficient Pattern Reduction algorithm for k-means based clustering , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[8]  Shiueng Bien Yang.  Variable-branch tree-structured vector quantization , 2004, IEEE Transactions on Image Processing.

[9]  Magdy M. A. Salama,et al.  Fast match-based vector quantization partial discharge pulse pattern recognition , 2005, IEEE Transactions on Instrumentation and Measurement.

[10]  Wisnu Jatmiko,et al.  Fuzzy-neuro LVQ and its comparison with fuzzy algorithm LVQ in artificial odor discrimination system. , 2002, ISA transactions.

[11]  A. Vasuki,et al.  A review of vector quantization techniques , 2006, IEEE Potentials.

[12]  Kuo-Liang Chung,et al.  An efficient law-of-cosine-based search for vector quantization , 2004, Pattern Recognit. Lett..

[13]  W. Chen,et al.  Tree-structured vector quantization for speech recognition , 2000, Comput. Speech Lang..

[14]  Chin-Chen Chang,et al.  Fast Planar-Oriented Ripple Search Algorithm for Hyperspace VQ Codebook , 2007, IEEE Transactions on Image Processing.

[15]  Giuseppe Patanè,et al.  The enhanced LBG algorithm , 2001, Neural Networks.

[16]  Qiu Chen,et al.  Face recognition using vector quantization histogram method , 2002, Proceedings. International Conference on Image Processing.

[17]  Olli Nevalainen,et al.  Tabu search algorithm for codebook generation in vector quantization , 1998, Pattern Recognit..

[18]  Spiros Fotopoulos,et al.  A novel training scheme for neural-network-based vector quantizers and its application in image compression , 2004, Neurocomputing.

[19]  Lowell LeRoy Winger.  Linearly constrained generalized Lloyd algorithm for reduced codebook vector quantization , 2001, IEEE Trans. Signal Process..

[20]  Yi-Ching Liaw,et al.  Fast-searching algorithm for vector quantization using projection and triangular inequality , 2004, IEEE Transactions on Image Processing.

[21]  Yi-Ching Liaw,et al.  A fast VQ codebook generation algorithm using codeword displacement , 2008, Pattern Recognit..

[22]  F Shen,et al.  An adaptive incremental LBG for vector quantization. , 2006, Neural networks : the official journal of the International Neural Network Society.

[23]  J. Cardinal.  A Lagrangian optimization approach to complexity-constrained TSVQ , 2000, IEEE Signal Processing Letters.

[24]  G. De Soete,et al.  Clustering and Classification , 2019, Data-Driven Science and Engineering.

[25]  Olli Nevalainen,et al.  A fast exact GLA based on code vector activity detection , 2000, IEEE Trans. Image Process..

[26]  Jeng-Shyang Pan,et al.  An efficient encoding algorithm for vector quantization based on subvector technique , 2003, IEEE Trans. Image Process..

[27]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[28]  Z. Pan,et al.  An improved full-search-equivalent vector quantization method using the law of cosines , 2004, IEEE Signal Processing Letters.

[29]  R. Gray,et al.  Speech coding based upon vector quantization , 1980, ICASSP.

[30]  J. Mielikainen,et al.  A novel full-search vector quantization algorithm based on the law of cosines , 2002, IEEE Signal Processing Letters.

[31]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[32]  Paul S. Bradley,et al.  Refining Initial Points for K-Means Clustering , 1998, ICML.

[33]  C. Chang,et al.  Fast search algorithm for vector quantisation without extra look-up table using declustered subcodebooks , 2005 .

[34]  Kuldip K. Paliwal,et al.  Fast K-dimensional tree algorithms for nearest neighbor search with application to vector quantization encoding , 1992, IEEE Trans. Signal Process..

[35]  Kuo-Liang Chung,et al.  Improved adaptive vector quantization algorithm using hybrid codebook data structure , 2005, Real Time Imaging.

[36]  Kuo-Sheng Cheng,et al.  An evolution-based tabu search approach to codebook design , 2007, Pattern Recognit..

[37]  William H. E. Day,et al.  COMPLEXITY THEORY: AN INTRODUCTION FOR PRACTITIONERS OF CLASSIFICATION , 1996 .

[38]  Shen-En Qian.  Fast vector quantization algorithms based on nearest partition set search , 2006, IEEE Transactions on Image Processing.

[39]  W. Bastiaan Kleijn,et al.  KLT-based adaptive classified VQ of the speech signal , 2004, IEEE Transactions on Speech and Audio Processing.

[40]  Shahram Shirani,et al.  Progressive scalable interactive region-of-interest image coding using vector quantization , 2005, IEEE Transactions on Multimedia.