Fuzzy declustering-based vector quantization

Vector quantization is a useful approach for multi-dimensional data compression and pattern classification. One of the most popular techniques for vector quantization design is the LBG (Linde, Buzo, Gray) algorithm. To address the problem of producing poor estimate of vector centroids which are subjected to biased data in vector quantization; we propose a fuzzy declustering strategy for the LBG algorithm. The proposed technique calculates appropriate declustering weights to adjust the global data distribution. Using the result of fuzzy declustering-based vector quantization design, we incorporate the notion of fuzzy partition entropy into the distortion measures that can be useful for classification of spectral features. Experimental results obtained from simulated and real data sets demonstrate the effective performance of the proposed approach.

[1]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[2]  N. M. S. Rock,et al.  Numerical geology , 1988 .

[3]  Hong Yan,et al.  LPC-VQ based Hidden Markov Models for Similarity Searching in DNA Sequences , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[4]  Stephen T. C. Wong,et al.  A Microscopic Image Classification System for High-Throughput Cell-Cycle Screening , 2007 .

[5]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[6]  D. Crane,et al.  Failure of microtubule-mediated peroxisome division and trafficking in disorders with reduced peroxisome abundance , 2006, Journal of Cell Science.

[7]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[8]  E. Dougherty,et al.  Gene-expression profiles in hereditary breast cancer. , 2001, The New England journal of medicine.

[9]  L. Rabiner,et al.  The acoustics, speech, and signal processing society - A historical perspective , 1984, IEEE ASSP Magazine.

[10]  Kyu-Sik Park,et al.  Content-Based Classification of Music Using VQ-Multifeature Clustering Technique , 2005, Australian Conference on Artificial Intelligence.

[11]  James A. Storer,et al.  Reduced complexity content-based image retrieval using vector quantization , 2006, Data Compression Conference (DCC'06).

[12]  Xiaobo Zhou,et al.  Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy , 2006, IEEE Transactions on Biomedical Engineering.

[13]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[14]  Clayton V. Deutsch,et al.  Geostatistical Reservoir Modeling , 2002 .

[15]  Akiyoshi Wakatani.  Parallel VQ compression using PNN algorithm for PC Grid system , 2008, Telecommun. Syst..

[16]  Shiueng Bien Yang.  Constrained-storage multistage vector quantization based on genetic algorithms , 2008, Pattern Recognit..

[17]  Hong Yan,et al.  Spectral Pattern Comparison Methods for Cancer Classification Based on Microarray Gene Expression Data , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[18]  J. Mesirov,et al.  Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. , 1999, Science.

[19]  A. Journel.  Nonparametric estimation of spatial distributions , 1983 .

[20]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..

[21]  Edward A. Lee,et al.  Fuzzy vector quantazation applied to hidden Markov modeling , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Nicholas M.S. Rock.  Numerical Geology: A Source Guide, Glossary and Selective Bibliography to Geological Uses of Computers and Statistics , 1988 .

[23]  Shree K. Nayar,et al.  A VQ-Based Demosaicing by Self-Similarity , 2007, 2007 IEEE International Conference on Image Processing.

[24]  Jeng-Shyang Pan,et al.  An efficient encoding algorithm for vector quantization based on subvector technique , 2003, IEEE Trans. Image Process..

[25]  Andre G. Journel,et al.  Constrained interpolation and qualitative information—The soft kriging approach , 1986 .

[26]  Marcos Faúndez-Zanuy,et al.  On-line signature recognition based on VQ-DTW , 2007, Pattern Recognit..

[27]  Giuseppe Patanè,et al.  LBGS: a smart approach for very large data sets vector quantization , 2005, Signal Process. Image Commun..

[28]  Yung-Kuan Chan,et al.  A Refined VQ-Based Image Compression Method , 2004, Fundam. Informaticae.

[29]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[30]  John J. Soraghan,et al.  A multiresolution adaptive VQ based still image codec with application to progressive image transmission , 1998, Signal Process. Image Commun..

[31]  Tuan D. Pham.  Vector Quantization And Fuzzy C-Means Clustering For Written Language Classification , 2003, PRIS.

[32]  Rafael Gadea Gironés,et al.  A wavelet-VQ system for real-time video compression , 2007, Journal of Real-Time Image Processing.

[33]  Zhaohui Wu,et al.  Speaker Identification Using the VQ-Based Discriminative Kernels , 2005, AVBPA.

[34]  M. Ringnér,et al.  Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks , 2001, Nature Medicine.

[35]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[36]  Shih-Chieh Shie,et al.  Secret image transmission based on VQ and data embedding , 2007 .

[37]  Robert M. Gray,et al.  Rate-distortion speech coding with a minimum discrimination information distortion measure , 1981, IEEE Trans. Inf. Theory.

[38]  Xiaobo Zhou,et al.  Integrated Algorithms for Image Analysis and Classification of Nuclear Division for High-Content Cell-Cycle Screening , 2006, Int. J. Comput. Intell. Appl..

[39]  Yi-Ching Liaw,et al.  A fast VQ codebook generation algorithm using codeword displacement , 2008, Pattern Recognit..

[40]  Dao-Qiang Zhang,et al.  A novel kernelized fuzzy C-means algorithm with application in medical image segmentation , 2004, Artif. Intell. Medicine.

[41]  Kenneth Rose,et al.  Multistage vector quantizer optimization for packet networks , 2003, IEEE Trans. Signal Process..

[42]  Manuel Graña,et al.  VQ based Bayesian image filtering , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[43]  Jeng-Shyang Pan,et al.  Fast clustering algorithms for vector quantization , 1996, Pattern Recognit..

[44]  J. Oglesby,et al.  Speaker recognition using hidden Markov models, dynamic time warping and vector quantisation , 1995 .

[45]  Dong-Sik Jang,et al.  Extraction of major object features using VQ clustering for content-based image retrieval , 2002, Pattern Recognit..

[46]  Douglas O'Shaughnessy.  Speech Communication , 1987 .

[47]  Seiichi Nakagawa,et al.  Speaker change detection and speaker clustering using VQ distortion for broadcast news speech recognition , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[48]  G. W. Hughes,et al.  Minimum Prediction Residual Principle Applied to Speech Recognition , 1975 .

[49]  D. Tran,et al.  Fuzzy entropy clustering , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).