Entropy-constrained reflected residual vector quantization: A realization of large block vector quantization

Abstract Vector quantization (VQ) techniques have been used for a number of years for developing successful data compression and classification algorithms. Vector quantization is inherently an unsupervised data clustering technique that smartly adopts to the given data statistics and is thus used in large variety of tasks. The gains associated with a VQ system are largely linked to the size of the block used. However, the complexity increases exponentially with an increase in block length. In conventional methods, a dimensional reduction pre-processing step is invoked before the VQ system in order to reduce the block length. For some data sources this may be unacceptable approach such as with hyper-spectral data. Therefore, a large block VQ is needed to fully exploit the linear and non-linear correlation in a data source. We propose an entropy-constrained reflected residual VQ (EC-RRVQ) as one alternative for large block vector quantization. The reflected residual VQ, a type of multistage VQ, has constrained structure with multiple stages having small-size code-books. The use of multiple code-books and a reflection constraint makes the computational complexity linearly depend on the number of stages involved. The linear increase in complexity prompted us to pose EC-RRVQ as a contender in the list of options of large block vector quantization implementation algorithms. Experimental results indicate that good image reproduction quality can be accomplished at relatively low bit rates. The performance of a 64-stage 16 × 16 EC-RRVQ at 0.175 bits per pixel is 23.75 dB with 96 vector distortion calculations per source vector, while the number for previously proposed large-dimensional entropy-constrained residual VQ (EC-RVQ) designed under the same specifications is 21.17 dB with 1212 vector distortion calculations per source vector.

[1]  Nasser M. Nasrabadi,et al.  Interframe Hierarchical Address-Vector Quantization , 1992, IEEE J. Sel. Areas Commun..

[2]  Mahmoud Kamarei,et al.  Real-time image compression based on wavelet vector quantization, algorithm and VLSI architecture , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[3]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[4]  Shaou-Gang Miaou,et al.  Wavelet-based lossy-to-lossless ECG compression in a unified vector quantization framework , 2005, IEEE Transactions on Biomedical Engineering.

[5]  Turaj Zakizadeh Shabestary,et al.  Vector quantization by companding a union of Z-lattices , 2005, IEEE Transactions on Information Theory.

[6]  Luciano Alparone,et al.  Lossless compression of multi/hyper-spectral imagery based on a 3-D fuzzy prediction , 1999, IEEE Trans. Geosci. Remote. Sens..

[7]  Robert M. Gray,et al.  High-resolution quantization theory and the vector quantizer advantage , 1989, IEEE Trans. Inf. Theory.

[8]  Sheng-He Sun,et al.  Multipurpose image watermarking algorithm based on multistage vector quantization , 2005, IEEE Transactions on Image Processing.

[9]  Giovanni Poggi,et al.  Kronecker-product gain-shape vector quantization for multispectral and hyperspectral image coding , 1998, IEEE Trans. Image Process..

[10]  Christopher F. Barnes,et al.  Large block RVQ with multipath searching , 1992, [Proceedings] 1992 IEEE International Symposium on Circuits and Systems.

[11]  Robert M. Gray,et al.  Minimum distortion color image retrieval based on Lloyd-clustered Gauss mixtures , 2005, Data Compression Conference.

[12]  Philip A. Chou,et al.  Entropy-constrained vector quantization , 1989, IEEE Trans. Acoust. Speech Signal Process..

[13]  Peter Willett,et al.  A quantization architecture for track fusion , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Christopher F. Barnes,et al.  A perspective view of finite state binary residual VQ , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[15]  Fredrik Nordén,et al.  Companded quantization of speech MDCT coefficients , 2005, IEEE Transactions on Speech and Audio Processing.

[16]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[17]  Thomas R. Fischer,et al.  Two-stage vector quantization-lattice vector quantization , 1994, IEEE Trans. Inf. Theory.

[18]  John F. Arnold,et al.  The lossless compression of AVIRIS images by vector quantization , 1997, IEEE Trans. Geosci. Remote. Sens..

[19]  Faouzi Kossentini,et al.  Image coding using entropy-constrained residual vector quantization , 1995, IEEE Trans. Image Process..

[20]  Taejeong Kim,et al.  Side match and overlap match vector quantizers for images , 1992, IEEE Trans. Image Process..

[21]  Chip-Hong Chang,et al.  Self-organizing topological tree for online vector quantization and data clustering , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Mohammad A. U. Khan,et al.  Image coding using entropy-constrained reflected residual vector quantization , 2002, Proceedings. International Conference on Image Processing.

[23]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[24]  Faouzi Kossentini,et al.  Finite-State Residual Vector Quantization , 1994, J. Vis. Commun. Image Represent..

[25]  Richard L. Frost,et al.  Vector quantizers with direct sum codebooks , 1993, IEEE Trans. Inf. Theory.

[26]  Michael A. Kaplan,et al.  Analytic properties of multiple-access trees , 1985, IEEE Trans. Inf. Theory.

[27]  John B. Anderson,et al.  Trellis source codes based on linear congruential recursions , 2005, IEEE Communications Letters.

[28]  Faouzi Kossentini,et al.  Necessary conditions for the optimality of variable-rate residual vector quantizers , 1995, IEEE Trans. Inf. Theory.

[29]  Jim Z. C. Lai,et al.  Image restoration of compressed image using classified vector quantization , 2002, Pattern Recognit..

[30]  Shigeki Matsubara,et al.  Hardware friendly vector quantization algorithm , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[31]  T.K. Abdel-Galil,et al.  Disturbance classification using Hidden Markov Models and vector quantization , 2005, IEEE Transactions on Power Delivery.

[32]  Mark J. Carlotto,et al.  A cluster-based approach for detecting man-made objects and changes in imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Biing-Hwang Juang,et al.  Multiple stage vector quantization for speech coding , 1982, ICASSP.

[34]  John B. Anderson,et al.  Instrumentable tree encoding of information sources (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[35]  Wilson C. Chung,et al.  Conditional entropy-constrained residual VQ with application to image coding , 1996, IEEE Trans. Image Process..

[36]  Nasser M. Nasrabadi,et al.  Image compression using address-vector quantization , 1990, IEEE Trans. Commun..

[37]  Mohammad A. U. Khan,et al.  Design and analysis of entropy-constrained reflected residual vector quantization , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[38]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[39]  Yao Zhao,et al.  Optimized multiple description image coding using lattice vector quantization , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[40]  Philip A. Chou,et al.  Variable rate vector quantization for speech, image, and video compression , 1993, IEEE Trans. Commun..

[41]  Timothy J. Schmit,et al.  Fast precomputed VQ with optimal bit allocation for lossless compression of ultraspectral sounder data , 2005, Data Compression Conference.

[42]  Ibon Saratxaga,et al.  Detection of synthetic speech for the problem of imposture , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[43]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[44]  Robert M. Gray,et al.  Finite-state vector quantization for waveform coding , 1985, IEEE Trans. Inf. Theory.

[45]  Syed A. Rizvi,et al.  Advances in residual vector quantization: a review , 1996, IEEE Trans. Image Process..

[46]  Mark J. T. Smith,et al.  Trellis coded residual vector quantization with application to image coding , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[47]  Magdy M. A. Salama,et al.  Fast match-based vector quantization partial discharge pulse pattern recognition , 2005, IEEE Transactions on Instrumentation and Measurement.

[48]  Yi-Ching Liaw,et al.  Artifact reduction of JPEG coded images using mean-removed classified vector quantization , 2002, Signal Process..