Finite state vector quantisation with neural network classification of states

The results of employing neural network classification of states (NNCS) in finite state vector quantisation (FSVQ) are presented. In addition to intrablock correlation, already exploited by vector quantisation (VQ), the new design takes advantage of the interblock spatial correlation in typical grey-level images. The main achievement of FSVQ techniques is to assure access to a large master codebook for quantising purposes, thus achieving high image quality, while utilising a small state codebook for the purpose of specifying the block label, thus utilising low bit rates. Typically, FSVQ techniques require a very large memory space for the storage of the numerous state codebooks. However, with NNCS the memory space requirements can be reduced by a large factor (about 102–103) to manageable size, with little or no impairment of image quality, in comparison to FSVQ. This is accomplished by a neural network classification of finite states into representation states, whose associated states all share the same codebook. This codebook is populated by the most frequently occurring codevectors in the representation state. Numerical and pictorial results of simulation experiments are presented for the image LENA. They show that by using NNCS the required bit rate is about 0.25 bits/pixel at 30 dB peak SNR resulting in high quality reconstructed imagery, while the memory requirement is reduced by a factor of 256.

[1]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[2]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[3]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[4]  Robert M. Gray,et al.  Vector Quantizers and Predictive Quantizers for Gauss-Markov Sources , 1982, IEEE Trans. Commun..

[5]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[6]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[7]  Hsueh-Ming Hang,et al.  Predictive Vector Quantization of Images , 1985, IEEE Trans. Commun..

[8]  Robert M. Gray,et al.  Finite-state vector quantization for waveform coding , 1985, IEEE Trans. Inf. Theory.

[9]  Bhaskar Ramamurthi,et al.  Classified Vector Quantization of Images , 1986, IEEE Trans. Commun..

[10]  Morris Goldberg,et al.  Image Compression Using Adaptive Vector Quantization , 1986, IEEE Trans. Commun..

[11]  Tsuneo Saito,et al.  Picture coding by an adaptive multistage vector quantization , 1986 .

[12]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[13]  Allen Gersho,et al.  Variable block-size image coding , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  T. Kim New finite state vector quantizers for images , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[15]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..

[16]  C. N. Manikopoulos,et al.  Adaptive image sequence coding with neural network vector quantization , 1989, International 1989 Joint Conference on Neural Networks.

[17]  Philip A. Chou,et al.  Entropy-constrained vector quantization , 1989, IEEE Trans. Acoust. Speech Signal Process..