An analysis of competitive and re-initialization learning for adaptive vector quantization

This paper describes an analysis of competitive and reinitialization learning (CRL) for adaptive vector quantization (AVQ) which is a version of vector quantization (VQ) in order for digital coding of signals to adapt to changing statistics of the signal sources. The CRL has been designed for achieving equi-distortion or asymptotically optimal quantization to overcome the under-utilization problem or the local minimum problem of vector quantization networks, while its performance in adaptation speed and obtained distortion level is shown to be higher than the conventional AVQ algorithms such as the optimal adaptive k-means algorithm (OPTM) and diversity oriented competitive learning II (DOCL-II). In this paper, after reviewing the CRL algorithm, we examine how the CRL algorithm works for various source signals such as nonstationary 2D vectors and high dimensional images. Furthermore, we compare the performance of the CRL with the OPTM and the DOCL-II.

[1]  C.H. Sequin,et al.  Optimal adaptive k-means algorithm with dynamic adjustment of learning rate , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[2]  Takeshi Nishida,et al.  Competitive learning using gradient and reinitialization methods for adaptive vector quantization , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[3]  Kazuo Murota,et al.  A fast Voronoi-diagram algorithm with applications to geographical optimization problems , 1984 .

[4]  James E. Fowler,et al.  Adaptive vector quantization for the coding of nonstationary sources , 1996 .

[5]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[6]  Allen Gersho,et al.  Asymptotically optimal block quantization , 1979, IEEE Trans. Inf. Theory.

[7]  Naonori Ueda,et al.  A new competitive learning approach based on an equidistortion principle for designing optimal vector quantizers , 1994, Neural Networks.