This paper presents a new approach toward the design of optimised codebooks by vector quantisation (VQ). A strategy of fuzzy k-means reinforced learning (FRL) is proposed which exploits the advantages offered by fuzzy clustering algorithms, competitive learning and knowledge of training vector and codevector configurations. Reinforced learning, which is consisted of attractive factor and repulsive factor, is used as a pre-process before using the conventional VQ algorithm, i.e. fuzzy k-means (FKM) algorithm. At each iteration of RL, codevectors move intelligently and intentionally toward an improved optimum codebook design. This is distinct from the standard FKM in which a random variation is introduced in the movement of the codevectors to escape from local minima. Experiments demonstrate that this results in a more effective representation of the training vectors by the codevectors and that the final codebook is nearer to the optimal solution in applications such as image compression. It has been found that the standard FKM yields improved quality of codebook design in this application when RL is used as a pre-process. The investigations have also indicated that new fuzzy k-means reinforced learning vector quantisation (FRLVQ) strategy is insensitive to the selection of both the initial codebook and a learning rate control parameter, which is the only additional parameter introduced by FRL from the standard FKM.
[1]
J. C. Dunn,et al.
A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters
,
1973
.
[2]
J. Bezdek,et al.
FCM: The fuzzy c-means clustering algorithm
,
1984
.
[3]
Liu Rui,et al.
Fuzzy c-Means Clustering Algorithm
,
2008
.
[4]
N.B. Karayiannis,et al.
Fuzzy vector quantization algorithms and their application in image compression
,
1995,
IEEE Trans. Image Process..
[5]
James C. Bezdek,et al.
Pattern Recognition with Fuzzy Objective Function Algorithms
,
1981,
Advanced Applications in Pattern Recognition.
[6]
Allen Gersho,et al.
Vector quantization and signal compression
,
1991,
The Kluwer international series in engineering and computer science.
[7]
Allen Gersho,et al.
Competitive learning and soft competition for vector quantizer design
,
1992,
IEEE Trans. Signal Process..
[8]
Robert M. Gray,et al.
An Algorithm for Vector Quantizer Design
,
1980,
IEEE Trans. Commun..
[9]
James C. Bezdek,et al.
Generalized clustering networks and Kohonen's self-organizing scheme
,
1993,
IEEE Trans. Neural Networks.