Relevance determination in Learning Vector Quantization

We propose a method to automatically determine the relevance of the input dimensions of a learning vector quantization (LVQ) architecture during training. The method is based on Hebbian learning and introduces weighting factors of the input dimensions which are automatically adapted to the speci c problem. The bene ts are twofold: On the one hand, the incorporation of relevance factors in the LVQ architecture increases the overall performance of the classi cation and adapts the metric to the speci c data used for training. On the other hand, the method induces a pruning algorithm, i.e. an automatic detection of the input dimensions which do not contribute to the overall classi er. Hence we obtain a possibly more eAEcient classi cation and we gain insight to the role of the data dimensions.

[1]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .

[2]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[3]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Wlodzislaw Duch,et al.  Extraction of crisp logical rules using constrained backpropagation networks , 1997, ESANN.

[5]  Hans Ulrich Simon,et al.  Robust Trainability of Single Neurons , 1995, J. Comput. Syst. Sci..