Soft Learning Vector Quantization and Clustering Algorithms Based on Mean-type Aggregation Operators

This paper presents a framework for developing soft learning vector quantization (LVQ) and clustering algorithms by minimizing reformulation functions based on aggregation operators. An axiomatic approach provides conditions for selecting the subset of all aggregation operators that lead to admissible reformulation functions. For mean-type aggregation operators, the construction of admissible reformulation functions reduces to the selection of admissible generator functions. Nonlinear generator functions result in a broad family of soft LVQ and clustering algorithms, which include fuzzy LVQ and clustering algorithms as special cases. The formulation considered in this paper also provides the basis for exploring the structure of the feature set by identifying outliers in the data. The procedure described in this paper for identifying outliers in the feature set is tested on a set of vowel data.

[1]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[2]  Nicholaos Zervos,et al.  Entropy-constrained learning vector quantization algorithms and their application in image compression , 2000, J. Electronic Imaging.

[3]  Kenney Ng,et al.  Practical Characteristics of Neural Network and Conventional Patterns Classifiers , 1990, NIPS.

[4]  Ronald R. Yager,et al.  On mean type aggregation , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[5]  James C. Bezdek,et al.  Two soft relatives of learning vector quantization , 1995, Neural Networks.

[6]  James C. Bezdek,et al.  An integrated approach to fuzzy learning vector quantization and fuzzy c-means clustering , 1997, IEEE Trans. Fuzzy Syst..

[7]  James C. Bezdek,et al.  Optimization of clustering criteria by reformulation , 1995, IEEE Trans. Fuzzy Syst..

[8]  W. Pedrycz,et al.  Generalized means as model of compensative connectives , 1984 .

[9]  Nicolaos B. Karayiannis Fuzzy Partition Entropies and Entropy Constrained Fuzzy Clustering Algorithms , 1997, J. Intell. Fuzzy Syst..

[10]  Didier Dubois,et al.  A review of fuzzy set aggregation connectives , 1985, Inf. Sci..

[11]  Allen Gersho,et al.  Competitive learning and soft competition for vector quantizer design , 1992, IEEE Trans. Signal Process..

[12]  Nicolaos B. Karayiannis,et al.  An axiomatic approach to soft learning vector quantization and clustering , 1999, IEEE Trans. Neural Networks.

[13]  Nicolaos B. Karayiannis Generalized fuzzy c-means algorithms , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[14]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.