Soft learning vector quantization and clustering algorithms based on ordered weighted aggregation operators

This paper presents the development and investigates the properties of ordered weighted learning vector quantization (LVQ) and clustering algorithms. These algorithms are developed by using gradient descent to minimize reformulation functions based on aggregation operators. An axiomatic approach provides conditions for selecting aggregation operators that lead to admissible reformulation functions. Minimization of admissible reformulation functions based on ordered weighted aggregation operators produces a family of soft LVQ and clustering algorithms, which includes fuzzy LVQ and clustering algorithms as special cases. The proposed LVQ and clustering algorithms are used to perform segmentation of magnetic resonance (MR) images of the brain. The diagnostic value of the segmented MR images provides the basis for evaluating a variety of ordered weighted LVQ and clustering algorithms.

[1]  James C. Bezdek,et al.  A comparison of neural network and fuzzy clustering techniques in segmenting magnetic resonance images of the brain , 1992, IEEE Trans. Neural Networks.

[2]  N. Karayiannis.  Soft learning vector quantization and clustering algorithms based on reformulation , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[3]  Nicolaos B. Karayiannis,et al.  Entropy-constrained learning vector quantization algorithms and their application in image compression , 1997, Electronic Imaging.

[4]  Ronald R. Yager,et al.  On mean type aggregation , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[5]  S P Raya,et al.  Low-level segmentation of 3-D magnetic resonance brain images-a rule-based system. , 1990, IEEE transactions on medical imaging.

[6]  James C. Bezdek,et al.  Two soft relatives of learning vector quantization , 1995, Neural Networks.

[7]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[8]  Ronald R. Yager,et al.  Quantifier guided aggregation using OWA operators , 1996, Int. J. Intell. Syst..

[9]  W. Pedrycz,et al.  Generalized means as model of compensative connectives , 1984 .

[10]  James C. Bezdek,et al.  Fuzzy Kohonen clustering networks , 1994, Pattern Recognit..

[11]  U Tiede,et al.  3-D segmentation of MR images of the head for 3-D display. , 1990, IEEE transactions on medical imaging.

[12]  R. Yager.  Families of OWA operators , 1993 .

[13]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[14]  G. C. Levy,et al.  Characterization of normal brain tissue using seven calculated MRI parameters and a statistical analysis system , 1989, Magnetic resonance in medicine.

[15]  James C. Bezdek,et al.  Repairs to GLVQ: a new family of competitive learning schemes , 1996, IEEE Trans. Neural Networks.

[16]  Nicholaos Zervos,et al.  Entropy-constrained learning vector quantization algorithms and their application in image compression , 2000, J. Electronic Imaging.

[17]  Ioannis Pitas,et al.  Robust and adaptive techniques in self-organizing neural networks , 1998, Int. J. Comput. Math..

[18]  Manolis A. Christodoulou,et al.  Convergence properties of a class of learning vector quantization algorithms , 1996, IEEE Trans. Image Process..

[19]  Didier Dubois,et al.  A review of fuzzy set aggregation connectives , 1985, Inf. Sci..

[20]  Nicolaos B. Karayiannis.  Fuzzy Partition Entropies and Entropy Constrained Fuzzy Clustering Algorithms , 1997, J. Intell. Fuzzy Syst..

[21]  James C. Bezdek,et al.  Optimization of clustering criteria by reformulation , 1995, IEEE Trans. Fuzzy Syst..

[22]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decision-making , 1988 .

[23]  Allen Gersho,et al.  Competitive learning and soft competition for vector quantizer design , 1992, IEEE Trans. Signal Process..

[24]  Nicolaos B. Karayiannis,et al.  Fuzzy algorithms for learning vector quantization , 1996, IEEE Trans. Neural Networks.

[25]  Ronald R. Yager,et al.  Including importances in OWA aggregations using fuzzy systems modeling , 1998, IEEE Trans. Fuzzy Syst..

[26]  Nicolaos B. Karayiannis,et al.  An axiomatic approach to soft learning vector quantization and clustering , 1999, IEEE Trans. Neural Networks.

[27]  Nicolaos B. Karayiannis.  Generalized fuzzy c-means algorithms , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[28]  N. Karayiannis.  Ordered weighted learning vector quantization and clustering algorithms , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[29]  Chong-Ho Choi,et al.  LVQ with a weighted objective function , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[30]  James C. Bezdek,et al.  An integrated approach to fuzzy learning vector quantization and fuzzy c-means clustering , 1997, IEEE Trans. Fuzzy Syst..

[31]  N.B. Karayiannis,et al.  Fuzzy vector quantization algorithms and their application in image compression , 1995, IEEE Trans. Image Process..

[32]  R. Yager.  Quantifier guided aggregation using OWA operators , 1996, Int. J. Intell. Syst..

[33]  Nicolaos B. Karayiannis,et al.  A methodology for constructing fuzzy algorithms for learning vector quantization , 1997, IEEE Trans. Neural Networks.

[34]  I Pitas,et al.  Order statistics learning vector quantizer , 1996, IEEE Trans. Image Process..

[35]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..