A max-min learning rule for Fuzzy ART

Fuzzy Adaptive Resonance Theory (Fuzzy ART) is an unsupervised neural network, which clusters data effectively based on learning from training data. In the learning process, Fuzzy ARTs update the weight vector of the wining category based on the current input pattern from training data. Fuzzy ARTs, however, only learn from patterns whose values are smaller than values of stored patterns. In this paper, we propose a max-min learning rule of Fuzzy ART that learns all patterns of training data and reduces effect of abnormal training patterns. Our learning rule changes the weight vector of the wining category based on the minimal difference between the current input pattern and the old weight vector of the wining category. We have also conducted experiments on seven benchmark datasets to prove the effectiveness of the proposed learning rule. Experiment results show that clustering results of Fuzzy ART with our learning rule (Max-min Fuzzy ART) is significantly higher than that of other models in complex datasets.

[1]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[2]  Riyadh Kenaya,et al.  Euclidean ART Neural Networks , 2008 .

[3]  Kunikazu Kobayashi,et al.  A Reinforcement Learning System Based on State Space Construction Using Fuzzy ART A Reinforcement Learning System Based on State Space Construction Using Fuzzy ART , 2005 .

[4]  Yannis A. Dimitriadis,et al.  Learning from noisy information in FasArt and FasBack neuro-fuzzy systems , 2001, Neural Networks.

[5]  Thomas Burwick,et al.  Optimal Algorithmic Complexity of Fuzzy ART , 1998, Neural Processing Letters.

[6]  Yoshifumi Nishio,et al.  Fuzzy Adaptive Resonance Theory with Group Learning and its Applications , 2007 .

[7]  Michael Georgiopoulos,et al.  Fuzzy ART properties , 1995, Neural Networks.

[8]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[9]  Yoshifumi Nishio,et al.  Fuzzy Adaptive Resonance Theory Combining Overlapped Category in consideration of connections , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[10]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[11]  Stephen Grossberg,et al.  Fuzzy ARTMAP: an adaptive resonance architecture for incremental learning of analog maps , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[12]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[13]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[14]  Georgios C. Anagnostopoulos,et al.  Category regions as new geometrical concepts in Fuzzy-ART and Fuzzy-ARTMAP , 2002, Neural Networks.

[15]  Yi Lu Murphey,et al.  A Supervised Fuzzy Adaptive Resonance Theory with Distributed Weight Update , 2010, ISNN.

[16]  GrossbergS..  Adaptive pattern classification and universal recoding , 1976 .

[17]  Issam Dagher,et al.  An ordering algorithm for pattern presentation in fuzzy ARTMAP that tends to improve generalization performance , 1999, IEEE Trans. Neural Networks.