Fuzzy ARTRON: A General-Purpose Classifier Empowered by Fuzzy ART and Error Back-Propagation Learning

This paper introduces Fuzzy ARTRON as a general-purpose classifier that can do high-quality classification in continuous, discrete, linear, or nonlinear domains. The topology of Fuzzy ARTRON contains a fuzzy ART network, on which a perceptron layer is superimposed. The learning algorithms involve unsupervised ART learning and supervised error back-propagation learning. The former is used to auto-construct proper clusters through the fuzzy ART self-construction ability. This improves the convergence rate and alleviates the local minima problem usually associated with the error back-propagation learning network. The latter is used to dynamically associate clusters with proper classes via connection weight adjustment. This improves the generalization ability so that Fuzzy ARTRON can successfully handle the linearly nonseparable problems usually associated with fuzzy ART and the weak generalization problem usually associated with fuzzy ARTMAP. Finally, Fuzzy ARTRON employs fuzzy hyperboxes to do clustering, which leads to better generalization performance compared to conventional hyperboxes. Computer simulations were conducted to evaluate the performance and applicability of Fuzzy ARTRON under continuous, discrete, linear, or nonlinear domains.

[1]  Witold Pedrycz,et al.  Fuzzy-set based models of neurons and knowledge-based networks , 1993, IEEE Trans. Fuzzy Syst..

[2]  N. Karayiannis,et al.  A fuzzy algorithm for learning vector quantization , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[3]  C. V. D. Malsburg,et al.  Frank Rosenblatt: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms , 1986 .

[4]  Yinghua Lin,et al.  Using fuzzy partitions to create fuzzy systems from input-output data and set the initial weights in a fuzzy neural network , 1997, IEEE Trans. Fuzzy Syst..

[5]  James M. Keller,et al.  Evidence aggregation networks for fuzzy logic inference , 1992, IEEE Trans. Neural Networks.

[6]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[7]  A. K. Garga,et al.  A neural architecture for fuzzy classification with application to complex system tracking , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[8]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[9]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[10]  James C. Bezdek,et al.  Improved semi-supervised point-prototype clustering algorithms , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[11]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[12]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[13]  Hahn-Ming Lee,et al.  A neural network architecture for classification of fuzzy inputs , 1994 .

[14]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[15]  Madan M. Gupta,et al.  On fuzzy neuron models , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[16]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[17]  Abraham Kandel,et al.  Compensatory neurofuzzy systems with fast learning algorithms , 1998, IEEE Trans. Neural Networks.

[18]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[19]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[20]  Zhi-Qiang Liu,et al.  Fuzzy neural network in case-based diagnostic system , 1997, IEEE Trans. Fuzzy Syst..

[21]  Kwang Baek Kim,et al.  A fuzzy self-organized backpropagation using nervous system , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.