Genetic Optimization of ART Neural Network Architectures

This paper focuses on the evolution of ARTMAP architectures, using genetic algorithms, with the objective of improving generalization performance and alleviating the ART category proliferation problem. We refer to the resulting architectures as GFAM, GEAM, and GGAM. We demonstrate through extensive experimentation that evolved ARTMAP architectures exhibit good generalization and are of small size, while consuming reasonable computational effort to produce an optimal or a sub-optimal network. Furthermore, we compare the performance of GFAM, GEAM and GGAM with other competitive ARTMAP architectures that have appeared in the literature and addressed the category proliferation problem in ART. This comparison indicates that GFAM, GEAM and GGAM have superior performance (generalize better, are of smaller size, and require less computations) compared with other competitive ARTMAP architectures.

[1]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[2]  Michael Georgiopoulos,et al.  Applications of Neural Networks in Electromagnetics , 2001 .

[3]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[4]  Mansooreh Mollaghasemi,et al.  GFAM: A Genetic Algorithm Optimization of Fuzzy ARTMAP , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[5]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[6]  Georgios C. Anagnostopoulos,et al.  Novel approaches in adaptive resonance theory for machine learning , 2001 .

[7]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[10]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[11]  Y.A. Dimitriadis,et al.  Safe-/spl mu/ARTMAP: a new solution for reducing category proliferation in fuzzy ARTMAP , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[12]  Georgios C. Anagnostopoulos,et al.  Exemplar-based pattern recognition via semi-supervised learning , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..