Factors of overtraining with fuzzy ARTMAP neural networks

In this paper, the impact of overtraining on the performance of fuzzy ARTMAP neural networks is assessed for pattern recognition problems consisting of overlapping class distributions, and consisting of complex decision boundaries with no overlap. Computer simulations are performed with fuzzy ARTMAP networks trained for one epoch, through cross-validation, and until network convergence, using several data sets representing these pattern recognition problems. By comparing the generalisation error and resources required by these networks, the extent of overtraining due to factors such as data set structure, training strategy, number of training epochs, data normalisation, and training set size, is demonstrated. A significant degradation in fuzzy ARTMAP performance due to overtraining is shown to depend on the training set size and the number of training epochs for pattern recognition problems with overlapping class distributions.

[1]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[2]  Ah-Hwee Tan,et al.  Rule Extraction, Fuzzy ARTMAP, and Medical Databases , 1993 .

[3]  Georgios C. Anagnostopoulos,et al.  Cross-validation in Fuzzy ARTMAP for large databases , 2001, Neural Networks.

[4]  Michael Georgiopoulos,et al.  Boosted ARTMAP , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[5]  Stephen Grossberg,et al.  A What-and-Where fusion neural network for recognition and tracking of multiple radar emitters , 2001, Neural Networks.

[6]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[7]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[8]  John Hallam,et al.  IEEE International Joint Conference on Neural Networks , 2005 .

[9]  Gail A. Carpenter,et al.  Distributed Learning, Recognition, and Prediction by ART and ARTMAP Neural Networks , 1997, Neural Networks.

[10]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[11]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[12]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[13]  Gail A. Carpenter,et al.  ART neural networks for remote sensing: vegetation classification from Landsat TM and terrain data , 1997, IEEE Trans. Geosci. Remote. Sens..

[14]  M. Stone.  Asymptotics for and against cross-validation , 1977 .

[15]  B. Lerner,et al.  An empirical study of fuzzy ARTMAP applied to cytogenetics , 2004, 2004 23rd IEEE Convention of Electrical and Electronics Engineers in Israel.

[16]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[17]  Yannis A. Dimitriadis,et al.  MicroARTMAP: use of mutual information for category reduction in fuzzy ARTMAP , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[18]  Gail A. Carpenter.  Distributed ART Networks for Learning, Recognition, and Prediction , 1996 .

[19]  Paseo Alfonso Xiii,et al.  MicroARTMAP: use of Mutual Information for Category Reduction in Fuzzy ARTMAP , 2000 .

[20]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[21]  Georgios C. Anagnostopoulos,et al.  Overtraining in fuzzy ARTMAP: Myth or reality? , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[22]  Flávio Bortolozzi,et al.  A Cognitive Approach to Off-Line Signature Verification , 1997, Int. J. Pattern Recognit. Artif. Intell..