Managing Category Proliferation in Fuzzy ARTMAP Caused by Overlapping Classes

This paper addresses the difficulties brought about by overlapping classes in fuzzy ARTMAP (FAM). Training with such data leads to category proliferation, and classification is made difficult not only by the large number of categories but also the fact that such data can belong to either class. In this paper, changes were proposed to allow more than one class to be predicted during classification, and a number of modifications were explored to reduce the number of categories. The excessive creation of small categories was suppressed with the implementation of the modifications, and the predictive accuracy improved despite the significant reduction in number of categories. No major changes needed to be made to the FAM architecture.

[1]  M. Georgiopoulos,et al.  A fuzzy ARTMAP based classification technique of natural textures , 1999, 18th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.99TH8397).

[2]  R. Sabourin,et al.  Factors of overtraining with fuzzy ARTMAP neural networks , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[3]  Gail A. Carpenter,et al.  Distributed ARTMAP: a neural network for fast distributed supervised learning , 1998, Neural Networks.

[4]  B. W. Jervis,et al.  Integrated probabilistic simplified fuzzy ARTMAP , 2004 .

[5]  B. W. Jervis,et al.  Probabilistic simplified fuzzy ARTMAP (PSFAM) , 1999 .

[6]  Robert Fullér,et al.  Introduction to neuro-fuzzy systems , 1999, Advances in soft computing.

[7]  Von-Wun Soo,et al.  Pruning fuzzy ARTMAP using the minimum description length principle in learning from clinical databases , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[8]  Razvan Andonie,et al.  Fuzzy ARTMAP with input relevances , 2006, IEEE Transactions on Neural Networks.

[9]  J. L. Coronado,et al.  A neuro-fuzzy system that uses distributed learning for compact rule set generation , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[10]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[11]  Boaz Lerner,et al.  Accurate and Fast Off and Online Fuzzy ARTMAP-Based Image Classification With Application to Genetic Abnormality Diagnosis , 2006, IEEE Transactions on Neural Networks.

[12]  Yannis A. Dimitriadis,et al.  MicroARTMAP: use of mutual information for category reduction in fuzzy ARTMAP , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[13]  Zhiyong Tang,et al.  Voting Algorithm of Fuzzy ARTMAP and Its Application to Fault Diagnosis , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[14]  Mark A. Rubin,et al.  Application of fuzzy ARTMAP and ART-EMAP to automatic target recognition using radar range profiles , 1995, Neural Networks.

[15]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[16]  Jeong Su Lee,et al.  Learning method for fuzzy ARTMAP in a noisy environment , 1998 .

[17]  Issam Dagher,et al.  An ordering algorithm for pattern presentation in fuzzy ARTMAP that tends to improve generalization performance , 1999, IEEE Trans. Neural Networks.

[18]  Michael Georgiopoulos,et al.  Applications of Neural Networks in Electromagnetics , 2001 .

[19]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[20]  Yannis A. Dimitriadis,et al.  Study of distributed learning as a solution to category proliferation in Fuzzy ARTMAP based neural systems , 2003, Neural Networks.

[21]  Gail A. Carpenter,et al.  ARTMAP-IC and medical diagnosis: Instance counting and inconsistent cases , 1998, Neural Networks.

[22]  Georgios C. Anagnostopoulos,et al.  Overtraining in fuzzy ARTMAP: Myth or reality? , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[23]  Eduardo Gómez-Sánchez,et al.  Incremental Rule Pruning for Fuzzy ARTMAP Neural Network , 2005, ICANN.

[24]  Choong Woong Lee,et al.  A new learning method to improve the category proliferation problem in fuzzy ART , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[25]  Min Han,et al.  An improved fuzzy ARTMAP network and its application in wetland classification , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Michael Georgiopoulos,et al.  Boosted ARTMAP , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[27]  Robert F. Harrison,et al.  A modified fuzzy ARTMAP architecture for the approximation of noisy mappings , 1995, Neural Networks.