Internal Categories with Irregular Geometry and Overlapping in ART Networks

PolyTope ARTMAP (PTAM) [6] is an ART neural network based on internal categories with irregular polytope (polygon in IRn) geometry. Categories in PTAM do not overlap, so that their expansion is limited by the other categories, and not by the category size. This makes the vigilance parameter unnecessary. What happens if categories have irregular geometries but overlap is allowed? This paper presents Overlapping PTAM (OPTAM), an alternative to PTAM based on polytope overlapping categories, which tries to answer this question. The comparison between the two approaches in classification tasks shows that category overlap does not reduce neither the classification error nor the number of categories, and it also requires vigilance as a tuning parameter. Futhermore, OPTAM provides a significant variability in the results among different data sets.

[1]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[2]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[3]  Gail A. Carpenter,et al.  Distributed ARTMAP: a neural network for fast distributed supervised learning , 1998, Neural Networks.

[4]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[5]  Yannis A. Dimitriadis,et al.  Study of distributed learning as a solution to category proliferation in Fuzzy ARTMAP based neural systems , 2003, Neural Networks.

[6]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[7]  S. Barro,et al.  A vigilance-free ART network with general geometry internal categories , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[8]  Georgios C. Anagnostopoulos,et al.  Ellipsoid ART and ARTMAP for incremental clustering and classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[9]  Yannis A. Dimitriadis,et al.  MicroARTMAP: use of mutual information for category reduction in fuzzy ARTMAP , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.