Learning and optimisation of hierarchical clusterings with ART-based modular networks

This paper introduces two optimization methods into learning of hierarchical clusterings with modular adaptive resonance theory (ART) networks. The aims are to reduce the complexity of trained networks and "clean up" the category prototypes during the learning process while maintaining the useful properties of hierarchical ART networks like fast and stable learning, and the ability to build category hierarchies incrementally. The experimental results demonstrate a significant reduction in category complexity as well as some improvement on a range of other metrics at a cost of varying amounts of additional training time. We suggest that scheduling the optimisation steps may be crucial in achieving an optimal trade-off.

[1]  Guszti Bartfai,et al.  An ART-based modular architecture for learning hierarchical clusterings , 1996, Neurocomputing.

[2]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[3]  Yukihiro Matsubara,et al.  arboART: ART based hierarchical clustering and its application to questionnaire data analysis , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[4]  Roger White,et al.  Adaptive Resonance Theory-based Modular Networks for Incremental Learning of Hierarchical Clusterings , 1997, Connect. Sci..

[5]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[6]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[7]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[8]  B. Moore,et al.  ART1 and pattern clustering , 1989 .

[9]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[10]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[11]  Michael Anderson,et al.  NIRS: Large scale ART-1 neural architectures for engineering design retrieval , 1994, Neural Networks.