TopoART: A Topology Learning Hierarchical ART Network

In this paper, a novel unsupervised neural network combining elements from Adaptive Resonance Theory and topology learning neural networks, in particular the Self-Organising Incremental Neural Network, is introduced. It enables stable on-line clustering of stationary and non-stationary input data. In addition, two representations reflecting different levels of detail are learnt simultaneously. Furthermore, the network is designed in such a way that its sensitivity to noise is diminished, which renders it suitable for the application to real-world problems.

[1]  Shen Furao,et al.  An enhanced self-organizing incremental neural network for online unsupervised learning , 2007, Neural Networks.

[2]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[3]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[4]  T. Kohonen.  Self-Organized Formation of Correct Feature Maps , 1982 .

[5]  Marko Tscherepanow,et al.  Image analysis methods for location proteomics , 2007 .

[6]  Martin Heckmann,et al.  Interactive online multimodal association for internal concept building in humanoids , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[7]  Shen Furao,et al.  An incremental network for on-line unsupervised classification and topology learning , 2006, Neural Networks.

[8]  Georgios C. Anagnostopoulos,et al.  Ellipsoid ART and ARTMAP for incremental clustering and classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[9]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[10]  Franz Kummert,et al.  An incremental approach to automated protein localisation , 2008, BMC Bioinformatics.

[11]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[12]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[13]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[14]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[15]  Franz Kummert,et al.  Direct imitation of human facial expressions by a user-interface robot , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[16]  Jerzy Neyman,et al.  PROCEEDINGS OF THE BERKELEY SYMPOSIUM ON MATHEMATICAL STATISTICS AND PROBABILITY (5TH) HELD JUNE 21-JULY 18, 1965, AND DECEMBER 27, 1965-JANUARY 7, 1966. VOLUME III. PHYSICAL SCIENCES AND ENGINEERING. , 1950 .

[17]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[18]  Boaz Lerner,et al.  Accurate and Fast Off and Online Fuzzy ARTMAP-Based Image Classification With Application to Genetic Abnormality Diagnosis , 2006, IEEE Transactions on Neural Networks.

[19]  Georgios C. Anagnostopoulos,et al.  Hypersphere ART and ARTMAP for unsupervised and supervised, incremental learning , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.