An incremental self-organizing neural network based on enhanced competitive Hebbian learning

Self-organizing neural networks are important tools for realizing unsupervised learning. Recently, a difficult task has involved the incremental, efficient and robust learning in noisy environments. Most of the existing techniques are poor in this regard. In this paper, we first propose a new topology generating method called enhanced competitive Hebbian learning (enhanced CHL), and then propose a novel incremental self-organizing neural network based on the enhanced CHL method, called enhanced incremental growing neural gas (Hi-GNG). The experiments presented in this paper show that the Hi-GNG algorithm can automatically and efficiently generate a topological structure with a suitable number of neurons and that the proposed algorithm is robust to noisy data.

[1]  Ernesto Cuadros-Vargas,et al.  DB-GNG: A constructive Self-Organizing Map based on densilty , 2007, 2007 International Joint Conference on Neural Networks.

[2]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[3]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[4]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[5]  José García Rodríguez,et al.  Fast Autonomous Growing Neural Gas , 2011, The 2011 International Joint Conference on Neural Networks.

[6]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[7]  Shen Furao,et al.  An incremental network for on-line unsupervised classification and topology learning , 2006, Neural Networks.

[8]  David West,et al.  A comparison of SOM neural network and hierarchical clustering methods , 1996 .

[9]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[10]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[11]  T. Martínez,et al.  Competitive Hebbian Learning Rule Forms Perfectly Topology Preserving Maps , 1993 .

[12]  P. N. Suganthan,et al.  Robust growing neural gas algorithm with application in cluster analysis , 2004, Neural Networks.

[13]  Jan Faigl,et al.  Growing neural gas efficiently , 2013, Neurocomputing.

[14]  Mahesh Motwani,et al.  Survey of clustering algorithms for MANET , 2009, ArXiv.

[15]  Ke-Lin Du,et al.  Clustering: A neural network approach , 2010, Neural Networks.

[16]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[17]  A. Ennaji,et al.  An incremental growing neural gas learns topologies , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..