Achieving self-organization by lateral inhibition

A new model based on self-organization by lateral inhibition (SOLI) is proposed for self-organizing networks. This model combines many of the good features of previous models while overcoming many of the drawbacks. Experiments on this new model indicate that SOLI is well suited for unsupervised learning tasks, such clustering, has the potential to preserve topology, and can be used for novelty detection. It is computationally efficient with O (n) time complexity and is not sensitive to the initial network parameters.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[3]  Christof Koch,et al.  Comparison of feature combination strategies for saliency-based visual attention systems , 1999, Electronic Imaging.

[4]  Risto Miikkulainen,et al.  Topographic Receptive Fields and Patterned Lateral Interaction in a Self-Organizing Model of the Primary Visual Cortex , 1997, Neural Computation.

[5]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[7]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[8]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[9]  Samuel Kaski,et al.  Self organization of a massive document collection , 2000, IEEE Trans. Neural Networks Learn. Syst..

[10]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[11]  Risto Miikkulainen,et al.  Self-Organizing Process Based On Lateral Inhibition And Synaptic Resource Redistribution , 1991 .

[12]  Shun-Ichi Amari,et al.  Topographic organization of nerve fields , 1979, Neuroscience Letters.

[13]  Klaus Schulten,et al.  Self-organizing maps: stationary states, metastability and convergence rate , 1992, Biological Cybernetics.

[14]  T. Villmann,et al.  Topology Preservation in Self-Organizing Maps , 1999 .

[15]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.