A Spiking Self-Organizing Map Combining STDP, Oscillations, and Continuous Learning

The self-organizing map (SOM) is a neural network algorithm to create topographically ordered spatial representations of an input data set using unsupervised learning. The SOM algorithm is inspired by the feature maps found in mammalian cortices but lacks some important functional properties of its biological equivalents. Neurons have no direct access to global information, transmit information through spikes and may be using phasic coding of spike times within synchronized oscillations, receive continuous input from the environment, do not necessarily alter network properties such as learning rate and lateral connectivity throughout training, and learn through relative timing of action potentials across a synaptic connection. In this paper, a network of integrate-and-fire neurons is presented that incorporates solutions to each of these issues through the neuron model and network structure. Results of the simulated experiments assessing map formation using artificial data as well as the Iris and Wisconsin Breast Cancer datasets show that this novel implementation maintains fundamental properties of the conventional SOM, thereby representing a significant step toward further understanding of the self-organizational properties of the brain while providing an additional method for implementing SOMs that can be utilized for future modeling in software or special purpose spiking neuron hardware.

[1]  Jonathan C. Horton,et al.  Anatomical Demonstration of Ocular Dominance Columns in Striate Cortex of the Squirrel Monkey , 1996, The Journal of Neuroscience.

[2]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[3]  D. J. Felleman,et al.  Topographic reorganization of somatosensory cortical areas 3b and 1 in adult monkeys following restricted deafferentation , 1983, Neuroscience.

[4]  W. Singer,et al.  Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. , 2008, Journal of neurophysiology.

[5]  Vivien A. Casagrande,et al.  The Afferent, Intrinsic, and Efferent Connections of Primary Visual Cortex in Primates , 1994 .

[6]  Iren Valova,et al.  Learning and data clustering with an RBF-based spiking neuron network , 2006, J. Exp. Theor. Artif. Intell..

[7]  Terrence J. Sejnowski,et al.  A Unifying Objective Function for Topographic Mappings , 1997, Neural Computation.

[8]  D. Polani Measures for the organization of self-organizing maps , 2001 .

[9]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[10]  R. Palmer,et al.  , Introduction to the Theory of Neural Computation 1 , 2007 .

[11]  Michael B. Calford,et al.  Dynamic representational plasticity in sensory cortex , 2002, Neuroscience.

[12]  Liam McDaid,et al.  SWAT: A Spiking Neural Network Training Algorithm for Classification Problems , 2010, IEEE Transactions on Neural Networks.

[13]  R. Axel,et al.  Odorant Receptors Govern the Formation of a Precise Topographic Map , 1998, Cell.

[14]  Russell Keith-Magee Learning and development in Kohonen-style self organising maps. , 2001 .

[15]  Soo-Young Lee,et al.  Training Algorithm with Incomplete Data for Feed-Forward Neural Networks , 1999, Neural Processing Letters.

[16]  J. S. Law,et al.  Modeling the development of organization for orientation preference in primary visual cortex , 2009 .

[17]  Qingxiang Wu,et al.  Learning under weight constraints in networks of temporal encoding spiking neurons , 2006, Neurocomputing.

[18]  Diego Vidaurre,et al.  A Quick Assessment of Topology Preservation for SOM Structures , 2007, IEEE Transactions on Neural Networks.

[19]  Xiao-Jing Wang Neurophysiological and computational principles of cortical rhythms in cognition. , 2010, Physiological reviews.

[20]  J.H. Kaas,et al.  How do features of sensory representations develop? , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[21]  Héctor Mesa,et al.  Imprecise correlated activity in self-organizing maps of spiking neurons , 2008, Neural Networks.

[22]  Iren Valova,et al.  CQoCO: A measure for comparative quality of coverage and organization for self-organizing maps , 2010, Neurocomputing.

[23]  Teuvo Kohonen,et al.  Self-Organizing Maps, Third Edition , 2001, Springer Series in Information Sciences.

[24]  Andrew Philippides,et al.  Reconciling the STDP and BCM Models of Synaptic Plasticity in a Spiking Recurrent Neural Network , 2010, Neural Computation.

[25]  Gustavo Deco,et al.  Computational neuroscience of vision , 2002 .

[26]  W. Singer,et al.  The gamma cycle , 2007, Trends in Neurosciences.

[27]  Ronald J. MacGregor,et al.  Neural and brain modeling , 1987 .

[28]  Michael Brecht,et al.  Map Plasticity in Somatosensory Cortex , 2005, Science.

[29]  Li Min Chen,et al.  Modality maps within primate somatosensory cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[30]  B. Wandell The neurobiological basis of seeing words , 2011, Annals of the New York Academy of Sciences.

[31]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[32]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[33]  T. Woolsey,et al.  Somatosensory Cortex: Structural Alterations following Early Injury to Sense Organs , 1973, Science.

[34]  Narayan Srinivasa,et al.  Self-Organizing Spiking Neural Model for Learning Fault-Tolerant Spatio-Motor Transformations , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Margaret J. Eppstein,et al.  Data-Driven Cluster Reinforcement and Visualization in Sparsely-Matched Self-Organizing Maps , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Rufin van Rullen,et al.  Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex , 2001, Neural Computation.

[37]  László Bakó,et al.  Real-time classification of datasets with hardware embedded neuromorphic neural networks , 2010, Briefings Bioinform..

[38]  Xiaoke Chen,et al.  A Gustotopic Map of Taste Qualities in the Mammalian Brain , 2011, Science.

[39]  M M Merzenich,et al.  Representation of cochlea within primary auditory cortex in the cat. , 1975, Journal of neurophysiology.

[40]  Krzysztof J. Cios,et al.  Self-Organization in Networks of Spiking Neurons , 2001 .

[41]  L. Abbott Cortical Remapping through Spike Timing-Dependent Plasticity , 2005 .

[42]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[43]  T. Hensch Critical period regulation. , 2004, Annual review of neuroscience.

[44]  Michael Schmitt,et al.  Self-organization of spiking neurons using action potential timing , 1998, IEEE Trans. Neural Networks.

[45]  Chung-Chian Hsu,et al.  Visualized Analysis of Mixed Numeric and Categorical Data Via Extended Self-Organizing Map , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Risto Miikkulainen,et al.  Self-organization and segmentation in a laterally connected orientation map of spiking neurons , 1998, Neurocomputing.

[47]  G. Blasdel,et al.  Voltage-sensitive dyes reveal a modular organization in monkey striate cortex , 1986, Nature.

[48]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[49]  T. Woolsey,et al.  Comparative anatomical studies of the Sml face cortex with special reference to the occurrence of “barrels” in layer IV , 1975, The Journal of comparative neurology.

[50]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[51]  D. Hubel,et al.  Anatomical demonstration of orientation columns in macaque monkey , 1978, The Journal of comparative neurology.