Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks

We demonstrate that spiking neural networks encoding information in the timing of single spikes are capable of computing and learning clusters from realistic data. We show how a spiking neural network based on spike-time coding and Hebbian learning can successfully perform unsupervised clustering on real-world data, and we demonstrate how temporal synchrony in a multilayer network can induce hierarchical clustering. We develop a temporal encoding of continuously valued data to obtain adjustable clustering capacity and precision with an efficient use of neurons: input variables are encoded in a population code by neurons with graded and overlapping sensitivity profiles. We also discuss methods for enhancing scale-sensitivity of the network and show how the induced synchronization of neurons within early RBF layers allows for the subsequent detection of complex clusters.

[1]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Terrence J. Sejnowski,et al.  Neuronal Tuning: To Sharpen or Broaden? , 1999, Neural Computation.

[3]  Konrad Paul Kording,et al.  Learning with two sites of synaptic integration , 2000, Network.

[4]  DeLiang Wang,et al.  Synchrony and Desynchrony in Integrate-and-Fire Oscillators , 1999, Neural Computation.

[5]  Wolfgang Maass,et al.  Fast Sigmoidal Networks via Spiking Neurons , 1997, Neural Computation.

[6]  T Natschläger,et al.  Spatial and temporal pattern analysis via spiking neurons. , 1998, Network.

[7]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[8]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[9]  Dean V. Buonomano,et al.  A Neural Network Model of Temporal Code Generation and Position-Invariant Pattern Recognition , 1999, Neural Computation.

[10]  Jacques Gautrais,et al.  SpikeNET: A simulator for modeling large networks of integrate and fire neurons , 1999, Neurocomputing.

[11]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[12]  Jan J. Koenderink,et al.  Information in channel-coded systems: correlated receivers , 1992, Biological Cybernetics.

[13]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[14]  Peter König,et al.  Stimulus-Dependent Assembly Formation of Oscillatory Responses: I. Synchronization , 1991, Neural Computation.

[15]  W. Heiligenberg,et al.  How sensory maps could enhance resolution through ordered arrangements of broadly tuned receivers , 2004, Biological Cybernetics.

[16]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[17]  Christian W. Eurich,et al.  Multidimensional Encoding Strategy of Spiking Neurons , 2000, Neural Computation.

[18]  Michael Werman,et al.  An On-Line Agglomerative Clustering Method for Nonstationary Data , 1999, Neural Computation.

[19]  Christoph von der Malsburg,et al.  The What and Why of Binding The Modeler’s Perspective , 1999, Neuron.

[20]  Paolo Del Giudice,et al.  Efficient Event-Driven Simulation of Large Networks of Spiking Neurons and Dynamical Synapses , 2000, Neural Computation.

[21]  Wulfram Gerstner,et al.  Intrinsic Stabilization of Output Rates by Spike-Based Hebbian Learning , 2001, Neural Computation.

[22]  DeLiang Wang,et al.  Perceiving without Learning: From Spirals to Inside/Outside Relations , 1998, NIPS.

[23]  Peter E. Latham,et al.  Narrow Versus Wide Tuning Curves: What's Best for a Population Code? , 1999, Neural Computation.

[24]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[25]  Han La Poutré,et al.  Unsupervised class detection by adaptive sampling and density estimation , 1999 .