A stochastic approach to STDP

We present a digital implementation of the Spike Timing Dependent Plasticity (STDP) learning rule. The proposed digital implementation consists of an exponential decay (exp-decay) generator array and a STDP adaptor array. The weight values are stored in a digital memory, and the STDP adaptor w ill send these values to the exp-decay generator using a digital spike of which the duration is modulated according to these values. The exp-decay generator will then generate an exponential decay, which will be used by the STDP adaptor for performing the weight adaption. The exponential decay, which is computational expensive, is efficiently implemented by using a novel stochastic approach. This stochastic approach was fully analysed and characterised. We use a time multiplexing approach to achieve 8192 (8k) virtual STDP adaptors and exp-decay generators with only one physical adaptor and exp-decay generator respectively. We have validated our stochastic STDP approach with measurement results of a balanced excitation experiment. In that experiment, the competition (induced by STDP) between the synapses can establish a bimodal distribution of the synaptic weights: either towards zero (weak) or the maximum (strong) values. Our stochastic approach is therefore ideal for implementing the STDP learning rule in large-scale spiking neural networks running in real time.

[1]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[2]  E. Ross.  The Organization of Will , 1916, American Journal of Sociology.

[3]  André van Schaik,et al.  A compact neural core for digital implementation of the Neural Engineering Framework , 2014, 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings.

[4]  André van Schaik,et al.  An FPGA design framework for large-scale spiking neural networks , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[5]  Alan F. Murray,et al.  Synchrony detection and amplification by silicon neurons with STDP synapses , 2004, IEEE Transactions on Neural Networks.

[6]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[7]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[8]  André van Schaik,et al.  A neuromorphic implementation of multiple spike-timing synaptic plasticity rules for large-scale neural networks , 2015, Front. Neurosci..

[9]  André van Schaik,et al.  A mixed-signal implementation of a polychronous spiking neural network with delay adaptation , 2014, Front. Neurosci..

[10]  Alister Hamilton,et al.  Analog VLSI Circuit Implementation of an Adaptive Neuromorphic Olfaction Chip , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  André van Schaik,et al.  Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits , 2014, Proceedings of the IEEE.

[12]  Saeed Afshar,et al.  Turn Down That Noise: Synaptic Encoding of Afferent SNR in a Single Spiking Neuron , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[13]  Gregory Cohen,et al.  An FPGA Implementation of a Polychronous Spiking Neural Network with Delay Adaptation , 2013, Front. Neurosci..

[14]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[15]  André van Schaik,et al.  A compact reconfigurable mixed-signal implementation of synaptic plasticity in spiking neurons , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).