Live demonstration: Multiple-timescale plasticity in a neuromorphic system

I. Demo Description Traditionally, neuromorphic ICs have integrated only reduced subsets of the rich repertoire of plasticity seen in biological preparations [1], [2]. The focus with respect to long term plasticity has been mostly on Spike-Time-Dependent Plasticity (STDP) [1]. Several ICs have also implemented forms of presynaptic short term dynamics, which filter synaptic pulse input, but have no influence on other timescales of plasticity. Here, we demonstrate an IC that implements short-term-, long-term-, and metaplasticity in an integrated way following [3], where these three different timescales interact to form the overall weight at the synapse. Fig. 1 shows an example presynaptic pattern with depression and the membrane trace as input for learning [3]. The resulting analog weight state shows the influence of presynaptic depression in the step increases, comparable to [1]. Also, different settings for the learning threshold exhibit a bias towards weight increase/decrease on a metaplastic (i.e. slow) timescale similar to [2]. The overall setup features several Maple-ICs of each 16 neurons and 512 of the above synapses, interlinked via FPGA-based pulse transmission. This allows network sizes of up to 200 neurons, sufficient to demonstrate the necessity for this type of learning for a range of computational neuroscience models.

[1]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[2]  Johannes Schemmel,et al.  Implementing Synaptic Plasticity in a VLSI Spiking Neural Network Model , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[3]  Y. Dan,et al.  Spike-timing-dependent synaptic modification induced by natural spike trains , 2002, Nature.

[4]  Nan Du,et al.  Waveform Driven Plasticity in BiFeO3 Memristive Devices: Model and Implementation , 2012, NIPS.

[5]  René Schüffny,et al.  Replicating experimental spike and rate based neural learning in CMOS , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[6]  René Schüffny,et al.  Synapse dynamics in CMOS derived from a model of neurotransmitter release , 2011, 2011 20th European Conference on Circuit Theory and Design (ECCTD).

[7]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[9]  Ryo Shimizu,et al.  Pulse-Type Hardware Neural Network with Two Time Windows in STDP , 2008, ICONIP.

[10]  Johannes Partzsch,et al.  Rate and Pulse Based Plasticity Governed by Local Synaptic State Variables , 2010, Front. Syn. Neurosci..

[11]  Stephan Henker,et al.  Biology-derived synaptic dynamics and optimized system architecture for neuromorphic hardware , 2010, Proceedings of the 17th International Conference Mixed Design of Integrated Circuits and Systems - MIXDES 2010.

[12]  Alister Hamilton,et al.  Analog VLSI Circuit Implementation of an Adaptive Neuromorphic Olfaction Chip , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  Paul Miller,et al.  Synaptic Plasticity and Connectivity Requirements to Produce Stimulus-Pair Specific Responses in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[14]  Giacomo Indiveri,et al.  Real-Time Classification of Complex Patterns Using Spike-Based Learning in Neuromorphic VLSI , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[15]  Y. Dan,et al.  Contribution of individual spikes in burst-induced long-term synaptic modification. , 2006, Journal of neurophysiology.