Wide dynamic range weights and biologically realistic synaptic dynamics for spike-based learning circuits

Spike-based neuromorphic learning circuits typically represent their synaptic weights as voltages, and convert them into post-synaptic currents so that they can be integrated by their afferent silicon neuron. This voltage-to-current conversion is often done using a single transistor. This results in an exponential (for weak-inversion) or quadratic (for strong inversion) non-linear transformation which severely restricts the type of learning algorithms that can be implemented. To overcome this problem we propose a range of solutions that perform a linear transformation fro m weight voltage to synaptic current, simplifying the implementation of a spike-based learning rules. We demonstrate the application of these conversion circuits using current-mode integrators that produce alpha-functions with biologically realistic temporal dynamics and amplitudes that are linearly proportional to the synaptic weights. The circuits proposed are low-power, and can be integrated in a wide range of spike-based learning framework s that have been recently proposed. We describe the advantages and disadvantages of the various solutions proposed and validate them with circuit simulation results.

[1]  Paul E. Hasler,et al.  Floating gate synapses with spike time dependent plasticity , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[2]  Chiara Bartolozzi,et al.  Neuromorphic Electronic Circuits for Building Autonomous Cognitive Systems , 2014, Proceedings of the IEEE.

[3]  Mario Pannunzi,et al.  Classification of Correlated Patterns with a Configurable Analog VLSI Neural Network of Spiking Neurons and Self-Regulating Plastic Synapses , 2009, Neural Computation.

[4]  Wolfgang Maass,et al.  Reward-Modulated Hebbian Learning of Decision Making , 2010, Neural Computation.

[5]  Chiara Bartolozzi,et al.  Synaptic Dynamics in Analog VLSI , 2007, Neural Computation.

[6]  Giacomo Indiveri,et al.  A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses , 2015, Front. Neurosci..

[7]  Mostafa Rahimi Azghadi,et al.  Spike-Based Synaptic Plasticity in Silicon: Design, Implementation, Application, and Challenges , 2014, Proceedings of the IEEE.

[8]  Johannes Schemmel,et al.  Is a 4-Bit Synaptic Weight Resolution Enough? – Constraints on Enabling Spike-Timing Dependent Plasticity in Neuromorphic Hardware , 2012, Front. Neurosci..

[9]  Shih-Chii Liu,et al.  Analog VLSI: Circuits and Principles , 2002 .

[10]  Hongming Zhou,et al.  Silicon spiking neurons for hardware implementation of extreme learning machines , 2013, Neurocomputing.

[11]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.