Biology-derived synaptic dynamics and optimized system architecture for neuromorphic hardware

Neuromorphic circuits try to replicate aspects of the information processing in neural tissue. Historically, this has often meant some kind of long-term learning function which slowly adjusts the weight of a synapse to achieve a certain target network function. Recently, short-term dynamics at the synapse have also gained significant attention due to their role in dynamic and temporal information processing. However, only very few neuromorphic circuits have incorporated short term dynamics, with still fewer of these implementations being biologically realistic. We derive a circuit for biologically relevant short term dynamics, showing its accuracy with respect to biological measurements. Since this circuit significantly increases the overall complexity of the synapse, a direct integration in the synapse would be prohibitive. Thus, in addition to the short term dynamics, we also present a novel configurable topology for the neurons and synapses on chip which achieves a compact and flexible overall design while still augmenting all synapses with the new short term dynamics.

[1]  Markus Diesmann,et al.  Activity dynamics and propagation of synchronous spiking in locally connected random networks , 2003, Biological Cybernetics.

[2]  Del Giudice Paolo Attractor dynamics in VLSI , 2009 .

[3]  Wolfgang Maass,et al.  Cerebral Cortex Advance Access published February 15, 2006 A Statistical Analysis of Information- Processing Properties of Lamina-Specific , 2022 .

[4]  René Schüffny,et al.  BCM and Membrane Potential: Alternative Ways to Timing Dependent Plasticity , 2008, ICONIP.

[5]  Shih-Chii Liu,et al.  Modeling Short-Term Synaptic Depression in Silicon , 2003, Neural Computation.

[6]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Alister Hamilton,et al.  Analog VLSI Circuit Implementation of an Adaptive Neuromorphic Olfaction Chip , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  Johannes Schemmel,et al.  Modeling Synaptic Plasticity within Networks of Highly Accelerated I&F Neurons , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[9]  William J Spain,et al.  Synaptic depression as a timing device. , 2005, Physiology.

[10]  Chiara Bartolozzi,et al.  Selective attention implemented with dynamic synapses and integrate-and-fire neurons , 2006, Neurocomputing.

[11]  Bertram E. Shi,et al.  An ON-OFF orientation selective address event representation image transceiver chip , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[13]  Joaquín J. Torres,et al.  Maximum Memory Capacity on Neural Networks with Short-Term Synaptic Depression and Facilitation , 2009, Neural Computation.

[14]  Y. Dan,et al.  Contribution of individual spikes in burst-induced long-term synaptic modification. , 2006, Journal of neurophysiology.

[15]  W. Maass,et al.  Self-tuning of neural circuits through short-term synaptic plasticity. , 2007, Journal of neurophysiology.

[16]  René Schüffny,et al.  Transient responses of activity-dependent synapses to modulated pulse trains , 2009, Neurocomputing.

[17]  Massimiliano Giulioni,et al.  Networks of spiking neurons and plastic synapses : implementation and control , 2008 .