Global scaling of synaptic efficacy: Homeostasis in silicon synapses

Synaptic homeostasis is a mechanism present in biological neural systems that acts to maintain an homogeneous and stable computational substrate, in face of intrinsic inhomogeneities among neurons, and of their continuous changes due to learning processes and variations in the statistics of the input signals. In hardware spike-based neural networks homeostasis could be useful for solving issues such as mismatch and temperature drifts. Here we present a synaptic circuit that supports both spike-based learning and homeostatic mechanisms, and show how it can be used in conjunction with a software control algorithm to model global synaptic scaling homeostatic mechanism.

[1]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[2]  Shih-Chii Liu,et al.  A Hardware/Software Framework for Real-Time Spiking Systems , 2005, ICANN.

[3]  Bertram E. Shi,et al.  Neuromorphic implementation of orientation hypercolumns , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[4]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[5]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[6]  Philipp Häfliger,et al.  Spike based learning with weak multi-level static memory , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[7]  Kwabena Boahen,et al.  Learning in Silicon: Timing is Everything , 2005, NIPS.

[8]  A. Bofill-I Petit.  Synchrony detection and amplification by silicon neurons with STDP synapses , 2004 .

[9]  Alan F. Murray,et al.  Synchrony detection and amplification by silicon neurons with STDP synapses , 2004, IEEE Transactions on Neural Networks.

[10]  Eve Marder,et al.  Modeling stability in neuron and network function: the role of activity in homeostasis. , 2002, BioEssays : news and reviews in molecular, cellular and developmental biology.

[11]  Tobi Delbrück,et al.  AER Building Blocks for Multi-Layer Multi-Chip Neuromorphic Vision Systems , 2005, NIPS.

[12]  Tobi Delbrück,et al.  A Multichip Pulse-Based Neuromorphic Infrastructure and Its Application to a Model of Orientation Selectivity , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  Giacomo Indiveri,et al.  Spike-based learning in VLSI networks of integrate-and-fire neurons , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[14]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[15]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[16]  Jochen Triesch,et al.  Synergies Between Intrinsic and Synaptic Plasticity Mechanisms , 2007, Neural Computation.

[17]  Giacomo Indiveri,et al.  A VLSI spike-driven dynamic synapse which learns only when necessary , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[18]  Niraj S. Desai,et al.  Critical periods for experience-dependent synaptic scaling in visual cortex , 2002, Nature Neuroscience.

[19]  Shih-Chii Liu,et al.  Analog VLSI: Circuits and Principles , 2002 .

[20]  G. Turrigiano.  Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same , 1999, Trends in Neurosciences.

[21]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[22]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[23]  Ivan Soltesz,et al.  Homeostatic Plasticity Studied Using In Vivo Hippocampal Activity-Blockade: Synaptic Scaling, Intrinsic Plasticity and Age-Dependence , 2007, PloS one.

[24]  Shih-Chii Liu,et al.  Silicon synaptic adaptation mechanisms for homeostasis and contrast gain control , 2002, IEEE Trans. Neural Networks.

[25]  A. Destexhe.  Kinetic Models of Synaptic Transmission , 1997 .