Self-sustained activity in attractor networks using neuromorphic VLSI

We describe and demonstrate the implementation of attractor neural network dynamics in analog VLSI chips [1]. The on-chip network is composed of an excitatory and an inhibitory population of recurrently connected linear integrate-and-fire neurons. Besides the recurrent input these two populations receive external input in the form of spike trains from an Address-Event-Representation (AER) based system. External AER input stimulates the attractor network and provides also an adequate background activity for the on-chip populations. We use the mean-field approximation of a model attractor neural network to identify regions of parameter space allowing for attractor states, matching hardware constraints. Consistency between theoretical predictions and the observed collective behaviour of the network on chip is checked using the ‘effective transfer function’ (ETF) [2]. We demonstrate that the silicon network can support two equilibrium states of sustained firing activity that are attractors of the dynamics, and that external stimulation can provoke a transition from the lower to the higher state.

[1]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[2]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[3]  J. Fuster,et al.  Inferotemporal neurons distinguish and retain behaviorally relevant features of visual stimuli. , 1981, Science.

[4]  D. Amit,et al.  Effective neural response function for collective population states. , 1999, Network.

[5]  Patrick Camilleri,et al.  A VLSI network of spiking neurons with plastic fully configurable “stop-learning” synapses , 2008, 2008 15th IEEE International Conference on Electronics, Circuits and Systems.

[6]  André van Schaik,et al.  AER EAR: A Matched Silicon Cochlea Pair With Address Event Representation Interface , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[7]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[8]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[9]  Dhanistha Panyasak,et al.  Circuits , 1995, Annals of the New York Academy of Sciences.

[10]  Jochen Braun,et al.  Bistable Perception Modeled as Competing Stochastic Integrations at Two Levels , 2009, PLoS Comput. Biol..

[11]  Maurizio Mattia,et al.  Collective Behavior of Networks with Linear (VLSI) Integrate-and-Fire Neurons , 1999, Neural Computation.

[12]  Y. Miyashita Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[13]  Giacomo Indiveri,et al.  A Current-Mode Hysteretic Winner-take-all Network, with Excitatory and Inhibitory Coupling , 2001 .

[14]  Mario Pannunzi,et al.  Classification of Correlated Patterns with a Configurable Analog VLSI Neural Network of Spiking Neurons and Self-Regulating Plastic Synapses , 2009, Neural Computation.

[15]  Misha Anne Mahowald,et al.  VLSI analogs of neuronal visual processing: a synthesis of form and function , 1992 .

[16]  Timothy K. Horiuchi,et al.  A neuromorphic head direction cell system , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[17]  Xiao-Jing Wang Decision Making in Recurrent Neuronal Circuits , 2008, Neuron.

[18]  Massimiliano Giulioni,et al.  Networks of spiking neurons and plastic synapses : implementation and control , 2008 .

[19]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[20]  Giacomo Indiveri,et al.  Real-Time Classification of Complex Patterns Using Spike-Based Learning in Neuromorphic VLSI , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[21]  Shih-Chii Liu,et al.  AER EAR: A Matched Silicon Cochlea Pair With Address Event Representation Interface , 2007, IEEE Trans. Circuits Syst. I Regul. Pap..

[22]  Gustavo Deco,et al.  A Fluctuation-Driven Mechanism for Slow Decision Processes in Reverberant Networks , 2008, PloS one.

[23]  Ralph Etienne-Cummings,et al.  A Silicon Central Pattern Generator Controls Locomotion in Vivo , 2008, IEEE Transactions on Biomedical Circuits and Systems.

[24]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[25]  Tobi Delbrück,et al.  A Multichip Pulse-Based Neuromorphic Infrastructure and Its Application to a Model of Orientation Selectivity , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[26]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[27]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[28]  Philipp Häfliger,et al.  A time domain winner-take-all network of integrate-and-fire neurons , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).