Adaptive Gain Control for Spike-Based Map Communication in a Neuromorphic Vision System

To support large numbers of model neurons, neuromorphic vision systems are increasingly adopting a distributed architecture, where different arrays of neurons are located on different chips or processors. Spike-based protocols are used to communicate activity between processors. The spike activity in the arrays depends on the input statistics as well as internal parameters such as time constants and gains. In this paper, we investigate strategies for automatically adapting these parameters to maintain a constant firing rate in response to changes in the input statistics. We find that under the constraint of maintaining a fixed firing rate, a strategy based upon updating the gain alone performs as well as an optimal strategy where both the gain and the time constant are allowed to vary. We discuss how to choose the time constant and propose an adaptive gain control mechanism whose operation is robust to changes in the input statistics. Our experimental results on a mobile robotic platform validate the analysis and efficacy of the proposed strategy.

[1]  Chiara Bartolozzi,et al.  Silicon synaptic homeostasis , 2006 .

[2]  K.M. Hynna,et al.  A silicon implementation of the thalamic low threshold calcium current , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[3]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[4]  Kwabena Boahen,et al.  A Recurrent Model of Orientation Maps with Simple and Complex Cells , 2003, NIPS.

[5]  Michael J. Berry,et al.  Adaptation of retinal processing to image contrast and spatial scale , 1997, Nature.

[6]  Gert Cauwenberghs,et al.  Dynamically Reconfigurable Silicon Array of Spiking Neurons With Conductance-Based Synapses , 2007, IEEE Transactions on Neural Networks.

[7]  Philipp Häfliger.  Adaptive WTA With an Analog VLSI Neuromorphic Learning Chip , 2007, IEEE Transactions on Neural Networks.

[8]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[9]  P. Lennie.  The Cost of Cortical Computation , 2003, Current Biology.

[10]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[11]  Philipp Hafliger,et al.  Adaptive WTA With an Analog VLSI Neuromorphic Learning Chip , 2007 .

[12]  Giacomo Indiveri,et al.  A low-power adaptive integrate-and-fire neuron circuit , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[13]  Tetsuya Yagi,et al.  An analog silicon retina with multichip configuration , 2006, IEEE Transactions on Neural Networks.

[14]  Tobi Delbrück,et al.  Modeling orientation selectivity using a neuromorphic multi-chip system , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[15]  Niraj S. Desai,et al.  Critical periods for experience-dependent synaptic scaling in visual cortex , 2002, Nature Neuroscience.

[16]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[17]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[18]  J E Dowling,et al.  On bipolar cell responses in the teleost retina are generated by two distinct mechanisms. , 1996, Journal of neurophysiology.

[19]  Shih-Chii Liu,et al.  Homeostasis in a Silicon Integrate and Fire Neuron , 2000, NIPS.

[20]  Andreas G. Andreou,et al.  AER image filtering architecture for vision-processing systems , 1999 .

[21]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[22]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[23]  Peter Földiák,et al.  SPARSE CODING IN THE PRIMATE CORTEX , 2002 .

[24]  A. van Schaik.  Building blocks for electronic spiking neural networks. , 2001, Neural networks : the official journal of the International Neural Network Society.

[25]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[26]  Bertram E. Shi,et al.  Expandable hardware for computing cortical feature maps , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[27]  Christof Koch,et al.  A Modular Multi-Chip Neuromorphic Architecture for Real-Time Visual Motion Processing , 2000 .

[28]  Tobi Delbrück,et al.  Orientation-Selective aVLSI Spiking Neurons , 2001, NIPS.

[29]  Bernabé Linares-Barranco,et al.  High-speed image processing with AER-based components , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[30]  Gert Cauwenberghs,et al.  A real-time spike-domain sensory information processing system [image processing applications] , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[31]  Chiara Bartolozzi,et al.  Global scaling of synaptic efficacy: Homeostasis in silicon synapses , 2009, Neurocomputing.

[32]  Bertram E. Shi,et al.  Neuromorphic implementation of orientation hypercolumns , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[33]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[34]  Kwabena Boahen,et al.  The Retinomorphic Approach: Pixel-Parallel Adaptive Amplification, Filtering, and Quantization , 1997 .

[35]  Erhan Ozalevli,et al.  Reconfigurable biologically inspired visual motion systems using modular neuromorphic VLSI chips , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[36]  Shih-Chii Liu,et al.  A Hardware/Software Framework for Real-Time Spiking Systems , 2005, ICANN.

[37]  Simon R. Schultz,et al.  Analogue VLSI 'integrate-and-fire' neuron with frequency adaptation , 1995 .