Stochastic Resonance and Finite Resolution in a Network of Leaky Integrate-and-Fire Neurons

This paper discusses the effect of stochastic resonance in a network of leaky integrate-and-fire (LIF) neurons and investigates its realisation on a Field Programmable Gate Array (FPGA). We report in this study that stochastic resonance which is mainly associated with floating point implementations is possible in both a single LIF neuron and a network of LIF neurons implemented on lower resolution integer based digital hardware. We also report that such a network can improve the signal-to-noise ratio (SNR) of the output over a single LIF neuron.

[1]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[2]  S. Bezrukov,et al.  Stochastic resonance in non-dynamical systems without response thresholds , 1997, Nature.

[3]  P. Landa.  Mechanism of stochastic resonance , 2004 .

[4]  Idan Segev,et al.  Reading Neuronal Synchrony with Depressing Synapses , 1998, Neural Computation.

[5]  John H. R. Maunsell,et al.  On the relationship between synaptic input and spike output jitter in individual neurons. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[6]  M. Häusser,et al.  Neurobiology , 2001, Current Opinion in Neurobiology.

[7]  Bulsara,et al.  Cooperative behavior in periodically driven noisy integrate-fire models of neuronal dynamics. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[8]  Carson C. Chow,et al.  Aperiodic stochastic resonance in excitable systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  Jung,et al.  Threshold devices: Fractal noise and neural talk. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  Tim Schönauer,et al.  Simulation of Spiking Neural Networks on Different Hardware Platforms , 1997, ICANN.

[11]  Wulfram Gerstner,et al.  Extracting Oscillations: Neuronal Coincidence Detection with Noisy Periodic Spike Input , 1998, Neural Computation.

[12]  N. Hohn.  Stochastic resonance in a neuron model with application to the auditory pathway , 2001 .

[13]  J. Sjöstrand,et al.  Quantitative estimations of foveal and extra-foveal retinal circuitry in humans , 1999, Vision Research.

[14]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  François Chapeau-Blondeau,et al.  Noise-enhanced transmission of spike trains in the neuron , 1996 .

[16]  Stephen F. Traynelis,et al.  Getting the most out of noise in the central nervous system , 1998, Trends in Neurosciences.

[17]  Angelo Di Garbo,et al.  The leaky integrate-and-fire with noise: a useful tool to investigate SR , 2000 .

[18]  Salvador Balle,et al.  Experimental evidence of stochastic resonance in an excitable optical system. , 2002, Physical review letters.

[19]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[20]  Eric L. Schwartz,et al.  Computing with the Leaky Integrate-and-Fire Neuron: Logarithmic Computation and Multiplication , 1997, Neural Computation.

[21]  S. Fauve,et al.  Stochastic resonance in a bistable system , 1983 .

[22]  Carson C. Chow,et al.  Noise shaping in populations of coupled model neurons. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[23]  K. Sere.  Reconngurable Hardware | a Case Study in Codesign , 1998 .

[24]  Emile Fiesler,et al.  Neural Network Adaptations to Hardware Implementations , 1997 .

[25]  G. Parisi,et al.  Stochastic resonance in climatic change , 1982 .

[26]  R. Douglas,et al.  A silicon neuron , 1991, Nature.

[27]  Kurt Wiesenfeld,et al.  The Benefits of Background Noise , 1995 .

[28]  Amir Hussain,et al.  Stochastic resonance and finite resolutions in a leaky integrate-and-fire neuron , 2002, ESANN.

[29]  Jonathan Rose,et al.  CALL FOR ARTICLES IEEE Design & Test of Computers Special Issue on Microprocessors , 1996 .

[30]  Markus Höhfeld,et al.  Probabilistic rounding in neural network learning with limited precision , 1992, Neurocomputing.

[31]  Wulfram Gerstner,et al.  Associative memory in a network of ‘spiking’ neurons , 1992 .

[32]  S. -. Lee,et al.  Parameter dependence of stochastic resonance in the stochastic Hodgkin-Huxley neuron. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[33]  Leslie S. Smith.  Extracting Features from the Short-term Time Structure of Cochlear Filtered Sound , 1997, NCPW.

[34]  Michael R. Leach,et al.  Java in a nutshell: A desktop quick reference , 1998 .

[35]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[36]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[37]  D. Ferster,et al.  The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. , 2000, Science.

[38]  Arun V. Holden,et al.  Stochastic resonance in biological systems , 2000 .

[39]  Kenneth D. Miller,et al.  Physiological Gain Leads to High ISI Variability in a Simple Model of a Cortical Regular Spiking Cell , 1997, Neural Computation.

[40]  Shigeru Tanaka,et al.  Stochastic resonance in a model neuron with reset , 1996, physics/9611014.

[41]  Mannella,et al.  Fast and precise algorithm for computer simulation of stochastic differential equations. , 1989, Physical review. A, General physics.

[42]  Anthony M. Zador,et al.  Novel Integrate-and-re-like Model of Repetitive Firing in Cortical Neurons , 1998 .

[43]  Ditto,et al.  Stochastic Resonance in a Neuronal Network from Mammalian Brain. , 1996, Physical review letters.

[44]  A. Longtin.  Stochastic resonance in neuron models , 1993 .

[45]  F. Moss,et al.  Non-Dynamical Stochastic Resonance: Theory and Experiments with White and Arbitrarily Coloured Noise , 1995 .

[46]  C. Koch,et al.  Methods in Neuronal Modeling: From Ions to Networks , 1998 .

[47]  Marius Usher,et al.  Stochastic resonance in the speed of memory retrieval , 2000, Biological Cybernetics.

[48]  A. V. Holden,et al.  Alias-free sampling of neuronal spike trains , 1971, Kybernetik.

[49]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[50]  Leslie S. Smith,et al.  Analogue VLSI Leaky Integrate-and-Fire Neurons and Their Use in a Sound Analysis System , 2002 .

[51]  Kurt Wiesenfeld,et al.  Minireview of stochastic resonance. , 1998, Chaos.

[52]  Carsten Wolff,et al.  PCNN neurocomputers - Event driven and parallel architectures , 2002, ESANN.

[53]  David C. Sterratt,et al.  Spikes, synchrony, sequences and Schistocerca's sense of smell , 2002 .

[54]  Brad Hutchings,et al.  FPGA-based stochastic neural networks-implementation , 1994, Proceedings of IEEE Workshop on FPGA's for Custom Computing Machines.

[55]  André Longtin,et al.  Stochastic resonance in models of neuronal ensembles , 1997 .

[56]  Wulfram Gerstner,et al.  Noise in Integrate-and-Fire Neurons: From Stochastic Input to Escape Rates , 2000, Neural Computation.

[57]  Riani,et al.  Stochastic resonance in the perceptual interpretation of ambiguous figures: A neural network model. , 1994, Physical review letters.

[58]  Geoff Bostock.  FPGAs and programmable LSI : a designer's handbook , 1996 .

[59]  E. Evans,et al.  Enhancement of vowel coding for cochlear implants by addition of noise , 1996, Nature Medicine.

[60]  Vera Lánská,et al.  Noise in Integrate-and-Fire Models of Neuronal Dynamics , 1997, ICANN.

[61]  Wolfgang Maass,et al.  Fast analog computation in networks of spiking neurons using unreliable synapses , 1999, ESANN.

[62]  Andrés Pérez-Uribe,et al.  FPGA Implementation of a Network of Neuronlike Adaptive Elements , 1997, ICANN.

[63]  Roy,et al.  Observation of stochastic resonance in a ring laser. , 1988, Physical review letters.

[64]  Chapeau-Blondeau,et al.  Stochastic resonance in a neuron model that transmits spike trains. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[65]  John McCarthy,et al.  Mathematical Theory of Computation , 1991 .

[66]  William R. Softky,et al.  Sub-millisecond coincidence detection in active dendritic trees , 1994, Neuroscience.

[67]  Riccardo Mannella,et al.  Stochastic resonance in electrical circuits. II. Nonconventional stochastic resonance , 1999 .

[68]  W. S. Rhode,et al.  Encoding of amplitude modulation in the cochlear nucleus of the cat. , 1994, Journal of neurophysiology.

[69]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[70]  Thomas T. Imhoff,et al.  Noise-enhanced information transmission in rat SA1 cutaneous mechanoreceptors via aperiodic stochastic resonance. , 1996, Journal of neurophysiology.

[71]  H. Scharstein.  Input-output relationship of the Leaky-Integrator Neuron Model , 1979, Journal of mathematical biology.

[72]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[73]  Henry C. Tuckwell,et al.  Stochastic processes in the neurosciences , 1989 .

[74]  Jianfeng Feng,et al.  Variability of Firing of Hodgkin-Huxley and FitzHugh-Nagumo Neurons with Stochastic Synaptic Input , 1999 .

[75]  Wulfram Gerstner,et al.  Reduction of the Hodgkin-Huxley Equations to a Single-Variable Threshold Model , 1997, Neural Computation.

[76]  I. Winter,et al.  CODING OF THE FUNDAMENTAL FREQUENCY OF VOICED SPEECH SOUNDS AND HARMONIC COMPLEXES IN THE COCHLEAR NERVE AND VENTRAL COCHLEAR NUCLEUS. , 1993 .

[77]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[78]  Germán Mato,et al.  On Numerical Simulations of Integrate-and-Fire Neural Networks , 1998, Neural Computation.

[79]  Maxim Volgushev,et al.  Noise Makes Sense in Neuronal Computing , 2000, Science.

[80]  Jianfeng Feng,et al.  Behaviors of Spike Output Jitter in the Integrate-and-Fire Model , 1997 .

[81]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[82]  Leslie S. Smith,et al.  A comparison of a hardware and a software integrate and fire neural network for clustering onsets in cochlear filtered sound , 1998, Neural Networks for Signal Processing VIII. Proceedings of the 1998 IEEE Signal Processing Society Workshop (Cat. No.98TH8378).

[83]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[84]  Guido Bugmann,et al.  Role of Temporal Integration and Fluctuation Detection in the Highly Irregular Firing of a Leaky Integrator Neuron Model with Partial Reset , 1997, Neural Computation.

[85]  Anthony N. Burkitt,et al.  Analysis of Integrate-and-Fire Neurons: Synchronization of Synaptic Input and Spike Output , 1999, Neural Computation.

[86]  Florentin Wörgötter,et al.  Stochastic resonance in visual cortical neurons: does the eye-tremor actually improve visual acuity? , 2002, Neurocomputing.

[87]  Teich,et al.  Information measures quantifying aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[88]  Shoichi Kai,et al.  Noise-induced entrainment and stochastic resonance in human brain waves. , 2002, Physical review letters.

[89]  Péter Érdi,et al.  The effect of synaptic depression on stochastic resonance , 2001, Neurocomputing.

[90]  J P Miller,et al.  Representation of sensory information in the cricket cercal sensory system. II. Information theoretic calculation of system accuracy and optimal tuning-curve widths of four primary interneurons. , 1991, Journal of neurophysiology.

[91]  A. V. Holden,et al.  The estimation of the frequency response function of a mechanoreceptor , 1972, Kybernetik.

[92]  Guido Bugmann,et al.  Summation and multiplication: two distinct operation domains of leaky integrate-and-fire neurons , 1991 .

[93]  Takashi Kanamaru,et al.  Stochastic resonance for the superimposed periodic pulse train , 1999 .

[94]  M Stemmler,et al.  Lateral interactions in primary visual cortex: a model bridging physiology and psychophysics. , 1995, Science.

[95]  Kurt Wiesenfeld,et al.  Stochastic resonance and the benefits of noise: from ice ages to crayfish and SQUIDs , 1995, Nature.

[96]  David E. van den Bout,et al.  AnyBoard: an FPGA-based, reconfigurable system , 1992, IEEE Design & Test of Computers.

[97]  Alfonso M Albano,et al.  MINIMUM REQUIREMENTS FOR STOCHASTIC RESONANCE IN THRESHOLD SYSTEMS , 1998 .

[98]  T. Geisel,et al.  Markov analysis of stochastic resonance in a periodically driven integrate-and-fire neuron. , 1998, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[99]  H. L. Bryant,et al.  Spike initiation by transmembrane current: a white‐noise analysis. , 1976, The Journal of physiology.

[100]  François Chapeau-Blondeau,et al.  Stochastic resonance in the information capacity of a nonlinear dynamic system , 1998 .

[101]  Ben Cohen.  VHDL Coding Styles and Methodologies , 1995 .

[102]  Leslie S. Smith.  Onset-based Sound Segmentation , 1995, NIPS.

[103]  Wiesenfeld,et al.  Stochastic resonance on a circle. , 1994, Physical review letters.

[104]  Riccardo Mannella,et al.  Stochastic resonance in the linear and nonlinear responses of a bistable system to a periodic field. , 1990 .

[105]  Mikael Millberg,et al.  Pulse-coupled neural network implementation in FPGA , 1998, Defense, Security, and Sensing.

[106]  F. AbbottPhysics.  FIRING-RATE MODELS FOR NEURAL POPULATIONSL , 1991 .

[107]  Leslie S. Smith,et al.  Silicon Cellular Morphology , 1999, Int. J. Neural Syst..

[108]  Alexander B. Neiman,et al.  Coherence resonance in a Hodgkin-Huxley neuron , 1998 .

[109]  L. Gammaitoni,et al.  Stochastic resonance and the dithering effect in threshold physical systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[110]  Peter Grigg,et al.  Effects of Colored Noise on Stochastic Resonance in Sensory Neurons , 1999 .

[111]  R. Miura,et al.  Models of subthreshold membrane resonance in neocortical neurons. , 1996, Journal of neurophysiology.

[112]  Eduard Säckinger.  Measurement of Finite-Precision Effects in Handwriting- and Speech-Recognition Algorithms , 1997, ICANN.

[113]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[114]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[115]  M. Stemmler.  A single spike suffices: the simplest form of stochastic resonance in model neurons , 1996 .