Stochastic Resonance in Continuous and Spiking Neuron Models with Levy Noise

Levy noise can help neurons detect faint or subthreshold signals. Levy noise extends standard Brownian noise to many types of impulsive jump-noise processes found in real and model neurons as well as in models of finance and other random phenomena. Two new theorems and the ItÔ calculus show that white Levy noise will benefit subthreshold neuronal signal detection if the noise process's scaled drift velocity falls inside an interval that depends on the threshold values. These results generalize earlier “forbidden interval” theorems of neuronal “stochastic resonance” (SR) or noise-injection benefits. Global and local Lipschitz conditions imply that additive white Levy noise can increase the mutual information or bit count of several feedback neuron models that obey a general stochastic differential equation (SDE). Simulation results show that the same noise benefits still occur for some infinite-variance stable Levy noise processes even though the theorems themselves apply only to finite-variance Levy noise. The Appendix proves the two ItÔ-theoretic lemmas that underlie the new Levy noise-benefit theorems.

[1]  E. Izhikevich,et al.  Weakly connected neural networks , 1997 .

[2]  Maozhen Li,et al.  Stability analysis for stochastic Cohen-Grossberg neural networks with mixed time delays , 2006, IEEE Transactions on Neural Networks.

[3]  S. Resnick Heavy-Tail Phenomena: Probabilistic and Statistical Modeling , 2006 .

[4]  Jinde Cao,et al.  Exponential stability analysis of uncertain stochastic neural networks with multiple delays , 2007 .

[5]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Derek Abbott,et al.  Quantization in the presence of large amplitude threshold noise , 2005 .

[7]  Wim Schoutens,et al.  Exotic options under Lévy models: An overview , 2006 .

[8]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[9]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[10]  Yonghui Sun,et al.  Synchronization in an array of linearly stochastically coupled networks with time delays , 2007 .

[11]  Peter Hänggi,et al.  Stochastic resonance in biology. How noise can enhance detection of weak signals and help improve biological information processing. , 2002, Chemphyschem : a European journal of chemical physics and physical chemistry.

[12]  D. Applebaum Lévy Processes—From Probability to Finance and Quantum Groups , 2004 .

[13]  Chongwu Zhou,et al.  Noise-Enhanced Detection of Subthreshold Signals With Carbon Nanotubes , 2006, IEEE Transactions on Nanotechnology.

[14]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[15]  François Chapeau-Blondeau,et al.  Noise-enhanced performance for an optimal Bayesian estimator , 2004, IEEE Transactions on Signal Processing.

[16]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[17]  Raisa E. Feldman,et al.  Optimal Filtering of a Gaussian Signal in the Presence of Lévy Noise , 1999, SIAM J. Appl. Math..

[18]  Kazuyuki Aihara,et al.  Stochastic Resonance and Coincidence Detection in Single Neurons , 2002, Neural Processing Letters.

[19]  M. Taqqu,et al.  Stable Non-Gaussian Random Processes : Stochastic Models with Infinite Variance , 1995 .

[20]  R. Durrett Stochastic Calculus: A Practical Introduction , 1996 .

[21]  A. Pacut Separation of deterministic and stochastic neurotransmission , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[22]  A.F. Kohn Dendritic transformation of random synaptic inputs as measured from a neuron's spike train-modelling and simulation , 1989, IEEE Transactions on Biomedical Engineering.

[23]  Alfred Hanssen,et al.  The normal inverse Gaussian distribution: a versatile model for heavy-tailed stochastic processes , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[24]  A. Bulsara,et al.  Stochastic resonance in a single neuron model: theory and analog simulation. , 1991, Journal of theoretical biology.

[25]  N. Shephard,et al.  Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics , 2001 .

[26]  Bart Kosko,et al.  Robust stochastic resonance for simple threshold neurons. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  François Chapeau-Blondeau,et al.  Constructive role of noise in signal detection from parallel arrays of quantizers , 2005, Signal Process..

[28]  David Allingham,et al.  THE APPLICATION OF SUPRATHRESHOLD STOCHASTIC RESONANCE TO COCHLEAR IMPLANT CODING , 2002, The Random and Fluctuating World.

[29]  G. G. Karapetyan Application of stochastic resonance in gravitational-wave interferometer , 2006 .

[30]  R. Durrett Probability: Theory and Examples , 1993 .

[31]  Mark E. Robert,et al.  Noise Enhances Modulation Sensitivity in Cochlear Implant Listeners: Stochastic Resonance in a Prosthetic Sensory System? , 2001, Journal of the Association for Research in Otolaryngology.

[32]  Laura Sacerdote,et al.  Multimodality of the interspike interval distribution in a simple jump-diffusion model. , 2003 .

[33]  Carson C. Chow,et al.  Aperiodic stochastic resonance in excitable systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[34]  David Rousseau,et al.  Neuronal Signal Transduction Aided by Noise at Threshold and at Saturation , 2004, Neural Processing Letters.

[35]  C. L. Nikias,et al.  Signal processing with alpha-stable distributions and applications , 1995 .

[36]  侯一平 关于神经科学原理(PRINCIPLES OF NEUROSCIENCE)课程的介绍 , 2000 .

[37]  M. Grigoriu Applied Non-Gaussian Processes , 1995 .

[38]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[39]  Jinde Cao,et al.  Adaptive synchronization of neural networks with or without time-varying delay. , 2006, Chaos.

[40]  F. Chapeau-Blondeau,et al.  Stochastic resonance for nonlinear sensors with saturation. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Carson C. Chow,et al.  Aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[42]  J. García-Ojalvo,et al.  Effects of noise in excitable systems , 2004 .

[43]  Sergey M. Bezrukov,et al.  Noise-induced enhancement of signal transduction across voltage-dependent ion channels , 1995, Nature.

[44]  Xuerong Mao,et al.  Stochastic differential equations and their applications , 1997 .

[45]  Ashok Patel,et al.  Stochastic resonance in noisy spiking retinal and sensory neuron models , 2005, Neural Networks.

[46]  Ralf Werner,et al.  The Normal Inverse Gaussian Distribution for Synthetic CDO Pricing , 2007 .

[47]  R. Schilling Financial Modelling with Jump Processes , 2005 .

[48]  L Sacerdote,et al.  Jump-diffusion processes as models for neuronal activity. , 1997, Bio Systems.

[49]  Boris S. Gutkin,et al.  Dynamics of Membrane Excitability Determine Interspike Interval Variability: A Link Between Spike Generation Mechanisms and Cortical Spike Train Statistics , 1998, Neural Computation.

[50]  R. Segev,et al.  Long term behavior of lithographically prepared in vitro neuronal networks. , 2002, Physical review letters.

[51]  Kurt Wiesenfeld,et al.  Stochastic resonance and the benefits of noise: from ice ages to crayfish and SQUIDs , 1995, Nature.

[52]  L. Gammaitoni,et al.  Stochastic resonance and the dithering effect in threshold physical systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[53]  A. Burkitt,et al.  Shot noise in the leaky integrate-and-fire neuron. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Hamid Krim,et al.  Levy processes for image modeling , 1999, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics. SPW-HOS '99.

[55]  Kurt Wiesenfeld,et al.  Mechanoelectrical transduction assisted by Brownian motion: a role for noise in the auditory system , 1998, Nature Neuroscience.

[56]  Yurong Liu,et al.  Stochastic stability of uncertain Hopfield neural networks with discrete and distributed delays , 2006 .

[57]  W. Schoutens Lévy Processes in Finance: Pricing Financial Derivatives , 2003 .

[58]  D. Applebaum Lévy Processes and Stochastic Calculus: Preface , 2009 .

[59]  François Chapeau-Blondeau,et al.  Noise-enhanced nonlinear detector to improve signal detection in non-Gaussian noise , 2006, Signal Process..

[60]  Chapeau-Blondeau,et al.  Stochastic resonance in a neuron model that transmits spike trains. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[61]  S. Kay,et al.  Can detectability be improved by adding noise? , 2000, IEEE Signal Processing Letters.

[62]  Thomas T. Imhoff,et al.  Noise-enhanced information transmission in rat SA1 cutaneous mechanoreceptors via aperiodic stochastic resonance. , 1996, Journal of neurophysiology.

[63]  Bart Kosko,et al.  Stochastic resonance in noisy threshold neurons , 2003, Neural Networks.

[64]  Bart Kosko,et al.  Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence , 1991 .

[65]  Schieve,et al.  Single effective neuron. , 1991, Physical Review A. Atomic, Molecular, and Optical Physics.

[66]  J A Kelso,et al.  Noise improves three-dimensional perception: stochastic resonance and other impacts of noise to the perception of autostereograms. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[67]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[68]  Bulsara,et al.  Threshold detection of wideband signals: A noise-induced maximum in the mutual information. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[69]  W. Stacey,et al.  Stochastic resonance improves signal detection in hippocampal CA1 neurons. , 2000, Journal of neurophysiology.

[70]  Adi R. Bulsara,et al.  Analytic Expressions for Rate and CV of a Type I Neuron Driven by White Gaussian Noise , 2003, Neural Computation.

[71]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[72]  Yonghui Sun,et al.  Adaptive lag synchronization of unknown chaotic delayed neural networks with noise perturbation , 2007 .

[73]  Bart Kosko,et al.  Adaptive stochastic resonance in noisy neurons based on mutual information , 2004, IEEE Transactions on Neural Networks.

[74]  竹中 茂夫 G.Samorodnitsky,M.S.Taqqu:Stable non-Gaussian Random Processes--Stochastic Models with Infinite Variance , 1996 .

[75]  L. M. Ward,et al.  Stochastic resonance and sensory information processing: a tutorial and review of application , 2004, Clinical Neurophysiology.

[76]  Bulsara,et al.  Information-theoretic stochastic resonance in noise-floor limited systems: the case for adding noise , 2000, Physical review letters.

[77]  François Chapeau-Blondeau,et al.  Noise-enhanced Fisher information in parallel arrays of sensors with saturation. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[78]  B. Kosko,et al.  Adaptive stochastic resonance , 1998, Proc. IEEE.

[79]  Tina Hviid Rydberg The normal inverse gaussian lévy process: simulation and approximation , 1997 .

[80]  A. Longtin AUTONOMOUS STOCHASTIC RESONANCE IN BURSTING NEURONS , 1997 .

[81]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[82]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[83]  Fan-Gang Zeng,et al.  Human hearing enhanced by noise 1 1 Published on the World Wide Web on 23 May 2000. , 2000, Brain Research.

[84]  Dong Yue,et al.  Synchronization control of stochastic delayed neural networks communicating with unreliable links , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[85]  Bernd Schürmann,et al.  Stochastic resonance in the mutual information between input and output spike trains of noisy central neurons , 1998 .

[86]  O. Sotolongo-Costa,et al.  Lévy flights and earthquakes , 2000 .

[87]  N G Stocks,et al.  Information transmission in parallel threshold arrays: suprathreshold stochastic resonance. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[88]  Adi R. Bulsara,et al.  Single effective neuron: dendritic coupling effects and stochastic resonance , 1993, Biological Cybernetics.

[89]  A F Kohn,et al.  Dendritic transformations on random synaptic inputs as measured from a neuron's spike train--modeling and simulation. , 1989, IEEE transactions on bio-medical engineering.

[90]  F. Moss,et al.  Noise sustained waves in subexcitable media: From chemical waves to brain waves. , 1998, Chaos.

[91]  Ashok Patel,et al.  Mutual-Information Noise Benefits in Brownian Models of Continuous and Spiking Neurons , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.