A review of methods for identifying stochastic resonance in simulations of single neuron models

Stochastic resonance (SR) is said to be observed when the presence of noise in a nonlinear system enables an output signal from the system to better represent some feature of an input signal than it does in the absence of noise. The effect has been observed in models of individual neurons, and in experiments performed on real neural systems. Despite the ubiquity of biophysical sources of stochastic noise in the nervous system, however, it has not yet been established whether neuronal computation mechanisms involved in performance of specific functions such as perception or learning might exploit such noise as an integral component, such that removal of the noise would diminish performance of these functions. In this paper we revisit the methods used to demonstrate stochastic resonance in models of single neurons. This includes a previously unreported observation in a multicompartmental model of a CA1-pyramidal cell. We also discuss, as a contrast to these classical studies, a form of ‘stochastic facilitation’, known as inverse stochastic resonance. We draw on the reviewed examples to argue why new approaches to studying ‘stochastic facilitation’ in neural systems need to be developed.

[1]  H Lecar,et al.  Theory of threshold fluctuations in nerves. I. Relationships between electrical noise and fluctuations in axon firing. , 1971, Biophysical journal.

[2]  Thomas T. Imhoff,et al.  Noise-enhanced information transmission in rat SA1 cutaneous mechanoreceptors via aperiodic stochastic resonance. , 1996, Journal of neurophysiology.

[3]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[4]  Bartlett W. Mel,et al.  Arithmetic of Subthreshold Synaptic Summation in a Model CA1 Pyramidal Cell , 2003, Neuron.

[5]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[6]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[7]  A. Bulsara,et al.  Stochastic resonance in a single neuron model: theory and analog simulation. , 1991, Journal of theoretical biology.

[8]  Laura Sacerdote,et al.  Mean Instantaneous Firing Frequency Is Always Higher Than the Firing Rate , 2004, Neural Computation.

[9]  W. Stacey,et al.  Synaptic noise improves detection of subthreshold signals in hippocampal CA1 neurons. , 2001, Journal of neurophysiology.

[10]  Adi R. Bulsara,et al.  Single effective neuron: dendritic coupling effects and stochastic resonance , 1993, Biological Cybernetics.

[11]  Dante R. Chialvo,et al.  Modulated noisy biological dynamics: Three examples , 1993 .

[12]  Eugene M. Izhikevich,et al.  FitzHugh-Nagumo model , 2006, Scholarpedia.

[13]  Li Wang,et al.  EFFECT OF NON-GAUSSIAN CHANNEL NOISE ON COHERENCE RESONANCE IN COUPLED STOCHASTIC HODGKIN–HUXLEY NEURONS , 2012 .

[14]  Thomas T. Imhoff,et al.  Noise-enhanced tactile sensation , 1996, Nature.

[15]  A. Destexhe,et al.  Neuronal Noise , 2012, Springer Series in Computational Neuroscience.

[16]  X. Yu,et al.  Studies with spike initiators: linearization by noise allows continuous signal modulation in neural networks , 1989, IEEE Transactions on Biomedical Engineering.

[17]  R. C Cannon,et al.  An on-line archive of reconstructed hippocampal neurons , 1998, Journal of Neuroscience Methods.

[18]  Masayoshi Kubo,et al.  Suprathreshold stochastic resonance induced by ion channel fluctuation , 2010 .

[19]  Teich,et al.  Information measures quantifying aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  Henk Spekreijse,et al.  Linearizing: A method for analysing and synthesizing nonlinear systems , 1970, Kybernetik.

[21]  G. Mayer-Kress,et al.  Stochastic resonance in threshold devices , 1995 .

[22]  Péter Érdi,et al.  The effect of synaptic depression on stochastic resonance , 2001, Neurocomputing.

[23]  Dgpartement de Physique Synchronization of the Stochastic Fitzhugh-Nagumo Equations to Periodic Forcing ( * ) . , 1995 .

[24]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[25]  T. Sejnowski,et al.  Perspectives on cognitive neuroscience. , 1988, Science.

[26]  Mark D. McDonnell,et al.  Channel-noise-induced stochastic facilitation in an auditory brainstem neuron model. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  S. Bezrukov,et al.  Signal transduction across alamethicin ion channels in the presence of noise. , 1997, Biophysical journal.

[28]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[29]  Carson C. Chow,et al.  Tuning stochastic resonance , 1995, Nature.

[30]  Carson C. Chow,et al.  Aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[31]  Hatsuo Hayashi,et al.  Stochastic resonance in the hippocampal CA3-CA1 model: a possible memory recall mechanism , 2002, Neural Networks.

[32]  Dmitry R Lyamzin,et al.  Analysis and modelling of variability and covariability of population spike trains across multiple time scales , 2012, Network.

[33]  Jürgen Jost,et al.  Inhibition and modulation of rhythmic neuronal spiking by noise. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  John Maddox,et al.  Towards the brain-computer's code? , 1991, Nature.

[35]  Henry C. Tuckwell,et al.  Weak Noise in Neurons May Powerfully Inhibit the Generation of Repetitive Spiking but Not Its Propagation , 2010, PLoS Comput. Biol..

[36]  A. Destexhe,et al.  Correlation detection and resonance in neural systems with distributed noise sources. , 2001, Physical review letters.

[37]  V. Skokov,et al.  Stochastic resonance in a nonlinear system with a 1/f spectrum , 2014 .

[38]  Mahmut Ozer,et al.  Dynamical structure underlying inverse stochastic resonance and its implications. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  L. B. Kiss,et al.  Possible breakthrough: significant improvement of signal to noise ratio by stochastic resonance , 1996 .

[40]  A. Burkitt,et al.  Shot noise in the leaky integrate-and-fire neuron. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  J. White,et al.  Channel noise in neurons , 2000, Trends in Neurosciences.

[42]  W. Stacey,et al.  Stochastic resonance improves signal detection in hippocampal CA1 neurons. , 2000, Journal of neurophysiology.

[43]  C. D. De Luca,et al.  Behaviour of human motor units in different muscles during linearly varying contractions , 1982, The Journal of physiology.

[44]  Boris S. Gutkin,et al.  Inhibition of rhythmic neural spiking by noise: the occurrence of a minimum in activity with increasing noise , 2009, Naturwissenschaften.

[45]  André Longtin,et al.  Stochastic resonance in models of neuronal ensembles , 1997 .

[46]  W Horsthemke,et al.  Voltage-noise-induced transitions in electrically excitable membranes. , 1981, Biophysical journal.

[47]  Henry C. Tuckwell,et al.  Analytical and Simulation Results for the Stochastic Spatial Fitzhugh-Nagumo Model Neuron , 2008, Neural Computation.

[48]  Henry C. Tuckwell,et al.  Analysis of inverse stochastic resonance and the long-term firing of Hodgkin–Huxley neurons with Gaussian white noise , 2012, 1202.2491.

[49]  H Lecar,et al.  Theory of threshold fluctuations in nerves. II. Analysis of various sources of membrane noise. , 1971, Biophysical journal.

[50]  David Paydarfar,et al.  Noisy inputs and the induction of on-off switching behavior in a neuronal pacemaker. , 2006, Journal of neurophysiology.

[51]  Bulsara,et al.  Threshold detection of wideband signals: A noise-induced maximum in the mutual information. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[52]  A. Aldo Faisal,et al.  Stochastic Simulations on the Reliability of Action Potential Propagation in Thin Axons , 2007, PLoS Comput. Biol..

[53]  N. Stocks,et al.  Suprathreshold stochastic resonance in multilevel threshold systems , 2000, Physical review letters.

[54]  Henry C. Tuckwell,et al.  The effects of various spatial distributions of weak noise on rhythmic spiking , 2011, Journal of Computational Neuroscience.

[55]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  E. Rolls A quantitative theory of the functions of the hippocampal CA3 network in memory , 2013, Front. Cell. Neurosci..

[57]  Jianfeng Feng,et al.  Suprathreshold stochastic resonance in neural processing tuned by correlation. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  Schimansky-Geier,et al.  Coherence and stochastic resonance in a two-state system , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[59]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[60]  Derek Abbott,et al.  What Is Stochastic Resonance? Definitions, Misconceptions, Debates, and Its Relevance to Biology , 2009, PLoS Comput. Biol..

[61]  T. Sejnowski On the stochastic dynamics of neuronal interaction , 1976, Biological Cybernetics.

[62]  Chapeau-Blondeau,et al.  Stochastic resonance in a neuron model that transmits spike trains. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[63]  Sergey M. Bezrukov,et al.  Stochastic resonance in non-dynamical systems without response thresholds , 1997, Nature.

[64]  Lutz Schimansky-Geier,et al.  Maximizing spike train coherence or incoherence in the leaky integrate-and-fire model. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  Brent Doiron,et al.  Slope-Based Stochastic Resonance: How Noise Enables Phasic Neurons to Encode Slow Signals , 2010, PLoS Comput. Biol..

[66]  Bulsara,et al.  Time-interval sequences in bistable systems and the noise-induced transmission of information by sensory neurons. , 1991, Physical review letters.

[67]  A. Longtin Stochastic resonance in neuron models , 1993 .

[68]  P. Miller,et al.  Stochastic Transitions between Neural States in Taste Processing and Decision-Making , 2010, The Journal of Neuroscience.

[69]  Henry C. Tuckwell,et al.  Transient termination of spiking by noise in coupled neurons , 2007 .

[70]  Roy D. Yates,et al.  Probability and stochastic processes : a friendly introduction for electrical and computer engineers , 1999 .

[71]  Sergey M. Bezrukov,et al.  Noise-induced enhancement of signal transduction across voltage-dependent ion channels , 1995, Nature.

[72]  Michael L. Hines,et al.  The NEURON Book , 2006 .

[73]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[74]  Sergey M. Bezrukov,et al.  Stochastic resonance as an inherent property of rate-modulated random series of events , 1998 .

[75]  L. M. Ward,et al.  Stochastic resonance and sensory information processing: a tutorial and review of application , 2004, Clinical Neurophysiology.

[76]  Shigeru Tanaka,et al.  Stochastic resonance in a model neuron with reset , 1996, physics/9611014.

[77]  Kurt Wiesenfeld,et al.  Minireview of stochastic resonance. , 1998, Chaos.

[78]  Mannella,et al.  Fast and precise algorithm for computer simulation of stochastic differential equations. , 1989, Physical review. A, General physics.

[79]  Hu,et al.  Faddeev calculation of the dt micro- mesic molecule. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[80]  Henry C. Tuckwell,et al.  Analytical and Simulation Results for Stochastic Fitzhugh-Nagumo Neurons and Neural Networks , 1998, Journal of Computational Neuroscience.

[81]  William H. Press,et al.  Numerical Recipes in Fortran 77: The Art of Scientific Computing 2nd Editionn - Volume 1 of Fortran Numerical Recipes , 1992 .

[82]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[83]  Riccardo Mannella,et al.  Stochastic resonance in perspective , 1995 .

[84]  Gregoire Nicolis,et al.  Stochastic resonance , 2007, Scholarpedia.

[85]  F. E. Moss,et al.  Single neuron dynamics: noise-enhanced signal processing , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[86]  Wiesenfeld,et al.  Stochastic resonance on a circle. , 1994, Physical review letters.

[87]  Frank Moss,et al.  Stochastic Resonance in an Electronic FitzHugh‐Nagumo Model a , 1993 .

[88]  André Longtin,et al.  Synchronization of the stochastic Fitzhugh-Nagumo equations to periodic forcing , 1995 .

[89]  Wiesenfeld,et al.  Theory of stochastic resonance. , 1989, Physical review. A, General physics.

[90]  Boris S. Gutkin,et al.  Noise delays onset of sustained firing in a minimal model of persistent activity , 2004, Neurocomputing.

[91]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[92]  Tim Gollisch,et al.  Modeling Single-Neuron Dynamics and Computations: A Balance of Detail and Abstraction , 2006, Science.

[93]  Michael Rudolph,et al.  Do Neocortical Pyramidal Neurons Display Stochastic Resonance? , 2001, Journal of Computational Neuroscience.

[94]  Ursula U. Müller,et al.  Nonparametric regression for threshold data , 2000 .

[95]  Mark D. McDonnell,et al.  Identifying positive roles for endogenous stochastic noise during computation in neural systems , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[96]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[97]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[98]  Frank Moss,et al.  Stochastic resonance: noise-enhanced order , 1999 .

[99]  A. Longtin AUTONOMOUS STOCHASTIC RESONANCE IN BURSTING NEURONS , 1997 .

[100]  Frank Moss,et al.  STOCHASTIC RESONANCE: TUTORIAL AND UPDATE , 1994 .

[101]  Carson C. Chow,et al.  Aperiodic stochastic resonance in excitable systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[102]  Peter Jung,et al.  Periodically driven stochastic systems , 1993 .

[103]  Mark D. McDonnell,et al.  Suprathreshold stochastic resonance , 2009, Scholarpedia.

[104]  Gustavo Deco,et al.  Stochastic dynamics as a principle of brain function , 2009, Progress in Neurobiology.

[105]  Yo Horikawa,et al.  Noise effects on spike propagation in the stochastic Hodgkin-Huxley models , 1991, Biological Cybernetics.

[106]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[107]  M. Stemmler A single spike suffices: the simplest form of stochastic resonance in model neurons , 1996 .

[108]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[109]  F. Rieke,et al.  Noise correlations improve response fidelity and stimulus encoding , 2010, Nature.

[110]  William Bialek,et al.  Information flow in sensory neurons , 1995 .

[111]  Kurt Wiesenfeld,et al.  Stochastic resonance and the benefits of noise: from ice ages to crayfish and SQUIDs , 1995, Nature.

[112]  Henry C. Tuckwell,et al.  Moment analysis of the Hodgkin–Huxley system with additive noise , 2009 .

[113]  Mahmut Ozer,et al.  Effects of the network structure and coupling strength on the noise-induced response delay of a neuronal network , 2008 .

[114]  Daqing Guo,et al.  Inhibition of rhythmic spiking by colored noise in neural systems , 2011, Cognitive Neurodynamics.

[115]  Gillespie,et al.  Exact numerical simulation of the Ornstein-Uhlenbeck process and its integral. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[116]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[117]  Sebastian Muller Stochastic Resonance From Suprathreshold Stochastic Resonance To Stochastic Signal Quantization , 2016 .

[118]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .