Impact of noise structure and network topology on tracking speed of neural networks

Understanding why neural systems can process information extremely fast is a fundamental question in theoretical neuroscience. The present study investigates the effect of noise on accelerating neural computation. To evaluate the speed of network response, we consider a computational task in which the network tracks time-varying stimuli. Two noise structures are compared, namely, the stimulus-dependent and stimulus-independent noises. Based on a simple linear integrate-and-fire model, we theoretically analyze the network dynamics, and find that the stimulus-dependent noise, whose variance is proportional to the mean of external inputs, has better effect on speeding up network computation. This is due to two good properties in the transient network dynamics: (1) the instant firing rate of the network is proportional to the mean of external inputs, and (2) the stationary state of the network is robust to stimulus changes. We investigate two network models with varying recurrent interactions, and find that recurrent interactions tend to slow down the tracking speed of the network. When the biologically plausible Hodgkin-Huxley model is considered, we also observe that the stimulus-dependent noise accelerates neural computation, although the improvement is smaller than that in the case of linear integrate-and-fire model.

[1]  G. Buzsáki,et al.  Gamma Oscillation by Synaptic Inhibition in a Hippocampal Interneuronal Network Model , 1996, The Journal of Neuroscience.

[2]  A. Hodgkin,et al.  Measurement of current‐voltage relations in the membrane of the giant axon of Loligo , 1952, The Journal of physiology.

[3]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[4]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[5]  G. Orban,et al.  The response variability of striate cortical neurons in the behaving monkey , 2004, Experimental Brain Research.

[6]  William T Newsome,et al.  Is there a signal in the noise? , 1995, Current Opinion in Neurobiology.

[7]  E. Adrian,et al.  The impulses produced by sensory nerve‐endings , 1926 .

[8]  J D Schall,et al.  Retinal constraints on orientation specificity in cat visual cortex , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[10]  J. Lacaille,et al.  Membrane properties of interneurons in stratum oriens-alveus of the CA1 region of rat hippocampus in vitro , 1990, Neuroscience.

[11]  H. Risken,et al.  Fokker-Planck Equation for One Variable; Methods of Solution , 1996 .

[12]  B. Finlay,et al.  Short-term response variability of monkey striate neurons , 1976, Brain Research.

[13]  E. Adrian,et al.  The impulses produced by sensory nerve-endings: Part II. The response of a Single End-Organ. , 2006, The Journal of physiology.

[14]  H Markram,et al.  Dynamics of population rate codes in ensembles of neocortical neurons. , 2004, Journal of neurophysiology.

[15]  Bruce W. Knight,et al.  Dynamics of Encoding in a Population of Neurons , 1972, The Journal of general physiology.

[16]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[17]  Mark C. W. van Rossum,et al.  Fast Propagation of Firing Rates through Layered Networks of Noisy Neurons , 2002, The Journal of Neuroscience.

[18]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[19]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[21]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[22]  Si Wu,et al.  Stimulus-Dependent Noise Facilitates Tracking Performances of Neuronal Networks , 2010, ISNN.

[23]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[24]  S. Thorpe,et al.  Dynamics of orientation coding in area V1 of the awake primate , 1993, Visual Neuroscience.

[25]  J. Rinzel,et al.  Spindle rhythmicity in the reticularis thalami nucleus: Synchronization among mutually inhibitory neurons , 1993, Neuroscience.

[26]  Thomas P. Trappenberg,et al.  Fundamentals of Computational Neuroscience , 2002 .

[27]  J. Elgin.  The Fokker-Planck Equation: Methods of Solution and Applications , 1984 .

[28]  D. Perkel,et al.  Quantitative methods for predicting neuronal behavior , 1981, Neuroscience.

[29]  Maurizio Mattia,et al.  Collective Behavior of Networks with Linear (VLSI) Integrate-and-Fire Neurons , 1999, Neural Computation.

[30]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[31]  H. Wigström,et al.  Shape of frequency-current curves in CAI pyramidal cells in the hippocampus , 1981, Brain Research.

[32]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[33]  H. Tuckwell.  Introduction to Theoretical Neurobiology: Linear Cable Theory and Dendritic Structure , 1988 .

[34]  G. Orban,et al.  Response latency of macaque area MT/V5 neurons and its relationship to stimulus parameters. , 1999, Journal of neurophysiology.