Recurrent Network Models for Perfect Temporal Integration of Fluctuating Correlated Inputs

Temporal integration of input is essential to the accumulation of information in various cognitive and behavioral processes, and gradually increasing neuronal activity, typically occurring within a range of seconds, is considered to reflect such computation by the brain. Some psychological evidence suggests that temporal integration by the brain is nearly perfect, that is, the integration is non-leaky, and the output of a neural integrator is accurately proportional to the strength of input. Neural mechanisms of perfect temporal integration, however, remain largely unknown. Here, we propose a recurrent network model of cortical neurons that perfectly integrates partially correlated, irregular input spike trains. We demonstrate that the rate of this temporal integration changes proportionately to the probability of spike coincidences in synaptic inputs. We analytically prove that this highly accurate integration of synaptic inputs emerges from integration of the variance of the fluctuating synaptic inputs, when their mean component is kept constant. Highly irregular neuronal firing and spike coincidences are the major features of cortical activity, but they have been separately addressed so far. Our results suggest that the efficient protocol of information integration by cortical networks essentially requires both features and hence is heterotic.

[1]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[2]  N. Parga,et al.  Response of spiking neurons to correlated inputs. , 2002, Physical review letters.

[3]  E. Niebur,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2022 .

[4]  H. Sompolinsky,et al.  Temporal integration by calcium dynamics in a model neuron , 2003, Nature Neuroscience.

[5]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[6]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[7]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[8]  Grigor Sargsyan,et al.  Visualization of invisible reaction zone of H2 molecules on the front of diffusion flame of propane , 2003, J. Vis..

[9]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[10]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[11]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[12]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[13]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[14]  M. Nicolelis,et al.  Decoding of temporal intervals from cortical ensemble activity. , 2008, Journal of neurophysiology.

[15]  Tomoki Fukai,et al.  Balanced Excitatory and Inhibitory Inputs to Cortical Neurons Decouple Firing Irregularity from Rate Modulations , 2007, The Journal of Neuroscience.

[16]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[17]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[18]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[19]  J. Ditterich Evidence for time‐variant decision making , 2006, The European journal of neuroscience.

[20]  R. Bogacz Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[21]  E. Miller,et al.  Prospective Coding for Objects in Primate Prefrontal Cortex , 1999, The Journal of Neuroscience.

[22]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[23]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[24]  D. Contreras,et al.  Balanced Excitation and Inhibition Determine Spike Timing during Frequency Adaptation , 2006, The Journal of Neuroscience.

[25]  T. Sejnowski,et al.  Impact of Correlated Synaptic Input on Output Firing Rate and Variability in Simple Neuronal Models , 2000, The Journal of Neuroscience.

[26]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[27]  N. P. Bichot,et al.  Frontal eye field activity before visual search errors reveals the integration of bottom-up and top-down salience. , 2005, Journal of neurophysiology.

[28]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[29]  H. Seung,et al.  In vivo intracellular recording and perturbation of persistent activity in a neural integrator , 2001, Nature Neuroscience.

[30]  J. Partridge,et al.  Long-lasting NMDA receptor-mediated EPSCs in mouse striatal medium spiny neurons. , 2007, Journal of neurophysiology.

[31]  Tomoki Fukai,et al.  Temporal integration by stochastic recurrent network dynamics with bimodal neurons. , 2007, Journal of neurophysiology.

[32]  Catalin V. Buhusi,et al.  What makes us tick? Functional and neural mechanisms of interval timing , 2005, Nature Reviews Neuroscience.

[33]  M. Hasselmo,et al.  Mechanism of Graded Persistent Cellular Activity of Entorhinal Cortex Layer V Neurons , 2006, Neuron.

[34]  David Melcher,et al.  Transsaccadic memory: Building a stable world from glance to glance , 2007 .

[35]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[36]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[37]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[38]  S. Haj-Dahmane,et al.  Muscarinic receptors regulate two different calcium‐dependent non‐selective cation currents in rat prefrontal cortex , 1999, The European journal of neuroscience.

[39]  David Melcher,et al.  Accumulation and persistence of memory for natural scenes. , 2006, Journal of vision.

[40]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[41]  T Okada,et al.  Li+ and muscarine cooperatively enhance the cationic tail current in rat cortical pyramidal cells , 1999, The European journal of neuroscience.

[42]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[43]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[44]  Daniel Durstewitz,et al.  Self-Organizing Neural Integrator Predicts Interval Times through Climbing Activity , 2003, The Journal of Neuroscience.

[45]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[46]  C. Stevens,et al.  Input synchrony and the irregular firing of cortical neurons , 1998, Nature Neuroscience.

[47]  Anders Ledberg,et al.  Neurobiological Models of Two-Choice Decision Making Can Be Reduced to a One-Dimensional Nonlinear Diffusion Equation , 2008, PLoS Comput. Biol..

[48]  Masataka Watanabe,et al.  Prefrontal and cingulate unit activity during timing behavior in the monkey , 1979, Brain Research.

[49]  R. Ivry,et al.  The neural representation of time , 2004, Current Opinion in Neurobiology.

[50]  H. Seung,et al.  Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. , 2003, Cerebral cortex.

[51]  D. Tank,et al.  Functional dissection of circuitry in a neural integrator , 2007, Nature Neuroscience.

[52]  M. Hasselmo,et al.  Simulations of the Role of the Muscarinic-Activated Calcium-Sensitive Nonspecific Cation CurrentINCM in Entorhinal Neuronal Activity during Delayed Matching Tasks , 2002, The Journal of Neuroscience.

[53]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[54]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[55]  R. Romo,et al.  A recurrent network model of somatosensory parametric working memory in the prefrontal cortex. , 2003, Cerebral cortex.

[56]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[57]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[58]  Tomoki Fukai,et al.  A Cellular Mechanism for Graded Persistent Activity in a Model Neuron and Its Implications in Working Memory , 2005, Journal of Computational Neuroscience.

[59]  R. Carpenter,et al.  The influence of urgency on decision time , 2000, Nature Neuroscience.

[60]  T. Ono,et al.  Retrospective and prospective coding for predicted reward in the sensory thalamus , 2001, Nature.

[61]  D. Drubach A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex , 2009 .

[62]  M. Shadlen,et al.  Limits to the temporal fidelity of cortical spike rate signals , 2002, Nature Neuroscience.