Neural Computations in a Dynamical System with Multiple Time Scales

Neural systems display rich short-term dynamics at various levels, e.g., spike-frequency adaptation (SFA) at the single-neuron level, and short-term facilitation (STF) and depression (STD) at the synapse level. These dynamical features typically cover a broad range of time scales and exhibit large diversity in different brain regions. It remains unclear what is the computational benefit for the brain to have such variability in short-term dynamics. In this study, we propose that the brain can exploit such dynamical features to implement multiple seemingly contradictory computations in a single neural circuit. To demonstrate this idea, we use continuous attractor neural network (CANN) as a working model and include STF, SFA and STD with increasing time constants in its dynamics. Three computational tasks are considered, which are persistent activity, adaptation, and anticipative tracking. These tasks require conflicting neural mechanisms, and hence cannot be implemented by a single dynamical feature or any combination with similar time constants. However, with properly coordinated STF, SFA and STD, we show that the network is able to implement the three computational tasks concurrently. We hope this study will shed light on the understanding of how the brain orchestrates its rich dynamics at various levels to realize diverse cognitive functions.

[1]  Tim Gollisch,et al.  Modeling Single-Neuron Dynamics and Computations: A Balance of Detail and Abstraction , 2006, Science.

[2]  S. Laughlin The role of sensory adaptation in the retina. , 1989, The Journal of experimental biology.

[3]  Misha Tsodyks,et al.  Persistent Activity in Neural Networks with Dynamic Synapses , 2007, PLoS Comput. Biol..

[4]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[5]  Jian-Young Wu,et al.  Propagating Waves of Activity in the Neocortex: What They Are, What They Do , 2008, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[6]  Paul C. Bressloff,et al.  Spatially structured oscillations in a two-dimensional excitatory neuronal network with synaptic depression , 2009, Journal of Computational Neuroscience.

[7]  F. Chavane,et al.  Imaging cortical correlates of illusion in early visual cortex , 2004, Nature.

[8]  Joël Tabak,et al.  Spike-Frequency Adaptation , 2014, Encyclopedia of Computational Neuroscience.

[9]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[10]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[11]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[12]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[13]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Paul Miller,et al.  Stabilization of Memory States by Stochastic Facilitating Synapses , 2013, Journal of mathematical neuroscience.

[15]  Si Wu,et al.  Nonlinear multiplicative dendritic integration in neuron and network models , 2013, Front. Comput. Neurosci..

[16]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[17]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[18]  Si Wu,et al.  A Moving Bump in a Continuous Manifold: A Comprehensive Study of the Tracking Dynamics of Continuous Attractor Neural Networks , 2008, Neural Computation.

[19]  Paul Miller,et al.  Accuracy and response-time distributions for decision-making: linear perfect integrators versus nonlinear attractor-based neural circuits , 2013, Journal of Computational Neuroscience.

[20]  Franco Nardini,et al.  The Dynamical System , 2001 .

[21]  G. Buzsáki,et al.  Cell Assembly Sequences Arising from Spike Threshold Adaptation Keep Track of Time in the Hippocampus , 2011, The Journal of Neuroscience.

[22]  S. Heinen Single neuron activity in the dorsomedial frontal cortex during smooth pursuit eye movements , 2004, Experimental Brain Research.

[23]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[24]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[25]  Andreas V. M. Herz,et al.  A Universal Model for Spike-Frequency Adaptation , 2003, Neural Computation.

[26]  Si Wu,et al.  Dynamical Synapses Enhance Neural Information Processing: Gracefulness, Accuracy, and Mobility , 2011, Neural Computation.

[27]  Shun-ichi Amari,et al.  Spontaneous Motion on Two-Dimensional Continuous Attractors , 2015, Neural Computation.

[28]  Y. Dan,et al.  Activity Recall in Visual Cortical Ensemble , 2012, Nature Neuroscience.

[29]  Si Wu,et al.  A Synaptical Story of Persistent Activity with Graded Lifetime in a Neural System , 2014, NIPS.

[30]  Y. Dan,et al.  An arithmetic rule for spatial summation of excitatory and inhibitory inputs in pyramidal neurons , 2009, Proceedings of the National Academy of Sciences.

[31]  J. Bullier,et al.  Visual latencies in areas V1 and V2 of the macaque monkey , 1995, Visual Neuroscience.

[32]  Anatol C. Kreitzer,et al.  Interplay between Facilitation, Depression, and Residual Calcium at Three Presynaptic Terminals , 2000, The Journal of Neuroscience.

[33]  Paul C. Bressloff,et al.  Binocular Rivalry in a Competitive Neural Network with Synaptic Depression , 2010, SIAM J. Appl. Dyn. Syst..

[34]  Xiao-Jing Wang,et al.  Cannabinoid-mediated disinhibition and working memory: dynamical interplay of multiple feedback mechanisms in a continuous attractor model of prefrontal cortex. , 2007, Cerebral cortex.

[35]  J. Taube The head direction signal: origins and sensory-motor integration. , 2007, Annual review of neuroscience.

[36]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[37]  Si Wu,et al.  Short-term synaptic plasticity , 2013, Scholarpedia.

[38]  Boris S. Gutkin,et al.  Turning On and Off with Excitation: The Role of Spike-Timing Asynchrony and Synchrony in Sustained Neural Activity , 2001, Journal of Computational Neuroscience.

[39]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[40]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[41]  Haim Sompolinsky,et al.  Traveling Waves and the Processing of Weakly Tuned Inputs in a Cortical Network Module , 2004, Journal of Computational Neuroscience.

[42]  Ruey-Beei Wu,et al.  Differential Signaling , 2000 .

[43]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.

[44]  A. Leonardo,et al.  Nonlinear Dynamics Support a Linear Population Code in a Retinal Target-Tracking Circuit , 2013, The Journal of Neuroscience.

[45]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[46]  R. M. Boynton,et al.  Visual Adaptation in Monkey Cones: Recordings of Late Receptor Potentials , 1970, Science.

[47]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Si Wu,et al.  Continuous Attractor Neural Networks: Candidate of a Canonical Model for Neural Information Representation , 2016, F1000Research.

[49]  A. Fairhall,et al.  Sensory adaptation , 2007, Current Opinion in Neurobiology.

[50]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[51]  서효정,et al.  Cell-assembly의 생리학적 증거 , 2002 .

[52]  M. Liu,et al.  Single-neuron activity in the dorsomedial frontal cortex during smooth-pursuit eye movements to predictable target motion , 1997, Visual Neuroscience.

[53]  P. Bressloff,et al.  Effects of synaptic depression and adaptation on spatiotemporal dynamics of an excitatory neuronal network , 2010 .

[54]  H. T. Blair,et al.  Anticipatory time intervals of head-direction cells in the anterior thalamus of the rat: implications for path integration in the head-direction circuit. , 1997, Journal of neurophysiology.

[55]  Bard Ermentrout,et al.  Stimulus-Driven Traveling Solutions in Continuum Neuronal Models with a General Smooth Firing Rate Function , 2010, SIAM J. Appl. Math..