The first second: Models of short-term memory traces in the brain

Many network models in computational neuroscience rise to the challenge of explaining behavioural phenomena ranging from microseconds to tens of seconds using components operating mostly on a time-scale of milliseconds. These models have in common that the underlying system has a memory, which implies that its output depends on its past input history. In this review we compare how such memory traces or delayed responses may be implemented in different brain areas supporting a diversity of functions.

[1]  Julian Eggert,et al.  Short Term Memory and Pattern Matching with Simple Echo State Networks , 2005, ICANN.

[2]  Jung Hoon Shin,et al.  Transient Upregulation of Postsynaptic IP3-Gated Ca Release Underlies Short-Term Potentiation of Metabotropic Glutamate Receptor 1 Signaling in Cerebellar Purkinje Cells , 2008, The Journal of Neuroscience.

[3]  J. Desmond,et al.  Neural substrates underlying human delay and trace eyeblink conditioning , 2008, Proceedings of the National Academy of Sciences.

[4]  H. Robinson,et al.  Recurrent Synaptic Input and the Timing of Gamma-Frequency-Modulated Firing of Pyramidal Cells during Neocortical “UP” States , 2008, The Journal of Neuroscience.

[5]  J. Houk,et al.  Modulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistability. , 2003, Journal of neurophysiology.

[6]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[7]  D. Kleinfeld,et al.  Traveling Electrical Waves in Cortex Insights from Phase Dynamics and Speculation on a Computational Role , 2001, Neuron.

[8]  Krisztina Szalisznyó,et al.  Dopamine induced switch in the subthreshold dynamics of the striatal cholinergic interneurons: a numerical study. , 2009, Journal of theoretical biology.

[9]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[10]  Sonja Grün,et al.  Detecting synfire chain activity using massively parallel spike train recording. , 2008, Journal of neurophysiology.

[11]  Paul Smolen,et al.  Effects of macromolecular transport and stochastic fluctuations on dynamics of genetic regulatory systems. , 1999, American journal of physiology. Cell physiology.

[12]  Erik De Schutter,et al.  Oscillations in the cerebellar cortex: a prediction of their frequency bands. , 2005, Progress in brain research.

[13]  W. Meck,et al.  Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. , 2004, Brain research. Cognitive brain research.

[14]  Patrick D. Roberts,et al.  Recurrent neural network generates a basis for sensory image cancellation , 2005, Neurocomputing.

[15]  Xiao-Jing Wang,et al.  The dynamical stability of reverberatory neural circuits , 2002, Biological Cybernetics.

[16]  Joshua W. Brown,et al.  How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues , 1999, The Journal of Neuroscience.

[17]  D. Tank,et al.  Functional dissection of circuitry in a neural integrator , 2007, Nature Neuroscience.

[18]  Charles J. Wilson,et al.  Activity Patterns in a Model for the Subthalamopallidal Network of the Basal Ganglia , 2002, The Journal of Neuroscience.

[19]  H. Bergman,et al.  Pathological synchronization in Parkinson's disease: networks, models and treatments , 2007, Trends in Neurosciences.

[20]  W. Friesen,et al.  Formal approaches to understanding biological oscillators. , 1993, Annual review of physiology.

[21]  J. Leo van Hemmen,et al.  Spontaneously emerging direction selectivity maps in visual cortex through STDP , 2005, Biological Cybernetics.

[22]  Dora E Angelaki,et al.  A Reevaluation of the Inverse Dynamic Model for Eye Movements , 2007, The Journal of Neuroscience.

[23]  J J Hopfield,et al.  Neural computation by concentrating information in time. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Stephen C. Cannon,et al.  A proposed neural network for the integrator of the oculomotor system , 1983, Biological Cybernetics.

[25]  Ray W Turner,et al.  Firing dynamics of cerebellar purkinje cells. , 2007, Journal of neurophysiology.

[26]  Shihab A. Shamma Spatial and temporal processing in central auditory networks , 1989 .

[27]  Marco Idiart,et al.  Memory retrieval time and memory capacity of the CA3 network: role of gamma frequency oscillations. , 2007, Learning & memory.

[28]  Michael E Hasselmo,et al.  Computation by oscillations: Implications of experimental data for theoretical models of grid cells , 2008, Hippocampus.

[29]  T. Yin,et al.  A matter of time: internal delays in binaural processing , 2007, Trends in Neurosciences.

[30]  D. Willshaw,et al.  Subthalamic–pallidal interactions are critical in determining normal and abnormal functioning of the basal ganglia , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[31]  S. Grossberg,et al.  Metabotropic Glutamate Receptor Activation in Cerebellar Purkinje Cells as Substrate for Adaptive Timing of the Classically Conditioned Eye-Blink Response , 1996, The Journal of Neuroscience.

[32]  C. Koch,et al.  Methods in Neuronal Modeling: From Ions to Networks , 1998 .

[33]  B. Grothe,et al.  Precise inhibition is essential for microsecond interaural time difference coding , 2002, Nature.

[34]  Máté Lengyel,et al.  Theta oscillation‐coupled dendritic spiking integrates inputs on a long time scale , 2005, Hippocampus.

[35]  R. Freeman,et al.  The Derivation of Direction Selectivity in the Striate Cortex , 2004, The Journal of Neuroscience.

[36]  Frances S. Chance,et al.  Synaptic Depression and the Temporal Response Characteristics of V1 Cells , 1998, The Journal of Neuroscience.

[37]  J J Hopfield,et al.  Transforming neural computations and representing time. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[39]  Charles J. Wilson,et al.  Origin of the slow afterhyperpolarization and slow rhythmic bursting in striatal cholinergic interneurons. , 2006, Journal of neurophysiology.

[40]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[41]  J. Fuster,et al.  Prefrontal Cortex and the Bridging of Temporal Gaps in the Perception‐Action Cycle , 1990, Annals of the New York Academy of Sciences.

[42]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[43]  Christos Constantinidis,et al.  The sensory nature of mnemonic representation in the primate prefrontal cortex , 2001, Nature Neuroscience.

[44]  W. Schultz Behavioral dopamine signals , 2007, Trends in Neurosciences.

[45]  Bard Ermentrout,et al.  When inhibition not excitation synchronizes neural firing , 1994, Journal of Computational Neuroscience.

[46]  J. Bassett,et al.  Persistent neural activity in head direction cells. , 2003, Cerebral cortex.

[47]  J. Fellous,et al.  A role for NMDA-receptor channels in working memory , 1998, Nature Neuroscience.

[48]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[49]  N. Macdonald Biological Delay Systems: Linear Stability Theory , 1989 .

[50]  P. Somogyi,et al.  Neuronal Diversity and Temporal Dynamics: The Unity of Hippocampal Circuit Operations , 2008, Science.

[51]  Nicolas Brunel,et al.  STDP in a Bistable Synapse Model Based on CaMKII and Associated Signaling Pathways , 2007, PLoS Comput. Biol..

[52]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[53]  Katsunori Kitano,et al.  Time representing cortical activities: two models inspired by prefrontal persistent activity , 2003, Biological Cybernetics.

[54]  Vincenzo Crunelli,et al.  The ‘window’ T‐type calcium current in brain dynamics of different behavioural states , 2005, The Journal of physiology.

[55]  Günther Palm,et al.  Synaptic Delay Learning in Pulse-Coupled Neurons , 1998, Neural Computation.

[56]  H. Wilson,et al.  Dynamics of travelling waves in visual perception , 2001, Nature.

[57]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[58]  Zheng Liu,et al.  Short-Term Memory Trace in Rapidly Adapting Synapses of Inferior Temporal Cortex , 2008, PLoS Comput. Biol..

[59]  K. Gurney,et al.  A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia , 2006, The Journal of Neuroscience.

[60]  Y. Yarom,et al.  Resonance, oscillation and the intrinsic frequency preferences of neurons , 2000, Trends in Neurosciences.

[61]  Tahl Holtzman,et al.  Different responses of rat cerebellar Purkinje cells and Golgi cells evoked by widespread convergent sensory inputs , 2006, The Journal of physiology.

[62]  R. Angus Silver,et al.  Cerebellar LTD and Pattern Recognition by Purkinje Cells , 2007, Neuron.

[63]  H. Sompolinsky,et al.  Temporal integration by calcium dynamics in a model neuron , 2003, Nature Neuroscience.

[64]  Jozsi Z. Jalics,et al.  NMDA receptor-dependent switching between different gamma rhythm-generating microcircuits in entorhinal cortex , 2008, Proceedings of the National Academy of Sciences.

[65]  Maxim Bazhenov,et al.  Membrane bistability in thalamic reticular neurons during spindle oscillations. , 2005, Journal of neurophysiology.

[66]  Gerardo Lafferriere,et al.  An implementation of reinforcement learning based on spike timing dependent plasticity , 2008, Biological Cybernetics.

[67]  D. Durstewitz,et al.  Beyond bistability: Biophysics and temporal dynamics of working memory , 2006, Neuroscience.

[68]  E De Schutter,et al.  Precise spike timing of tactile-evoked cerebellar Golgi cell responses: a reflection of combined mossy fiber and parallel fiber activation? , 2000, Progress in brain research.

[69]  W. Rall Theory of Physiological Properties of Dendrites , 1962, Annals of the New York Academy of Sciences.

[70]  G. Orban,et al.  Model circuit of spiking neurons generating directional selectivity in simple cells. , 1996, Journal of neurophysiology.

[71]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[72]  David Willshaw,et al.  Generation of time delays: Simplified models of intracellular signalling in cerebellar Purkinje cells , 2006, Network.

[73]  Christine Köppl,et al.  Maps of interaural time difference in the chicken’s brainstem nucleus laminaris , 2008, Biological Cybernetics.

[74]  David J. Willshaw,et al.  A Biophysical Model of Synaptic Delay Learning and Temporal Pattern Recognition in a Cerebellar Purkinje Cell , 2004, Journal of Computational Neuroscience.

[75]  Simon Hanslmayr,et al.  Alpha phase reset contributes to the generation of ERPs. , 2006, Cerebral cortex.

[76]  T. Sejnowski,et al.  A Computational Model of How the Basal Ganglia Produce Sequences , 1998, Journal of Cognitive Neuroscience.

[77]  M. Hasselmo,et al.  Mechanism of Graded Persistent Cellular Activity of Entorhinal Cortex Layer V Neurons , 2006, Neuron.

[78]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[79]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[80]  Nicolas Brunel,et al.  Dynamics and plasticity of stimulus-selective persistent activity in cortical network models. , 2003, Cerebral cortex.

[81]  G. Ermentrout,et al.  Analysis of neural excitability and oscillations , 1989 .

[82]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[83]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[84]  Thomas A Cleland,et al.  Dynamical mechanisms of odor processing in olfactory bulb mitral cells. , 2006, Journal of neurophysiology.

[85]  John Rinzel,et al.  An intracellular Ca2+ subsystem as a biologically plausible source of intrinsic conditional bistability in a network model of working memory , 2006, Journal of Computational Neuroscience.

[86]  Xiao-Jing Wang,et al.  The Stability of a Stochastic CaMKII Switch: Dependence on the Number of Enzyme Molecules and Protein Turnover , 2005, PLoS biology.

[87]  Walter Senn,et al.  Spike-Based Synaptic Plasticity and the Emergence of Direction Selective Simple Cells: Simulation Results , 2002, Journal of Computational Neuroscience.