A biologically plausible model of time-scale invariant interval timing

The temporal durations between events often exert a strong influence over behavior. The details of this influence have been extensively characterized in behavioral experiments in different animal species. A remarkable feature of the data collected in these experiments is that they are often time-scale invariant. This means that response measurements obtained under intervals of different durations coincide when plotted as functions of relative time. Here we describe a biologically plausible model of an interval timing device and show that it is consistent with time-scale invariant behavior over a substantial range of interval durations. The model consists of a set of bistable units that switch from one state to the other at random times. We first use an abstract formulation of the model to derive exact expressions for some key quantities and to demonstrate time-scale invariance for any range of interval durations. We then show how the model could be implemented in the nervous system through a generic and biologically plausible mechanism. In particular, we show that any system that can display noise-driven transitions from one stable state to another can be used to implement the timing device. Our work demonstrates that a biologically plausible model can qualitatively account for a large body of data and thus provides a link between the biology and behavior of interval timing.

[1]  Riccardo Mannella,et al.  Noise in Nonlinear Dynamical Systems , 2009 .

[2]  Idan Segev,et al.  Methods in Neuronal Modeling , 1988 .

[3]  S. Grossberg,et al.  Metabotropic Glutamate Receptor Activation in Cerebellar Purkinje Cells as Substrate for Adaptive Timing of the Classically Conditioned Eye-Blink Response , 1996, The Journal of Neuroscience.

[4]  T. Ono,et al.  Retrospective and prospective coding for predicted reward in the sensory thalamus , 2001, Nature.

[5]  C. Morris,et al.  Voltage oscillations in the barnacle giant muscle fiber. , 1981, Biophysical journal.

[6]  H. Kramers.  Brownian motion in a field of force and the diffusion model of chemical reactions , 1940 .

[7]  Xiao-Jing Wang,et al.  Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks , 2003 .

[8]  M. Nicolelis,et al.  Decoding of temporal intervals from cortical ensemble activity. , 2008, Journal of neurophysiology.

[9]  Charles J. Wilson,et al.  The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  F. Manning,et al.  Performance under temporal schedules by monkeys with partial ablations of prefontal cortex. , 1973, Physiology & behavior.

[11]  R. Malenka,et al.  Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. , 2000, Annual review of neuroscience.

[12]  S. Karlin,et al.  A second course in stochastic processes , 1981 .

[13]  W. Smeets,et al.  Evolution of the basal ganglia: new perspectives through a comparative approach , 2000, Journal of anatomy.

[14]  L. Pontryagin,et al.  Noise in nonlinear dynamical systems: Appendix: On the statistical treatment of dynamical systems , 1989 .

[15]  Sabine Windmann,et al.  Single forebrain neurons represent interval timing and reward amount during response scheduling , 2006, The European journal of neuroscience.

[16]  Paul Miller,et al.  Stability of discrete memory states to stochastic fluctuations in neuronal systems. , 2006, Chaos.

[17]  Bruno Delord,et al.  A biophysical model of nonlinear dynamics underlying plateau potentials and calcium spikes in purkinje cell dendrites. , 2002, Journal of neurophysiology.

[18]  Masahiko Inase,et al.  Striatal neurons encoded temporal information in duration discrimination task , 2008, Experimental Brain Research.

[19]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[20]  Mortimer Mishkin,et al.  Time discrimination with positional responses after selective prefrontal lesions in monkeys , 1981, Brain Research.

[21]  W. Ebeling.  Stochastic Processes in Physics and Chemistry , 1995 .

[22]  W. Senn,et al.  Climbing Neuronal Activity as an Event-Based Cortical Representation of Time , 2004, The Journal of Neuroscience.

[23]  W. Meck.  Neuroanatomical localization of an internal clock: A functional link between mesolimbic, nigrostriatal, and mesocortical dopaminergic systems , 2006, Brain Research.

[24]  H. M. Taylor,et al.  An introduction to stochastic modeling , 1985 .

[25]  J. Wearden,et al.  Scalar Properties in Animal Timing: Conformity and Violations , 2006, Quarterly journal of experimental psychology.

[26]  Daniel Durstewitz,et al.  Self-Organizing Neural Integrator Predicts Interval Times through Climbing Activity , 2003, The Journal of Neuroscience.

[27]  E. Fetz.  Operant Conditioning of Cortical Unit Activity , 1969, Science.

[28]  Tomoki Fukai,et al.  Temporal integration by stochastic recurrent network dynamics with bimodal neurons. , 2007, Journal of neurophysiology.

[29]  W. Meck,et al.  Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. , 2004, Brain research. Cognitive brain research.

[30]  R. Ivry.  The representation of temporal information in perception and motor control , 1996, Current Opinion in Neurobiology.

[31]  R. C. Miall.  Neural networks and the representation of time. , 1993 .

[32]  H Okamoto,et al.  Neural mechanism for a cognitive timer. , 2001, Physical review letters.

[33]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[34]  J. Wearden,et al.  Scalar properties in animal timing: conformity and violations. , 2006, Quarterly journal of experimental psychology.

[35]  M. Hasselmo,et al.  Switching between “On” and “Off” states of persistent activity in lateral entorhinal layer III neurons , 2007, Hippocampus.

[36]  Germán Mato,et al.  Asynchronous States and the Emergence of Synchrony in Large Networks of Interacting Excitatory and Inhibitory Neurons , 2003, Neural Computation.

[37]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[38]  Y. Sakurai,et al.  Stimulus duration in working memory is represented by neuronal activity in the monkey prefrontal cortex , 2004, The European journal of neuroscience.

[39]  Y. Kuznetsov.  Elements of applied bifurcation theory (2nd ed.) , 1998 .

[40]  Christopher Miall,et al.  The Storage of Time Intervals Using Oscillating Neurons , 1989, Neural Computation.

[41]  J. Bargas,et al.  D1 Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca2+ Conductance , 1997, The Journal of Neuroscience.

[42]  M. Nicolelis,et al.  Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons. , 2003, Behavioral neuroscience.

[43]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[44]  Yael Niv,et al.  Operant Conditioning , 1971 .

[45]  G. Ermentrout,et al.  Analysis of neural excitability and oscillations , 1989 .

[46]  Charles J. Wilson,et al.  The generation of natural firing patterns in neostriatal neurons. , 1993, Progress in brain research.

[47]  Masahiko Inase,et al.  Delay period activity of monkey prefrontal neurones during duration‐discrimination task , 2006, The European journal of neuroscience.

[48]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[49]  W. Meck.  Neuropharmacology of timing and time perception. , 1996, Brain research. Cognitive brain research.

[50]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[51]  P. J. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[52]  M. Shadlen,et al.  Representation of Time by Neurons in the Posterior Parietal Cortex of the Macaque , 2003, Neuron.

[53]  Warren H Meck,et al.  Cortico-striatal Representation of Time in Animals and Humans This Review Comes from a Themed Issue on Cognitive Neuroscience Edited Evidence from Patient Populations and Electrical Potentials Neuroimaging Evidence Using Fmri and Pet , 2022 .

[54]  R. Romo,et al.  Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. , 2003, Cerebral cortex.

[55]  P. Goldman-Rakic,et al.  Delay-related activity of prefrontal neurons in rhesus monkeys performing delayed response , 1982, Brain Research.

[56]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos , 2024 .

[57]  A. Machado.  Learning the temporal dynamics of behavior. , 1997, Psychological review.

[58]  A. Grace,et al.  Synaptic interactions among excitatory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[59]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[60]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[61]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[62]  Y. Kuznetsov.  Elements of Applied Bifurcation Theory , 2023, Applied Mathematical Sciences.

[63]  Alexa Riehle,et al.  Context‐related representation of timing processes in monkey motor cortex , 2003, The European journal of neuroscience.

[64]  Catalin V. Buhusi,et al.  What makes us tick? Functional and neural mechanisms of interval timing , 2005, Nature Reviews Neuroscience.

[65]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[66]  J. Gibbon.  Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[67]  William H. Press,et al.  Numerical recipes in C , 2002 .

[68]  Masataka Watanabe,et al.  Prefrontal and cingulate unit activity during timing behavior in the monkey , 1979, Brain Research.

[69]  E. Helfand.  Numerical integration of stochastic differential equations , 1979, The Bell System Technical Journal.

[70]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[71]  P. Killeen,et al.  A behavioral theory of timing. , 1988, Psychological review.

[72]  Shozo Kojima,et al.  Prefrontal neuron activity during delayed-response performance without imperative GO signals in the monkey , 1981, Experimental Neurology.

[73]  Jianfeng Feng,et al.  Computational neuroscience , 1986, Behavioral and Brain Sciences.

[74]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[75]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[76]  Anthony A Grace,et al.  Opposite Influences of Endogenous Dopamine D1 and D2 Receptor Activation on Activity States and Electrophysiological Properties of Striatal Neurons: Studies CombiningIn Vivo Intracellular Recordings and Reverse Microdialysis , 2002, The Journal of Neuroscience.

[77]  Katsunori Kitano,et al.  Time representing cortical activities: two models inspired by prefrontal persistent activity , 2003, Biological Cybernetics.

[78]  Louis Renoult,et al.  Time is a rubberband: neuronal activity in monkey motor cortex in relation to time estimation , 2006, The European journal of neuroscience.

[79]  J. Staddon,et al.  Time and memory: towards a pacemaker-free theory of interval timing. , 1999, Journal of the experimental analysis of behavior.

[80]  D. Sherrington.  Stochastic Processes in Physics and Chemistry , 1983 .

[81]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[82]  Charles J. Wilson,et al.  Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat corticostriatal and striatal neurons in vivo. , 1997, Journal of neurophysiology.