Interval timing as an emergent learning property.

Interval timing in operant conditioning is the learned covariation of a temporal dependent measure such as wait time with a temporal independent variable such as fixed-interval duration. The dominant theories of interval timing all incorporate an explicit internal clock, or "pacemaker," despite its lack of independent evidence. The authors propose an alternative, pacemaker-free view that demonstrates that temporal discrimination can be explained by using only 2 assumptions: (a) variation and selection of responses through competition between reinforced behavior and all other, elicited, behaviors and (b) modulation of the strength of response competition by the memory for recent reinforcement. The model departs radically from existing timing models: It shows that temporal learning can emerge from a simple dynamic process that lacks a periodic time reference such as a pacemaker.

[1]  R. Church,et al.  Methamphetamine and time estimation. , 1981, Journal of experimental psychology. Animal behavior processes.

[2]  Bartlett W. Mel Synaptic integration in an excitable dendritic tree. , 1993, Journal of neurophysiology.

[3]  M. Sur,et al.  Adaptation-Induced Plasticity of Orientation Tuning in Adult Visual Cortex , 2000, Neuron.

[4]  Armando Machado,et al.  Acquisition and extinction under periodic reinforcement , 1998, Behavioural Processes.

[5]  M. Spetch,et al.  The effect of d-amphetamine on short-term memory for time in pigeons , 1984, Pharmacology Biochemistry and Behavior.

[6]  M. Mauk,et al.  Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[8]  F. C. Clark Effects of Repeated VI Reinforcement and Extinction upon Operant Behavior , 1964 .

[9]  M. Treisman Temporal discrimination and the indifference interval. Implications for a model of the "internal clock". , 1963, Psychological monographs.

[10]  R. Church,et al.  Application of scalar timing theory to individual trials. , 1994 .

[11]  R. Church,et al.  Nucleus basalis magnocellularis and medial septal area lesions differentially impair temporal memory , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  J. Falk Physiology and Behavior. , 1973 .

[13]  G. S. Reynolds,et al.  A quantitative analysis of the responding maintained by interval schedules of reinforcement. , 1968, Journal of the experimental analysis of behavior.

[14]  R. Malott,et al.  Schedules of interresponse time reinforcement , 1964 .

[15]  M. Zeiler,et al.  Temporal control in fixed-interval schedules. , 1994, Journal of the experimental analysis of behavior.

[16]  W. N. Schoenfeld The Theory of reinforcement schedules , 1970 .

[17]  M. Sidman Time discrimination and behavioral interaction in a free operant situation. , 1956, Journal of comparative and physiological psychology.

[18]  R T KELLEHER,et al.  Inter-response time distribution as a function of differential reinforcement of temporally spaced responses. , 1959, Journal of the experimental analysis of behavior.

[19]  Dynamics of time discrimination. , 1991, Journal of experimental psychology. Animal behavior processes.

[20]  P. Killeen,et al.  A behavioral theory of timing , 1988 .

[21]  A. Machado Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. , 1997, Journal of the experimental analysis of behavior.

[22]  D. Shurtleff,et al.  Perceptual bisection in rats: The effects of physostigmine, scopolamine and pirenzepine , 1992, Physiology & Behavior.

[23]  J. Gibbon Dynamics of time matching: Arousal makes better seem worse , 1995, Psychonomic bulletin & review.

[24]  Markus Meister,et al.  Individual neurons dissociated from rat suprachiasmatic nucleus express independently phased circadian firing rhythms , 1995, Neuron.

[25]  J. Dalrymple-Alford,et al.  Effects of lesions to the cerebellar vermis and hemispheres on timing and counting in rats. , 1999, Behavioral neuroscience.

[26]  L. Abbott,et al.  A model of multiplicative neural responses in parietal cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Russell M. Church,et al.  A connectionist model of timing. , 1991 .

[28]  B A Schneider,et al.  A two-state analysis of fixed-interval responding in the pigeon. , 1969, Journal of the experimental analysis of behavior.

[29]  J. Staddon,et al.  Chapter 1 Dynamic models of rapid temporal control in animals , 1997 .

[30]  J. Staddon,et al.  The "supersitition" experiment: A reexamination of its implications for the principles of adaptive behavior. , 1971 .

[31]  A. Machado Learning the temporal dynamics of behavior. , 1997, Psychological review.

[32]  Valentin Dragoi,et al.  A Dynamic Theory of Acquisition and Extinction in Operant Learning , 1997, Neural Networks.

[33]  J. Gibbon,et al.  Simultaneous timing of multiple intervals: implications of the scalar property. , 1995, Journal of experimental psychology. Animal behavior processes.

[34]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[35]  C. Buhusi,et al.  Timing in simple conditioning and occasion setting: a neural network approach , 1999, Behavioural Processes.

[36]  J. Staddon,et al.  SOME PROPERTIES OF SPACED RESPONDING IN PIGEONS. , 1965, Journal of the experimental analysis of behavior.

[37]  R M Church,et al.  Comparison of variance and covariance patterns in parallel and serial theories of timing. , 1992, Journal of the experimental analysis of behavior.

[38]  J. Staddon,et al.  Time and memory: towards a pacemaker-free theory of interval timing. , 1999, Journal of the experimental analysis of behavior.

[39]  J. Gibbon Origins of scalar timing , 1991 .

[40]  W. Meck Neuropharmacology of timing and time perception. , 1996, Brain research. Cognitive brain research.

[41]  J. Staddon,et al.  The dynamics of operant conditioning. , 1999, Psychological review.

[42]  G. Cahill,et al.  Circadian rhythmicity in the locomotor activity of larval zebrafish , 1998, Neuroreport.

[43]  W. K. Honig,et al.  Handbook of Operant Behavior , 2022 .

[44]  M. Wilson,et al.  On the selective reinforcement of spaced responses. , 1953, Journal of comparative and physiological psychology.

[45]  J. Staddon,et al.  A tuned-trace theory of interval-timing dynamics. , 2002, Journal of the experimental analysis of behavior.

[46]  K. Bättig,et al.  The effects of the noncompetitive NMDA receptor antagonist MK 801 on DRL performance in rats , 1991, Psychobiology.

[47]  M. Mirmiran,et al.  Circadian rhythms and the suprachiasmatic nucleus in perinatal development, aging and Alzheimer's disease. , 1992, Progress in brain research.

[48]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[49]  L. M. Lieving,et al.  Effects of D-amphetamine in a temporal discrimination procedure: selective changes in timing or rate dependency? , 2002, Journal of the experimental analysis of behavior.

[50]  C. R. Fourtner,et al.  Nonspiking interneurons in walking system of the cockroach. , 1975, Journal of neurophysiology.

[51]  John E. R. Staddon Adaptive Dynamics: The Theoretical Analysis of Behavior , 2001 .

[52]  A. Santi,et al.  Memory for event duration in rats , 1995 .

[53]  R M Church,et al.  Properties of the Internal Clock a , 1984, Annals of the New York Academy of Sciences.