Time and memory: towards a pacemaker-free theory of interval timing.

A popular view of interval timing in animals is that it is driven by a discrete pacemaker-accumulator mechanism that yields a linear scale for encoded time. But these mechanisms are fundamentally at odds with the Weber law property of interval timing, and experiments that support linear encoded time can be interpreted in other ways. We argue that the dominant pacemaker-accumulator theory, scalar expectancy theory (SET), fails to explain some basic properties of operant behavior on interval-timing procedures and can only accommodate a number of discrepancies by modifications and elaborations that raise questions about the entire theory. We propose an alternative that is based on principles of memory dynamics derived from the multiple-time-scale (MTS) model of habituation. The MTS timing model can account for data from a wide variety of time-related experiments: proportional and Weber law temporal discrimination, transient as well as persistent effects of reinforcement omission and reinforcement magnitude, bisection, the discrimination of relative as well as absolute duration, and the choose-short effect and its analogue in number-discrimination experiments. Resemblances between timing and counting are an automatic consequence of the model. We also argue that the transient and persistent effects of drugs on time estimates can be interpreted as well within MTS theory as in SET. Recent real-time physiological data conform in surprising detail to the assumptions of the MTS habituation model. Comparisons between the two views suggest a number of novel experiments.

[1]  H. Jennings Behavior of the Lower Organisms , 1907 .

[2]  S. S. Stevens Mathematics, measurement, and psychophysics. , 1951 .

[3]  N E Manos,et al.  Stochastic Models , 1960, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[4]  D. M. MacKay,et al.  Psychophysics of Perceived Intensity: A Theoretical Basis for Fechner's and Stevens' Laws , 1963, Science.

[5]  E. N. Solokov Perception and the conditioned reflex , 1963 .

[6]  M. Treisman Temporal discrimination and the indifference interval. Implications for a model of the "internal clock". , 1963, Psychological monographs.

[7]  Erwin Bünning,et al.  The Physiological Clock , 1964, Heidelberg Science Library.

[8]  G. Ekman,et al.  Is the Power Law a Special Case of Fechner's Law? , 1964, Perceptual and motor skills.

[9]  J. Staddon,et al.  SOME PROPERTIES OF SPACED RESPONDING IN PIGEONS. , 1965, Journal of the experimental analysis of behavior.

[10]  P ROZIN Temperature Independence of an Arbitrary Temporal Discrimination in the Goldfish , 1965, Science.

[11]  R. F. Thompson,et al.  Habituation: a model phenomenon for the study of neuronal substrates of behavior. , 1966, Psychological review.

[12]  J. Staddon,et al.  An effect analogous to “frustration” on interval reinforcement schedules , 1966 .

[13]  M. Cook,et al.  The Power Law as a Special Case of Fechner's Law , 1967, Perceptual and motor skills.

[14]  R. Herrnstein,et al.  Choice and delay of reinforcement. , 1967, Journal of the experimental analysis of behavior.

[15]  A. Stubbs The discrimination of stimulus duration by pigeons. , 1968, Journal of the experimental analysis of behavior.

[16]  J. Staddon,et al.  Reinforcement omission on fixed-interval schedules. , 1969, Journal of the experimental analysis of behavior.

[17]  B A Schneider,et al.  A two-state analysis of fixed-interval responding in the pigeon. , 1969, Journal of the experimental analysis of behavior.

[18]  D. C. Wood,et al.  Parametric studies of the response decrement produced by mechanical stimuli in the protozoan, Stentor coeruleus. , 1969, Journal of neurobiology.

[19]  J E Staddon,et al.  Multiple fixed-interval schedules: transient contrast and temporal inhibition. , 1969, Journal of the experimental analysis of behavior.

[20]  J. Staddon Temporal Effects of Reinforcement: A Negative "Frustration" Effect' , 1970 .

[22]  J. Staddon Effect of reinforcement duration on fixed-interval responding. , 1970, Journal of the experimental analysis of behavior.

[23]  M. Davis,et al.  Effects of interstimulus interval length and variability on startle-response habituation in the rat. , 1970, Journal of comparative and physiological psychology.

[24]  J E Staddon,et al.  Temporal tracking on cyclic-interval reinforcement schedules. , 1971, Journal of the experimental analysis of behavior.

[25]  J. Staddon,et al.  The "supersitition" experiment: A reexamination of its implications for the principles of adaptive behavior. , 1971 .

[26]  J. Kello The reinforcement-omission effect on fixed-interval schedules: Frustration or inhibition? , 1972 .

[27]  J. Staddon A note on the analysis of behavioural sequences in Columba livia , 1972 .

[28]  Eric R. Kandel,et al.  Long-Term Habituation of a Defensive Withdrawal Reflex in Aplysia , 1972, Science.

[29]  J. Staddon,et al.  Reinforcement omission on temporal go-no-go schedules. , 1972, Journal of the experimental analysis of behavior.

[30]  E. Eisenstein,et al.  Comparative Aspects of Habituation in Invertebrates , 1973 .

[31]  J. Staddon A Note on Behavioural Contrast and Frustration , 1974, The Quarterly journal of experimental psychology.

[32]  J. Staddon,et al.  Control of long-interval performance on mixed cyclic-interval schedules , 1974 .

[33]  Effects of Restraint on Temporal Discrimination Behavior , 1974 .

[34]  B C Starr,et al.  Temporal control of periodic schedules: signal properties of reinforcement and blackout. , 1974, Journal of the experimental analysis of behavior.

[35]  G. Davey,et al.  Effects of reinforcement magnitude on interval and ratio schedules. , 1974, Journal of the experimental analysis of behavior.

[36]  J. Staddon Temporal control, attention, and memory. , 1974 .

[37]  LIMITATIONS ON TEMPORAL CONTROL: GENERALIZATION AND THE EFFECTS OF CONTEXT , 1975 .

[38]  J. Staddon,et al.  Sequential and Temporal Properties of Behavior Induced By a Schedule of Periodic Food Delivery , 1975 .

[39]  Sara J. Shettleworth,et al.  Reinforcement and the Organization of Behavior in Golden Hamsters: Hunger , 1975 .

[40]  John E. R. Staddon,et al.  Temporal control on periodic schedules: Fine structure , 1975 .

[41]  R. Church,et al.  Bisection of temporal intervals. , 1977, Journal of experimental psychology. Animal behavior processes.

[42]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[43]  John E. R. Staddon,et al.  THEORY OF BEHAVIORAL POWER FUNCTIONS , 1978 .

[44]  Russell M. Church,et al.  Short-term memory for time intervals , 1980 .

[45]  R. Church,et al.  Time left: linear versus logarithmic subjective time. , 1981, Journal of experimental psychology. Animal behavior processes.

[46]  J. Gibbon On the form and location of the Psychometric Bisection Function for time , 1981 .

[47]  M. Spetch,et al.  Duration discrimination is better with food access as the signal than with light as the signal , 1981 .

[48]  J. Byrne,et al.  Analysis of synaptic depression contributing to habituation of gill-withdrawal reflex in Aplysia californica. , 1982, Journal of neurophysiology.

[49]  W. Meck Selective adjustment of the speed of internal clock and memory processes. , 1983, Journal of experimental psychology. Animal behavior processes.

[50]  J. Hinson,et al.  Hill-climbing by pigeons. , 1983, Journal of the experimental analysis of behavior.

[51]  P.N.J. Mackintosh Adaptive Behavior and Learning, J.E.R. Staddon. Cambridge University Press, Cambridge (1984), xiii, +555. Price £30.00 hardback, £10.95 paperback , 1984 .

[52]  S. Roberts,et al.  What starts an internal clock? , 1984, Journal of experimental psychology. Animal behavior processes.

[53]  L. Petrinovich,et al.  Habituation, sensitization, and behavior , 1984 .

[54]  M. Treisman CHAPTER 3 – A Theory of the Mechanism of Habituation: The Assignment of Responses to Stimuli , 1984 .

[55]  J. Byrne,et al.  Simulation of synaptic depression, posttetanic potentiation, and presynaptic facilitation of synaptic potentials from sensory neurons mediating gill-withdrawal reflex in Aplysia. , 1985, Journal of neurophysiology.

[56]  R M Church,et al.  Temporal integration in duration and number discrimination. , 1985, Journal of experimental psychology. Animal behavior processes.

[57]  J. Gibbon The Structure Of Subjective Time: How Time Flies , 1986 .

[58]  J. R. Sampson,et al.  Biological Information Processing. , 1987 .

[59]  M. Spetch Systematic errors in pigeons’ memory for event duration: Interaction between training and test delay , 1987 .

[60]  J. Fetterman,et al.  Discrimination of temporal relations by pigeons. , 1988, Journal of experimental psychology. Animal behavior processes.

[61]  P. Killeen,et al.  A behavioral theory of timing. , 1988, Psychological review.

[62]  C. Wynne,et al.  Journal of the Experimental Analysis of Behavior Typical Delay Determines Waiting Time on Periodic-food Schedules: Static and Dynamic Tests , 2022 .

[63]  M. Bonem,et al.  Elucidating the effects of reinforcement magnitude. , 1988, Psychological bulletin.

[64]  M. Spetch,et al.  Pigeons’ memory for event duration: Intertrial interval and delay effects , 1989 .

[65]  J. Fetterman,et al.  Short-term memory for responses: the "choose-small" effect. , 1989, Journal of the experimental analysis of behavior.

[66]  J. Fetterman,et al.  Discrimination of duration ratios. , 1989, Journal of experimental psychology. Animal behavior processes.

[67]  R. Shull,et al.  Delay and number of food reinforcers: Effects on choice and latencies. , 1990, Journal of the experimental analysis of behavior.

[68]  P. Kop Reinforcement, choice and response strength , 1990 .

[69]  R. Church,et al.  Representation of time , 1990, Cognition.

[70]  J. Wixted,et al.  On the Form of Forgetting , 1991 .

[71]  Warren H. Meck,et al.  Symmetrical and asymmetrical sources of variance in temporal generalization , 1991 .

[72]  P. Killeen,et al.  The effects of rate and amount of reinforcement on the speed of the pacemaker in pigeons’ timing behavior , 1991 .

[73]  M. Zeiler Ecological influences on timing , 1991 .

[74]  J. Gibbon Origins of scalar timing , 1991 .

[75]  J. Gibbon,et al.  Human bisection at the geometric mean , 1991 .

[76]  John Gibbon,et al.  Ubiquity of scalar timing with Poisson clock , 1992 .

[77]  R M Church,et al.  Comparison of variance and covariance patterns in parallel and serial theories of timing. , 1992, Journal of the experimental analysis of behavior.

[78]  M. Perone,et al.  Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude. , 1992, Journal of the experimental analysis of behavior.

[79]  J. Fetterman,et al.  On discriminating temporal relations: Is it relational? , 1992 .

[80]  K. Cheng,et al.  Analysis of single trials in pigeons' timing performance. , 1993 .

[81]  P. Killeen,et al.  The behavioral theory of timing: transition analyses. , 1993, Journal of the experimental analysis of behavior.

[82]  John E. R. Staddon,et al.  On Rate-Sensitive Habituation , 1993, Adapt. Behav..

[83]  J. Fetterman,et al.  Duration comparison: relative stimulus differences stimulus age, and stimulus predictiveness. , 1994, Journal of the experimental analysis of behavior.

[84]  R. Church,et al.  Application of scalar timing theory to individual trials. , 1994, Journal of experimental psychology. Animal behavior processes.

[85]  J. Gibbon,et al.  Choice between fixed and variable delays with different reward amounts. , 1994, Journal of experimental psychology. Animal behavior processes.

[86]  M. Zeiler,et al.  Temporal control in fixed-interval schedules. , 1994, Journal of the experimental analysis of behavior.

[87]  J. Gibbon,et al.  Simultaneous timing of multiple intervals: implications of the scalar property. , 1995, Journal of experimental psychology. Animal behavior processes.

[88]  Lewis A. Bizo,et al.  Reinforcement context and pacemaker rate in the behavioral theory of timing , 1995 .

[89]  J. Gibbon,et al.  Timing processes in the reinforcement-omission effect , 1995 .

[90]  D. Rubin,et al.  One Hundred Years of Forgetting : A Quantitative Description of Retention , 1996 .

[91]  J J Higa,et al.  Multiple time scales in simple habituation. , 1996, Psychological review.

[92]  W. Meck Neuropharmacology of timing and time perception. , 1996, Brain research. Cognitive brain research.

[93]  S. Golden,et al.  Circadian Rhythms in Rapidly Dividing Cyanobacteria , 1997, Science.

[94]  W. Meck Chapter 4 Application of a mode-control model of temporal integration to counting and timing behavior , 1997 .

[95]  J. Staddon,et al.  Chapter 1 Dynamic models of rapid temporal control in animals , 1997 .

[96]  L. Bizo,et al.  Training with controlled reinforcer density: implications for models of timing , 1997 .

[97]  J Gibbon,et al.  Mnemonics for variability: remembering food delay. , 1997, Journal of experimental psychology. Animal behavior processes.

[98]  J. Wearden,et al.  Adjusting to changes in the time of reinforcement: peak-interval transitions in rats. , 1997, Journal of experimental psychology. Animal behavior processes.

[99]  J. Wixted,et al.  Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions , 1997, Memory & cognition.

[100]  T J Sejnowski,et al.  Biological Information Processing: Bits of Progress , 1997, Science.

[101]  Marcia L. Spetch,et al.  Pigeons''coding of event duration in delayed-matching-to-sample , 1997 .

[102]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[103]  J. M. Horner,et al.  Integration of reinforcement effects over time , 1997 .

[104]  Fetterman Jg A temporal intermediate stimulus problem. , 1998 .

[105]  Thomas R. Zentall,et al.  Timing in pigeons: The choose-short effect may result from pigeons’ “confusion” between delay and intertrial intervals , 1998 .

[106]  J Glantz Magnetic brain imaging traces a stairway to memory. , 1998, Science.

[107]  A temporal intermediate stimulus problem. , 1998, Journal of experimental psychology. Animal behavior processes.

[108]  J. Staddon,et al.  The dynamics of operant conditioning. , 1999, Psychological review.