Animal timing: a synthetic approach

Inspired by Spence’s seminal work on transposition, we propose a synthetic approach to understanding the temporal control of operant behavior. The approach takes as primitives the temporal generalization gradients obtained in prototypical concurrent and retrospective timing tasks and then combines them to synthetize more complex temporal performances. The approach is instantiated by the learning-to-time (LeT) model. The article is divided into three parts. In the first part, we review the basic findings concerning the generalization gradients observed in fixed-interval schedules, the peak procedure, and the temporal generalization procedure and then describe how LeT explains them. In the second part, we use LeT to derive by gradient combination the typical performances observed in mixed fixed-interval schedules, the free-operant psychophysical procedure, the temporal bisection task, and the double temporal bisection task. We also show how the model plays the role of a useful null hypothesis to examine whether temporal control in the bisection task is relative or absolute. In the third part, we identify a set of issues that must be solved to advance our understanding of temporal control, including the shape of the generalization gradients outside the range of trained stimulus durations, the nature of temporal memories, the influence of context on temporal learning, whether temporal control can be inhibitory, and whether temporal control is also relational. These issues attest to the heuristic value of a Spencean approach to temporal control.

[1]  W. Meck Functional and neural mechanisms of interval timing , 2003 .

[2]  B A Schneider,et al.  A two-state analysis of fixed-interval responding in the pigeon. , 1969, Journal of the experimental analysis of behavior.

[3]  R M Church,et al.  Comparison of variance and covariance patterns in parallel and serial theories of timing. , 1992, Journal of the experimental analysis of behavior.

[4]  L. M. Lieving,et al.  Effects of D-amphetamine in a temporal discrimination procedure: selective changes in timing or rate dependency? , 2002, Journal of the experimental analysis of behavior.

[5]  M. Matell,et al.  Stimulus compounding in interval timing: the modality-duration relationship of the anchor durations results in qualitatively different response patterns to the compound cue. , 2011, Journal of experimental psychology. Animal behavior processes.

[6]  C. Gallistel,et al.  Sources of variability and systematic error in mouse timing behavior. , 2004, Journal of experimental psychology. Animal behavior processes.

[7]  Yael Niv,et al.  Operant Conditioning , 1971 .

[8]  A. Machado,et al.  Dupla bissecção temporal: Testes críticos de dois modelos de timing , 2010 .

[9]  T. Zentall,et al.  Pigeons show near-optimal win-stay/lose-shift performance on a simultaneous-discrimination, midsession reversal task with short intertrial intervals , 2013, Behavioural Processes.

[10]  W A Roberts,et al.  Timing light and tone signals in pigeons. , 1989, Journal of experimental psychology. Animal behavior processes.

[11]  K. Spence The basis of solution by chimpanzees of the intermediate size problem. , 1942 .

[12]  R. Cook,et al.  Temporal control of internal states in pigeons , 2010, Psychonomic bulletin & review.

[13]  Alexis Faure,et al.  Temporal Sensitivity Changes with Extended Training in a Bisection Task in a Transgenic Rat Model , 2011, Front. Integr. Neurosci..

[14]  W. Roberts,et al.  Pigeons make errors as a result of interval timing in a visual, but not a visual-spatial, midsession reversal task. , 2012, Journal of experimental psychology. Animal behavior processes.

[15]  Armando Machado,et al.  Oscillations following periodic reinforcement , 2009, Behavioural Processes.

[16]  J. Gibbon,et al.  Simultaneous timing of multiple intervals: implications of the scalar property. , 1995, Journal of experimental psychology. Animal behavior processes.

[17]  J. Staddon,et al.  Time and memory: towards a pacemaker-free theory of interval timing. , 1999, Journal of the experimental analysis of behavior.

[18]  Kimberly S. Kirkpatrick,et al.  The role of temporal generalization in a temporal discrimination task , 2007, Behavioural Processes.

[19]  Jessica P. Stagner,et al.  Midsession reversal learning: why do pigeons anticipate and perseverate? , 2012, Learning & Behavior.

[20]  A. Machado,et al.  Relative versus absolute stimulus control in the temporal bisection task. , 2012, Journal of the experimental analysis of behavior.

[21]  A. Machado,et al.  Toward a richer view of the scientific method. The role of conceptual analysis. , 2007, The American psychologist.

[22]  G S REYNOLDS,et al.  Temporal Discrimination in Pigeons , 1962, Science.

[23]  B. Skinner,et al.  The Behavior of Organisms: An Experimental Analysis , 2016 .

[24]  A. Machado,et al.  Testing the scalar expectancy theory (SET) and the learning-to-time model (LeT) in a double bisection task , 2005, Learning & behavior.

[25]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[26]  Monica Luciana,et al.  Interval timing and Parkinson’s disease: heterogeneity in temporal performance , 2007, Experimental Brain Research.

[27]  S. H. Hulse,et al.  The perception of time relations in auditory tempo discrimination , 1993 .

[28]  N. Guttman,et al.  Discriminability and stimulus generalization. , 1956, Journal of experimental psychology.

[29]  J. Wearden,et al.  Scalar properties in animal timing: conformity and violations. , 2006, Quarterly journal of experimental psychology.

[30]  Russell M. Church,et al.  Shifts in the psychophysical function in rats , 2007, Behavioural Processes.

[31]  A. Machado,et al.  Learning in the temporal bisection task: Relative or absolute? , 2016, Journal of experimental psychology. Animal learning and cognition.

[32]  Warren H. Meck,et al.  Acquisition of “Start” and “Stop” response thresholds in peak-interval timing is differentially sensitive to protein synthesis inhibition in the dorsal and ventral striatum , 2011, Front. Integr. Neurosci..

[33]  P. Killeen,et al.  A behavioral theory of timing. , 1988, Psychological review.

[34]  Timothy F. Elsmore,et al.  CONTROL OF RESPONDING BY STIMULUS DURATION1 , 1971 .

[35]  A. Machado,et al.  Further tests of the Scalar Expectancy Theory (SET) and the Learning-to-Time (LeT) model in a temporal bisection task , 2006, Behavioural Processes.

[36]  T F Elsmore,et al.  Control of responding by stimulus duration. , 1971, Journal of the experimental analysis of behavior.

[37]  M. Zeiler,et al.  Temporal control in fixed-interval schedules. , 1994, Journal of the experimental analysis of behavior.

[38]  P. Nichelli,et al.  Time estimation in mild Alzheimer's disease patients , 2009, Behavioral and Brain Functions.

[39]  P B Dews,et al.  Studies on responding under fixed-interval schedules of reinforcement: II. The scalloped pattern of the cumulative record. , 1978, Journal of the experimental analysis of behavior.

[40]  J. Wearden,et al.  Multiple-interval timing in rats: Performance on two-valued mixed fixed-interval schedules. , 2003, Journal of experimental psychology. Animal behavior processes.

[41]  A three-stimulus midsession reversal task in pigeons with visual and spatial discriminative stimuli , 2014, Animal Cognition.

[42]  Dirk Ifenthaler,et al.  Stochastic Models of Learning , 2012 .

[43]  Paulo Guilhardi,et al.  Measures of temporal discrimination in fixed-interval performance: A case study in archiving data , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[44]  J. Wearden,et al.  Scalar Properties in Human Timing: Conformity and Violations , 2006 .

[45]  E. Wasserman,et al.  Cyclic responding by pigeons on the peak timing procedure. , 1996, Journal of experimental psychology. Animal behavior processes.

[46]  A. Machado,et al.  Representation of time intervals in a double bisection task: Relative or absolute? , 2009, Behavioural Processes.

[47]  H. M. Jenkins,et al.  Effect of discrimination training on auditory generalization. , 1960, Journal of experimental psychology.

[48]  Armando Machado,et al.  Acquisition and extinction under periodic reinforcement , 1998, Behavioural Processes.

[49]  Wolfram Erlhagen,et al.  Learning to Time: a perspective. , 2009, Journal of the experimental analysis of behavior.

[50]  Coding in pigeons: Multiple-coding versus single-code/default strategies. , 2015, Journal of the experimental analysis of behavior.

[51]  G. S. Reynolds,et al.  A quantitative analysis of the responding maintained by interval schedules of reinforcement. , 1968, Journal of the experimental analysis of behavior.

[52]  A. Machado,et al.  Short-term memory for temporal intervals: Contrasting explanations of the choose-short effect in pigeons , 2011 .

[53]  S. Ghirlanda,et al.  A century of generalization , 2003, Animal Behaviour.

[54]  R. Church,et al.  Simultaneous temporal processing. , 1984, Journal of experimental psychology. Animal behavior processes.

[55]  M. Matell,et al.  Reinforcement probability modulates temporal memory selection and integration processes. , 2014, Acta psychologica.

[56]  Ken Cheng,et al.  Three Psychophysical Principles in the Processing of Spatial and Temporal Information , 2018, Cognitive Aspects of Stimulus Control.

[57]  Pigeons’ use of cues in a repeated five-trial-sequence, single-reversal task , 2013, Learning & behavior.

[58]  Armando Machado,et al.  Temporal discrimination in a long operant chamber , 2003, Behavioural Processes.

[59]  C. K. Ogden A Source Book Of Gestalt Psychology , 2013 .

[60]  K. Spence The nature of discrimination learning in animals. , 1936 .

[61]  D. H. Kaiser The proportion of fixed interval trials to probe trials affects acquisition of the peak procedure fixed interval timing task , 2008, Behavioural Processes.

[62]  K. Cheng The vector sum model of pigeon landmark use. , 1989 .

[63]  Peter R. Killeen,et al.  Temporal generalization accounts for response resurgence in the peak procedure , 2007, Behavioural Processes.

[64]  J. E. Weaver,et al.  Pigeons group time intervals according to their relative duration , 2004, Psychonomic bulletin & review.

[65]  W. Roberts,et al.  Pigeon (Columba livia) and rat (Rattus norvegicus) performance in the midsession reversal procedure depends upon cue dimensionality. , 2014, Journal of comparative psychology.

[66]  H. S. Pennypacker,et al.  Positive and negative generalization gradients obtained after equivalent training conditions. , 1963 .

[67]  S. Siegel,et al.  A test of the similarity rule model of temporal bisection , 1986 .

[68]  Armando Machado,et al.  Context effect in a temporal bisection task with the choice keys available during the sample , 2009, Behavioural Processes.

[69]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[70]  M. Matell,et al.  Temporal memory averaging and post-encoding alterations in temporal expectation , 2013, Behavioural Processes.

[71]  C. Lowe,et al.  Temporal control of behavior and the power law. , 1979, Journal of the experimental analysis of behavior.

[72]  Interval Timing and Time-Based Decision Making , 2012, Front. Integr. Neurosci..

[73]  J. Wearden,et al.  When to respond? And how much? Temporal control and response output on mixed-fixed-interval schedules with unequally probable components , 2008, Behavioural Processes.

[74]  A. Machado,et al.  Learning to Time (LET) or Scalar Expectancy Theory (SET)? A Critical Test of Two Models of Timing , 1999 .

[75]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[76]  T. Zentall,et al.  Simultaneous discrimination reversal learning in pigeons and humans: anticipatory and perseverative errors , 2011, Learning & behavior.

[77]  John H Wearden,et al.  Internal clock processes and the filled-duration illusion. , 2007, Journal of experimental psychology. Human perception and performance.

[78]  Ken Cheng,et al.  Small-scale spatial cognition in pigeons , 2006, Behavioural Processes.

[79]  Armando Machado,et al.  Context effects in a temporal discrimination task" further tests of the Scalar Expectancy Theory and Learning-to-Time models. , 2008, Journal of the experimental analysis of behavior.

[80]  A. Machado,et al.  On the Clarification of Concepts: A Reply to Gallistel (2007) and Lau (2007). , 2007 .

[81]  J R Platt,et al.  Bisection of temporal intervals by pigeons. , 1983, Journal of experimental psychology. Animal behavior processes.

[82]  A. Machado,et al.  The context effect as interaction of temporal generalization gradients: Testing the fundamental assumptions of the Learning-to-Time model , 2013, Behavioural Processes.

[83]  Joana Arantes,et al.  Comparison of Scalar Expectancy Theory (SET) and the Learning-to-Time (LeT) model in a successive temporal bisection task , 2008, Behavioural Processes.

[84]  J H Wearden,et al.  About Skinner and time: behavior-analytic contributions to research on animal timing. , 2006, Journal of the experimental analysis of behavior.

[85]  Jessica P. Stagner,et al.  Midsession reversals with pigeons: visual versus spatial discriminations and the intertrial interval , 2014, Learning & behavior.

[86]  W. Köhler Simple structural functions in the chimpanzee and in the chicken. , 1938 .

[87]  P. Killeen,et al.  The behavioral theory of timing: transition analyses. , 1993, Journal of the experimental analysis of behavior.

[88]  S. Roberts,et al.  Isolation of an internal clock. , 1981, Journal of experimental psychology. Animal behavior processes.

[89]  S. Cabeza de Vaca,et al.  Internal clock and memory processes in animal timing. , 1994, Journal of experimental psychology. Animal behavior processes.

[90]  Thomas R Zentall,et al.  Timing in pigeons: effects of the similarity between intertrial interval and gap in a timing signal. , 2002, Journal of experimental psychology. Animal behavior processes.

[91]  K G White,et al.  Biasing the pacemaker in the behavioral theory of timing. , 1995, Journal of the experimental analysis of behavior.

[92]  R. Church,et al.  Bisection of temporal intervals. , 1977, Journal of experimental psychology. Animal behavior processes.

[93]  T. S. Collett,et al.  Landmark learning and visuo-spatial memories in gerbils , 1986, Journal of Comparative Physiology A.

[94]  C. Lowe,et al.  Species differences in temporal control of behavior. , 1977, Journal of the experimental analysis of behavior.

[95]  K. Cheng,et al.  Memory Variance in the Peak Procedure of Timing in Pigeons , 1993 .

[96]  R. Church A concise introduction to scalar timing theory. , 2003 .

[97]  Marcia L. Spetch,et al.  Spatial peak shift and generalization in pigeons. , 1997 .

[98]  D. R. Thomas,et al.  Effects of interdimensional training on stimulus generalization. , 1966, Journal of Experimental Psychology.

[99]  J. Wearden,et al.  Why “Sounds Are Judged Longer than Lights”: Application of a Model of the Internal Clock in Humans , 1998, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[100]  A. Machado,et al.  The interaction of temporal generalization gradients predicts the context effect. , 2012, Journal of the experimental analysis of behavior.

[101]  A Machado,et al.  Shifts in the psychometric function and their implications for models of timing. , 2000, Journal of the experimental analysis of behavior.

[102]  Jonathon D. Crystal,et al.  Endogenous oscillations in short-interval timing , 2007, Behavioural Processes.

[103]  M. Matell,et al.  Averaging of temporal memories by rats. , 2009, Journal of experimental psychology. Animal behavior processes.

[104]  A. Machado Learning the temporal dynamics of behavior. , 1997, Psychological review.

[105]  J. Gibbon Origins of scalar timing , 1991 .

[106]  C R Gallistel,et al.  Flawed foundations of associationism? Comments on Machado and Silva (2007). , 2007, The American psychologist.

[107]  C. Gallistel The organization of learning , 1990 .

[108]  William P. Hetrick,et al.  Temporal processing dysfunction in schizophrenia , 2008, Brain and Cognition.

[109]  Marcia L. Spetch,et al.  A step function in pigeons’ temporal generalization in the peak shift task , 1998 .

[110]  D. Stubbs,et al.  Response bias and the discrimination of stimulus duration. , 1976, Journal of the experimental analysis of behavior.

[111]  Armando Machado,et al.  The effect of sample duration and cue on a double temporal discrimination , 2008 .

[112]  Martin Garwicz,et al.  Authenticity, Depression, and Deep Brain Stimulation , 2011, Front. Integr. Neurosci..

[113]  A. Machado,et al.  Temporal generalization gradients following an interdimensional discrimination protocol , 2016, Quarterly journal of experimental psychology.

[114]  W. Meck Selective adjustment of the speed of internal clock and memory processes. , 1983, Journal of experimental psychology. Animal behavior processes.

[115]  Ken Cheng,et al.  More psychophysics of the pigeon's use of landmarks , 2004, Journal of Comparative Physiology A.

[116]  T. Zentall,et al.  Relative judgments affect assessments of stimulus duration , 2008, Psychonomic bulletin & review.

[117]  C. Gallistel,et al.  Acquisition of peak responding: What is learned? , 2009, Behavioural Processes.

[118]  J. Wearden,et al.  The comparative psychology of fixed-interval responding: Some quantitative analyses ☆ , 1991 .

[119]  R. Church,et al.  Application of scalar timing theory to individual trials. , 1994, Journal of experimental psychology. Animal behavior processes.

[120]  K. Spence The differential response in animals to stimuli varying within a single dimension. , 1937 .

[121]  C. Wynne,et al.  Journal of the Experimental Analysis of Behavior Typical Delay Determines Waiting Time on Periodic-food Schedules: Static and Dynamic Tests , 2022 .

[122]  R M Church,et al.  Temporal generalization. , 1982, Journal of experimental psychology. Animal behavior processes.

[123]  Veronika Coltheart Concept Identification with and without Blank Trials † , 1973 .