Learning the temporal dynamics of behavior.

This study presents a dynamic model of how animals learn to regulate their behavior under time-based reinforcement schedules. The model assumes a serial activation of behavioral states during the interreinforcement interval, an associative process linking the states with the operant response, and a rule mapping the activation of the states and their associative strength onto response rate or probability. The model fits data sets from fixed-interval schedules, the peak procedure, mixed fixed-interval schedules, and the bisection of temporal intervals. The major difficulties of the model came from experiments that suggest that under some conditions animals may time 2 intervals independently and simultaneously.

[1]  B. Skinner,et al.  Are theories of learning necessary? , 2013, Psychological review.

[2]  A. Stubbs.  The discrimination of stimulus duration by pigeons. , 1968, Journal of the experimental analysis of behavior.

[3]  G. S. Reynolds,et al.  A quantitative analysis of the responding maintained by interval schedules of reinforcement. , 1968, Journal of the experimental analysis of behavior.

[4]  B A Schneider,et al.  A two-state analysis of fixed-interval responding in the pigeon. , 1969, Journal of the experimental analysis of behavior.

[5]  James G. Greeno,et al.  Introduction to mathematical psychology , 1970 .

[6]  J. Falk.  The nature and determinants of adjunctive behavior. , 1971, Physiology & behavior.

[7]  J. Staddon,et al.  The "supersitition" experiment: A reexamination of its implications for the principles of adaptive behavior. , 1971 .

[8]  M. Sachs.  Objective Knowledge , 1974 .

[9]  N. Mackintosh.  The psychology of animal learning , 1974 .

[10]  R. Church,et al.  Bisection of temporal intervals. , 1977, Journal of experimental psychology. Animal behavior processes.

[11]  J. Gibbon.  Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[12]  Arousal: its genesis and manifestation as response rate. , 1978, Psychological review.

[13]  J. Myerson,et al.  The kinetics of choice: An operant systems analysis. , 1980 .

[14]  J. Gibbon.  On the form and location of the Psychometric Bisection Function for time , 1981 .

[15]  S. Roberts,et al.  Isolation of an internal clock. , 1981, Journal of experimental psychology. Animal behavior processes.

[16]  S. Hanson,et al.  Measurement and modeling of behavior under fixed-interval schedules of reinforcement. , 1981 .

[17]  J R Platt,et al.  Bisection of temporal intervals by pigeons. , 1983, Journal of experimental psychology. Animal behavior processes.

[18]  P.N.J. Mackintosh.  Adaptive Behavior and Learning, J.E.R. Staddon. Cambridge University Press, Cambridge (1984), xiii, +555. Price £30.00 hardback, £10.95 paperback , 1984 .

[19]  J. Gibbon,et al.  Timing and time perception. , 1984, Annals of the New York Academy of Sciences.

[20]  M D Zeiler,et al.  Pure timing in temporal differentiation. , 1985, Journal of the experimental analysis of behavior.

[21]  G A Lucas,et al.  The basis of superstitious behavior: chance contingency, stimulus substitution, or appetitive behavior? , 1985, Journal of the experimental analysis of behavior.

[22]  T. J. Matthews,et al.  Behavior patterns in pigeons during autoshaping with an incremental conditioned stimulus , 1987 .

[23]  J. Staddon,et al.  Probabilistic choice: A simple invariance , 1987, Behavioural Processes.

[24]  P. Killeen,et al.  A behavioral theory of timing. , 1988, Psychological review.

[25]  John A. Nevin,et al.  Behavioral momentum and the partial reinforcement effect , 1988 .

[26]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[27]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[28]  W A Roberts,et al.  Timing light and tone signals in pigeons. , 1989, Journal of experimental psychology. Animal behavior processes.

[29]  R. Church,et al.  Alternative representations of time, number, and rate , 1990, Cognition.

[30]  Peter R. Killeen,et al.  Adjusting the pacemaker , 1991 .

[31]  Dynamics of time discrimination. , 1991, Journal of experimental psychology. Animal behavior processes.

[32]  Dynamics of time discrimination. , 1991, Journal of experimental psychology. Animal behavior processes.

[33]  Peter R. Killeen,et al.  Behavior's Time , 1991 .

[34]  永福 智志.  The Organization of Learning , 2005, Journal of Cognitive Neuroscience.

[35]  K. Cheng,et al.  Three psychophysical principles of timing in pigeons , 1991 .

[36]  John Gibbon,et al.  Ubiquity of scalar timing with Poisson clock , 1992 .

[37]  Peter R. Killeen,et al.  Changing rates of reinforcement perturbs the flow of time , 1993, Behavioural Processes.

[38]  D. G. Davis,et al.  The process of recurrent choice. , 1993, Psychological review.

[39]  P. Killeen.  Mathematical principles of reinforcement , 1994 .

[40]  L. Bizo,et al.  The behavioral theory of timing: Reinforcer rate determines pacemaker rate. , 1994, Journal of the experimental analysis of behavior.

[41]  R. Church,et al.  Application of scalar timing theory to individual trials. , 1994, Journal of experimental psychology. Animal behavior processes.

[42]  W. Estes.  Toward a Statistical Theory of Learning. , 1994 .

[43]  W. Timberlake.  Behavior systems, associationism, and Pavlovian conditioning , 1994, Psychonomic bulletin & review.

[44]  M. Zeiler,et al.  Temporal control in fixed-interval schedules. , 1994, Journal of the experimental analysis of behavior.

[45]  J. Gibbon,et al.  Simultaneous timing of multiple intervals: implications of the scalar property. , 1995, Journal of experimental psychology. Animal behavior processes.

[46]  B. Roche,et al.  The Behavior of Organisms? , 1997 .