A modular theory of learning and performance

We describe a theory to account for the acquisition and extinction of response rate (conditioning) and pattern (timing). This modular theory is a development of packet theory (Kirkpatrick, 2002; Kirkpatrick & Church, 2003) that adds a distinction between pattern and strength memories, as well as contributing closed-form equations. We describe the theory using equations related to a flow diagram and illustrate it by an application to an experiment with repeated acquisitions and extinctions of a multiple-cued-interval procedure using rats. The parameter estimates for the theory were based on a calibration sample from the data, and the predictions for different measures of performance on a validation sample from the same data (cross-validation). The theory’s predictions were similar to predictions based on the reliability of the behavior.

[1]  C. L. Hull.  Principles of behavior : an introduction to behavior theory , 1943 .

[2]  H. Harlow,et al.  The formation of learning sets. , 1949, Psychological review.

[3]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[4]  D S BLOUGH,et al.  Dark adaptation in the pigeon. , 1956, Journal of comparative and physiological psychology.

[5]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[6]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[7]  R J Herrnstein,et al.  Formal properties of the matching law. , 1974, Journal of the experimental analysis of behavior.

[8]  J. Gibbon.  Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[9]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[10]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[11]  R. Church,et al.  Simultaneous temporal processing. , 1984, Journal of experimental psychology. Animal behavior processes.

[12]  M. Davison,et al.  The matching law: A research review. , 1988 .

[13]  Thomas A. Tatham,et al.  The MED-PC experimental apparatus programming system , 1989 .

[14]  Mark M. Meerschaert,et al.  Mathematical Modeling , 2014, Encyclopedia of Social Network Analysis and Mining.

[15]  J. Gibbon,et al.  Simultaneous timing of multiple intervals: implications of the scalar property. , 1995, Journal of experimental psychology. Animal behavior processes.

[16]  A. Machado.  Learning the temporal dynamics of behavior. , 1997, Psychological review.

[17]  Sebastian Thrun,et al.  Learning to Learn , 1998, Springer US.

[18]  David L. Allen,et al.  A parsimonious alternative to the pacemaker/accumulator process in animal timing , 1998, Behavioural Processes.

[19]  J. Gibbon,et al.  Temporal control during maintenance and extinction of conditioned keypecking in ring doves , 1999 .

[20]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[21]  S. Klein,et al.  Handbook of contemporary learning theories , 2000 .

[22]  I. J. Myung,et al.  The Importance of Complexity in Model Selection. , 2000, Journal of mathematical psychology.

[23]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[24]  Jonathon D Crystal,et al.  Nonlinear time perception , 2001, Behavioural Processes.

[25]  A. Neuringer.  Operant variability: Evidence, functions, and theory , 2002, Psychonomic bulletin & review.

[26]  H. Pashler.  STEVENS' HANDBOOK OF EXPERIMENTAL PSYCHOLOGY , 2002 .

[27]  Mark A. Pitt,et al.  Toward a method of selecting among computational models of cognition. , 2002 .

[28]  Kimberly S. Kirkpatrick,et al.  Packet theory of conditioning and timing , 2002, Behavioural Processes.

[29]  R. Rescorla.  Comparison of the rates of associative change during acquisition and extinction. , 2002, Journal of experimental psychology. Animal behavior processes.

[30]  Data archiving for animal cognition research: Report of an NIMH workshop , 2002, Animal learning & behavior.

[31]  Kimberly S. Kirkpatrick,et al.  Tracking of the expected time to reinforcement in temporal conditioning procedures , 2003, Learning & behavior.

[32]  Jonathan Vaughan,et al.  A Web-Based Archive of Norms, Stimuli, and Data , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[33]  Paulo Guilhardi,et al.  Measures of temporal discrimination in fixed-interval performance: A case study in archiving data , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[34]  P. Balsam,et al.  Temporal specificity of extinction in autoshaping. , 2004, Journal of experimental psychology. Animal behavior processes.

[35]  Russell M. Church,et al.  A Turing test of a timing theory , 2005, Behavioural Processes.

[36]  R. Church,et al.  Dynamics of temporal discrimination , 2005, Learning & behavior.

[37]  R. Church,et al.  How rats combine temporal cues , 2005, Behavioural Processes.

[38]  R. Church,et al.  Effects of repeated acquisitions and extinctions on response rate and pattern. , 2006, Journal of experimental psychology. Animal behavior processes.

[39]  M. Yamaguchi.  Complete solution of the Rescorla–Wagner model for relative validity , 2006, Behavioural Processes.

[40]  R. Church,et al.  The pattern of responding after extensive extinction , 2006, Learning & behavior.