Generalizing from the Past, Choosing the Future

Behavior in the present depends critically on experience in similar environments in the past. Such past experience may be important in controlling behavior not because it determines the strength of a behavior, but because it allows the structure of the current environment to be detected and used. We explore a prospective-control approach to understanding simple behavior. Under this approach, order in the environment allows even simple organisms to use their personal past to respond according to the likely future. The predicted future controls behavior, and past experience forms the building blocks of the predicted future. We explore how generalization affects the use of past experience to predict and respond to the future. First, we consider how generalization across various dimensions of an event determines the degree to which the structure of the environment exerts control over behavior. Next, we explore generalization from the past to the present as the method of deciding when, where, and what to do. This prospective-control approach is measurable and testable; it builds predictions from events that have already occurred, and assumes no agency. Under this prospective-control approach, generalization is fundamental to understanding both adaptive and maladaptive behavior.

[1]  T. Shahan Moving Beyond Reinforcement and Response Strength , 2017, The Behavior Analyst.

[2]  Valentin Dragoi,et al.  Population coding of strategic variables during foraging in freely-moving macaques , 2019, bioRxiv.

[3]  M Davison,et al.  Performance On Concurrent Variable-interval Extinction Schedules. , 1998, Journal of the experimental analysis of behavior.

[4]  M. Davison,et al.  Reinforcement: food signals the time and location of future food. , 2011, Journal of the experimental analysis of behavior.

[5]  M. Davison,et al.  Concurrent-schedule performance in transition: changeover delays and signaled reinforcer ratios. , 2003, Journal of the experimental analysis of behavior.

[6]  L. Bizo,et al.  The behavioral theory of timing: Reinforcer rate determines pacemaker rate. , 1994, Journal of the experimental analysis of behavior.

[7]  D. Stubbs Temporal discrimination and a free-operant psychophysical procedure. , 1980, Journal of the experimental analysis of behavior.

[8]  M. Davison,et al.  Being there on time: Reinforcer effects on timing and locating. , 2020, Journal of the experimental analysis of behavior.

[9]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[10]  M. Davison,et al.  Control by reinforcers across time and space: A review of recent choice research. , 2016, Journal of the experimental analysis of behavior.

[11]  C. Branch,et al.  What-Where-When Memory in the Rodent Odor Span Task. , 2014, Learning and motivation.

[12]  O. Lazareva,et al.  Relational learning in a context of transposition: a review. , 2012, Journal of the experimental analysis of behavior.

[13]  M. Davison,et al.  Concurrent schedules: discriminating reinforcer-ratio reversals at a fixed time after the previous reinforcer. , 2013, Journal of the experimental analysis of behavior.

[14]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[15]  Christopher A. Podlesnik,et al.  Quantitative analysis of local-level resurgence , 2017, Learning & behavior.

[16]  M. Davison,et al.  Do conditional reinforcers count? , 2006, Journal of the experimental analysis of behavior.

[17]  E. Wasserman,et al.  A three-component model of relational responding in the transposition paradigm. , 2014, Journal of experimental psychology. Animal learning and cognition.

[18]  Christopher A. Podlesnik,et al.  Training reinforcement rates, resistance to extinction, and the role of context in reinstatement , 2016, Learning & behavior.

[19]  J. Nevin,et al.  Stimuli, reinforcers, and behavior: an integration. , 1999, Journal of the experimental analysis of behavior.

[20]  B. Skinner,et al.  The Behavior of Organisms: An Experimental Analysis , 2016 .

[21]  M. Davison,et al.  Timing or Counting? Control by Contingency Reversals at Fixed Times or Numbers of Responses , 2019, Journal of experimental psychology. Animal learning and cognition.

[22]  C. L. Hull Differential habituation to internal stimuli in the albino rat. , 1933 .

[23]  Numerical reproduction in pigeons. , 2007, Journal of experimental psychology. Animal behavior processes.

[24]  Christian U. Krägeloh,et al.  Local preference in concurrent schedules: the effects of reinforcer sequences. , 2005, Journal of the experimental analysis of behavior.

[25]  Rebecca A. Sharp,et al.  Lounge Layout to Facilitate Communication and Engagement in People with Dementia , 2019, Behavior analysis in practice.

[26]  S. Cowie Some weaknesses of a response-strength account of reinforcer effects , 2020, European Journal of Behavior Analysis.

[27]  Kenneth W. Jacobs,et al.  Coal Is Not Black, Snow Is Not White, Food Is Not a Reinforcer: The Roles of Affordances and Dispositions in the Analysis of Behavior , 2016, The Behavior Analyst.

[28]  D. Blough Steady state data and a quantitative model of operant generalization and discrimination. , 1975 .

[29]  Sarah Cowie,et al.  Behavioral Time Travel: Control by Past, Present, and Potential Events , 2018 .

[30]  J A Nevin,et al.  The analysis of behavioral momentum. , 1983, Journal of the experimental analysis of behavior.

[31]  M. Davison,et al.  Control by past and present stimuli depends on the discriminated reinforcer differential. , 2017, Journal of the experimental analysis of behavior.

[32]  M. Bouton,et al.  Context change explains resurgence after the extinction of operant behavior. , 2015, Revista mexicana de analisis de la conducta = Mexican journal of behavior analysis.

[33]  K. Spence The differential response in animals to stimuli varying within a single dimension. , 1937 .

[34]  M. Bouton,et al.  Renewal after the extinction of free operant behavior , 2011, Learning & behavior.

[35]  A. Odum,et al.  Effects of prefeeding, intercomponent-interval food, and extinction on temporal discrimination and pacemaker rate , 2006, Behavioural Processes.

[36]  Lewis A. Bizo,et al.  Reinforcement context and pacemaker rate in the behavioral theory of timing , 1995 .

[37]  W. Estes An experimental study of punishment. , 1944 .

[38]  R. Bolles,et al.  Contextual control of the extinction of conditioned fear , 1979 .

[39]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[40]  W M Baum,et al.  On two types of deviation from the matching law: bias and undermatching. , 1974, Journal of the experimental analysis of behavior.

[41]  R. L. Reid The role of the reinforcer as a stimulus. , 1958, British journal of psychology.

[42]  M. Davison,et al.  A model for discriminating reinforcers in time and space , 2016, Behavioural Processes.

[43]  Christopher A. Podlesnik,et al.  Stimulus generalization and operant context renewal , 2015, Behavioural Processes.

[44]  Choice, time and food: continuous cyclical changes in food probability between reinforcers. , 2014, Journal of the experimental analysis of behavior.

[45]  J. Nevin,et al.  Behavioral momentum and the Law of Effect , 2000, Behavioral and Brain Sciences.

[46]  W. Baum Rethinking reinforcement: allocation, induction, and contingency. , 2012, Journal of the experimental analysis of behavior.

[47]  D. Elliffe,et al.  Generalization of response patterns in a multiple peak procedure , 2018, Behavioural Processes.

[48]  T. Shahan Conditioned reinforcement and response strength. , 2010, Journal of the experimental analysis of behavior.

[49]  D S Blough,et al.  Recognition by the pigeon of stimuli varying in two dimensions. , 1972, Journal of the experimental analysis of behavior.

[50]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[51]  T. Zentall,et al.  Simultaneous discrimination reversal learning in pigeons and humans: anticipatory and perseverative errors , 2011, Learning & behavior.

[52]  D McCarthy,et al.  Effects of mild hypoxia on perceptual-motor performance: a signal-detection approach. , 1995, Ergonomics.

[53]  M. Galizio,et al.  The Magic Number 70 (plus or minus 20): Variables Determining Performance in the Rodent Odor Span Task. , 2013, Learning and motivation.

[55]  J. Wearden,et al.  Scalar Properties in Human Timing: Conformity and Violations , 2006 .

[56]  Jessica P. Stagner,et al.  Episodic-like memory: Pigeons can report location pecked when unexpectedly asked , 2008, Behavioural Processes.

[57]  M. Davison,et al.  A model for food and stimulus changes that signal time-based contingency changes. , 2014, Journal of the experimental analysis of behavior.

[58]  The differentiation of response numerosities in the pigeon. , 2007, Journal of the experimental analysis of behavior.

[59]  R. Leeper The Rôle of Motivation in Learning: A Study of the Phenomenon of Differential Motivational Control of the Utilization of Habits , 1935 .

[60]  J. Rosales-Ruiz,et al.  The power of one reinforcer: The effect of a single reinforcer in the context of shaping. , 2019, Journal of the experimental analysis of behavior.