Unification of models for choice between delayed reinforcers.

Two models for choice between delayed reinforcers, Fantino's delay-reduction theory and Killeen's incentive theory, are reviewed. Incentive theory is amended to incorporate the effects of arousal on alternate types of behavior that might block the reinforcement of the target behavior. This amended version is shown to differ from the delay-reduction theory in a term that is an exponential in incentive theory and a difference in delay-reduction theory. A power series approximation to the exponential generates a model that is formally identical with delay-reduction theory. Correlations between delay-reduction theory and the amended incentive theory show excellent congruence over a range of experimental conditions. Although the assumptions that gave rise to delay-reduction theory and incentive theory remain different and testable, the models deriving from the theories are unlikely to be discriminable by parametric experimental tests. This congruence of the models is recognized by naming the common model the delayed reinforcement model, which is then compared with other models of choice such as Killeen and Fetterman's (1988) behavioral theory of timing, Mazur's (1984) equivalence rule, and Vaughan's (1985) melioration theory.

[1]  R. Herrnstein SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. , 1964, Journal of the experimental analysis of behavior.

[2]  S. H. Chung,et al.  Effects of delayed reinforcement in a concurrent situation. , 1965, Journal of the experimental analysis of behavior.

[3]  R. Herrnstein,et al.  Choice and delay of reinforcement. , 1967, Journal of the experimental analysis of behavior.

[4]  P. Killeen On the measurement of reinforcement frequency in the study of preference. , 1968, Journal of the experimental analysis of behavior.

[5]  E. Fantino Choice and rate of reinforcement. , 1969, Journal of the experimental analysis of behavior.

[6]  M. Davison Preference for mixed-interval versus fixed-interval schedules. , 1969, Journal of the experimental analysis of behavior.

[7]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[8]  P. Killeen Preference for fixed-interval schedules of reinforcement. , 1970, Journal of the experimental analysis of behavior.

[9]  Edmund Fantino,et al.  CHOICE FOR PERIODIC SCHEDULES OF REINFORCEMENT1 , 1970 .

[10]  N Squires,et al.  A model for choice in simple concurrent and concurrent-chains schedules. , 1971, Journal of the experimental analysis of behavior.

[11]  D Macewen,et al.  The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules. , 1972, Journal of the experimental analysis of behavior.

[12]  M C Davison,et al.  Preference for fixed-interval schedules: an alternative model. , 1973, Journal of the experimental analysis of behavior.

[13]  E Fantino,et al.  Relative delay of reinforcement and choice. , 1973, Journal of the experimental analysis of behavior.

[14]  P. Killeen On the temporal control of behavior. , 1975 .

[15]  Edmund Fantino,et al.  Self-control and general models of choice. , 1976 .

[16]  R. Cicerone,et al.  Preference for mixed versus constant delay of reinforcement. , 1976, Journal of the experimental analysis of behavior.

[17]  R. Luce,et al.  The Choice Axiom after Twenty Years , 1977 .

[18]  S. Hanson,et al.  Arousal: its genesis and manifestation as response rate. , 1978, Psychological review.

[19]  E. Fantino,et al.  Effects on choice of reinforcement delay and conditioned reinforcement. , 1978, Journal of the experimental analysis of behavior.

[20]  S R Hursh,et al.  Economic concepts for the analysis of behavior. , 1980, Journal of the experimental analysis of behavior.

[21]  R. Herrnstein,et al.  CHAPTER 5 – Melioration and Behavioral Allocation1 , 1980 .

[22]  M. Marr,et al.  Choice and reinforcement delay. , 1980, Journal of the experimental analysis of behavior.

[23]  E. Fantino,et al.  The delay-reduction hypothesis of conditioned reinforcement and punishment: Observing behavior. , 1981, Journal of the experimental analysis of behavior.

[24]  Masato Ito,et al.  Choice behavior of rats in a concurrent-chains schedule: Amount and delay of reinforcement. , 1982, Journal of the experimental analysis of behavior.

[25]  E. Fantino,et al.  Choice and the relative immediacy of reinforcement. , 1982, Journal of the experimental analysis of behavior.

[26]  P R Killeen,et al.  Incentive theory: II. Models for choice. , 1982, Journal of the experimental analysis of behavior.

[27]  E Fantino,et al.  Choice and foraging. , 1982, Journal of the experimental analysis of behavior.

[28]  Edmund Fantino,et al.  The delay-reduction hypothesis: Extension to three-alternative choice. , 1983 .

[29]  E Fantino,et al.  Choice: Some quantitative relations. , 1983, Journal of the experimental analysis of behavior.

[30]  E. Fantino,et al.  Human observing: Maintained by stimuli correlated with reinforcement but not extinction. , 1983, Journal of the experimental analysis of behavior.

[31]  P. Killeen,et al.  Perception of Contingency in Conditioning: Scalar Timing, Response Bias, and Erasure of Memory by Reinforcement , 1984 .

[32]  J. E. Mazur Tests of an equivalence rule for fixed and variable reinforcer delays. , 1984 .

[33]  E. Fantino,et al.  Choice, optimal foraging, and the delay-reduction hypothesis , 1985, Behavioral and Brain Sciences.

[34]  P. Killeen Delay reduction: A field guide for optimal foragers? , 1985, Behavioral and Brain Sciences.

[35]  W. Vaughan Choice: A local analysis. , 1985, Journal of the experimental analysis of behavior.

[36]  J. Staddon,et al.  Probabilistic choice: A simple invariance , 1987, Behavioural Processes.

[37]  R. Dunn,et al.  Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement. , 1987, Journal of the experimental analysis of behavior.

[38]  A. Catania,et al.  Reinforcement schedules: Retroactive and proactive effects of reinforcers inserted into fixed-interval performances. , 1988, Journal of the experimental analysis of behavior.

[39]  J Myerson,et al.  Choice in transition: A comparison of melioration and the kinetic model. , 1988, Journal of the experimental analysis of behavior.

[40]  J E Staddon,et al.  Quasi-dynamic choice models: Melioration and ratio invariance. , 1988, Journal of the experimental analysis of behavior.

[41]  R. A. Preston,et al.  Choice and foraging: the effects of accessibility on acceptability. , 1988, Journal of the experimental analysis of behavior.

[42]  P. Killeen,et al.  A behavioral theory of timing , 1988 .

[43]  E. Fantino,et al.  Responding on concurrent-chains schedules in open and closed economies. , 1989, Journal of the experimental analysis of behavior.

[44]  J T Wixted,et al.  Journal of the Experimental Analysis of Behavior Nonhuman Short-te4?m Memory: a Quantitative Reanalysis of Selected Findings , 2022 .