Adjusting delay to reinforcement: comparing choice in pigeons and humans.

Indifference functions of amount and delay of reinforcement were compared for pigeon and human subjects by using Mazur's (1987) adjusting delay procedure. A model similar to the matching law (the simple reciprocal model), a hyperbolic model, three modified versions of the hyperbolic model, and a negative exponential model were evaluated. In Experiment 1 the subjects were pigeons, and in Experiments 2 and 3 the subjects were humans. In order to make the nonhuman and human situations more comparable, in Experiments 2 and 3 the reinforcer (points exchangeable for money) was discounted at a constant rate during the delay periods. The rate of this discounting varied between Experiments 2 and 3. The results of all three experiments demonstrated that a power function transformation of the hyperbolic model (in which 1 is added to the delays in the denominator of the simple reciprocal model) provided the best description of both nonhuman and human data.

[1]  B. Skinner,et al.  Principles of Behavior , 1944 .

[2]  N H Azrin,et al.  Some Effects of Noise on Human Behavior. , 1958, Journal of the experimental analysis of behavior.

[3]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[4]  S. H. Chung,et al.  Effects of delayed reinforcement in a concurrent situation. , 1965, Journal of the experimental analysis of behavior.

[5]  F A LOGAN,et al.  DECISION MAKING BY RATS: DELAY VERSUS AMOUNT OF REWARD. , 1965, Journal of comparative and physiological psychology.

[6]  Arnold Kaufman,et al.  SOME EFFECTS OF INSTRUCTIONS ON HUMAN OPERANT BEHAVIOR. , 1966 .

[7]  W M Baum,et al.  Choice as time allocation. , 1969, Journal of the experimental analysis of behavior.

[8]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[9]  Effects of relative reinforcer duration on concurrent response rates , 1971 .

[10]  H Rachlin,et al.  Commitment, choice and self-control. , 1972, Journal of the experimental analysis of behavior.

[11]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[12]  J C Todorov,et al.  Interaction of frequency and magnitude of reinforcement on concurrent performances. , 1973, Journal of the experimental analysis of behavior.

[13]  J. W. Schneider Reinforcer effectiveness as a function of reinforcer rate and magnitude: a comparison of concurrent performances. , 1973, Journal of the experimental analysis of behavior.

[14]  D R Schmitt Effects of reinforcement rate and reinforcer magnitude on choice behavior of humans. , 1974, Journal of the experimental analysis of behavior.

[15]  W M Baum,et al.  On two types of deviation from the matching law: bias and undermatching. , 1974, Journal of the experimental analysis of behavior.

[16]  R J Herrnstein,et al.  Formal properties of the matching law. , 1974, Journal of the experimental analysis of behavior.

[17]  G. Ainslie,et al.  Impulse control in pigeons. , 1974, Journal of the experimental analysis of behavior.

[18]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[19]  C. Bradshaw,et al.  Behavior of humans in variable-interval schedules of reinforcement. , 1976, Journal of the experimental analysis of behavior.

[20]  B. A. Matthews,et al.  Uninstructed human responding: sensitivity to ratio and interval contingencies. , 1977, Journal of the experimental analysis of behavior.

[21]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[22]  W. K. Honig,et al.  Handbook of Operant Behavior , 2022 .

[23]  J. E. Mazur,et al.  Choice in a "self-control" paradigm: effects of a fading procedure. , 1978, Journal of the experimental analysis of behavior.

[24]  Human Concurrent Performances: Variation of Reinforcer Magnitude and Rate of Reinforcement , 1979 .

[25]  M. Zeiler,et al.  Reinforcement and the organization of behaviour , 1979 .

[26]  M Galizio,et al.  Contingency-shaped and rule-governed behavior: instructional control of human loss avoidance. , 1979, Journal of the experimental analysis of behavior.

[27]  E Szabadi,et al.  The effect of signaled reinforcement availability on concurrent performances in humans. , 1979, Journal of the experimental analysis of behavior.

[28]  Gene M. Heyman,et al.  Human neuropsychology: Some differences between korsakoff and normal operant performance , 1980, Psychological research.

[29]  L Green,et al.  Journal of the Experimental Analysis of Behavior Choice between Rewards Differing in Amount and Delay: toward a Choice Model of Self Control , 2022 .

[30]  L. Green,et al.  Preference reversal and self control: choice as a function of reward amount and delay , 1981 .

[31]  T. Foster,et al.  Performance of humans in concurrent avoidance/positive-reinforcement schedules. , 1982, Journal of the experimental analysis of behavior.

[32]  C. M. Bradshaw,et al.  Quantification of Steady-State Operant Behavior , 1982 .

[33]  Masato Ito,et al.  Choice behavior of rats in a concurrent-chains schedule: Amount and delay of reinforcement. , 1982, Journal of the experimental analysis of behavior.

[34]  W. Dixon,et al.  BMDP statistical software , 1983 .

[35]  A W Logue,et al.  Choice in a self-control paradigm: Quantification of experience-based differences. , 1984, Journal of the experimental analysis of behavior.

[36]  J. J. McDowell,et al.  Confirmation of linear system theory prediction: Rate of change of Herrnstein's kappa as a function of response-force requirement. , 1985, Journal of the experimental analysis of behavior.

[37]  Leonard Green,et al.  Undermatching in humans to amount of reinforcement , 1985, Behavioural Processes.

[38]  A. Logue,et al.  Self-control in adult humans: variation in positive reinforcer amount and delay. , 1986, Journal of the experimental analysis of behavior.

[39]  Monica L. Rodriguez,et al.  Independence of the amount and delay ratios in the generalized matching law , 1986 .

[40]  Alexandra W. Logue,et al.  Effect on choice of absolute and relative values of reinforcer delay, amount, and frequency. , 1987 .

[41]  J. E. Mazur An adjusting procedure for studying delayed reinforcement. , 1987 .