Preference reversal and delayed reinforcement

Pigeons chose, in a two-key discrete-trial procedure, between 2- and 4-sec access to grain, with the larger amount always presented 4 sec later than the smaller. As the delay between the choice and the availability of the smaller reinforcement was varied from .01 to 12 sec, all subjects reversed preference from the small-early to the large-late reinforcement. The values of delay at which preference reversed were approximately consistent with the matching law as adapted for delayed reinforcement.

[1]  R. H. Strotz Myopia and Inconsistency in Dynamic Utility Maximization , 1955 .

[2]  K. Renner DELAYED OF REINFORCEMENT: A HISTORICAL REVIEW. , 1964, Psychological bulletin.

[3]  E. Fantino Immediate reward followed by extinction vs. later reward without extinction , 1966 .

[4]  R. Herrnstein,et al.  Choice and delay of reinforcement. , 1967, Journal of the experimental analysis of behavior.

[5]  W M Baum,et al.  Choice as time allocation. , 1969, Journal of the experimental analysis of behavior.

[6]  H. Rachlin Introduction to modern behaviorism , 1970 .

[7]  F. Logan,et al.  Relative effect of delay of food and water reward. , 1970 .

[8]  H Rachlin,et al.  Commitment, choice and self-control. , 1972, Journal of the experimental analysis of behavior.

[9]  G. Ainslie,et al.  Impulse control in pigeons. , 1974, Journal of the experimental analysis of behavior.

[10]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[11]  Edmund Fantino,et al.  Self-control and general models of choice. , 1976 .

[12]  J. E. Mazur,et al.  Choice in a "self-control" paradigm: effects of a fading procedure. , 1978, Journal of the experimental analysis of behavior.

[13]  Drazen Prelec,et al.  Feedback functions for reinforcement: A paradigmatic experiment , 1978 .

[14]  M. Z. Deluty,et al.  Self-control and impulsiveness involving aversive events. , 1978 .

[15]  E. Fantino,et al.  Effects on choice of reinforcement delay and conditioned reinforcement. , 1978, Journal of the experimental analysis of behavior.

[16]  David A. Eckerman,et al.  An experimental analysis of impulsivity and impulse control in humans. , 1980 .

[17]  C. M. Bradshaw,et al.  Quantification of Steady-State Operant Behavior , 1982 .