Conditioned Reinforcement: Experimental and Theoretical Issues

The concept of conditioned reinforcement has received decreased attention in learning textbooks over the past decade, in part because of criticisms of its validity by major behavior theorists and in part because its explanatory function in a variety of different conditioning procedures has become uncertain. Critical data from the major procedures that have been used to investigate the concept (second-order schedules, chain schedules, concurrent chains, observing responses, delay-of-reinforcement procedures) are reviewed, along with the major issues of interpretation. Although the role played by conditioned reinforcement in some procedures remains unresolved, the results taken together leave little doubt that the underlying idea of conditioned value is a critical component of behavior theory that is necessary to explain many different types of data. Other processes (marking, bridging) may also operate to produce effects similar to those of conditioned reinforcement, but these clearly cannot explain the full domain of experimental effects ascribed to conditioned reinforcement and should be regarded as complements to the concept rather than theoretical competitors. Examples of practical and theoretical applications of the concept of conditioned reinforcement are also considered.

[1]  J. E. Mazur Predicting the Strength of a Conditioned Reinforcer: Effects of Delay and Uncertainty , 1993 .

[2]  M N Branch,et al.  Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement. , 1988, Journal of the experimental analysis of behavior.

[3]  P. Balsam,et al.  The negative side effects of reward. , 1983, Journal of applied behavior analysis.

[4]  C. B. Ferster An Experimental Analysis of Clinical Phenomena , 1972 .

[5]  B. Williams,et al.  Conditioned reinforcement versus time to reinforcement in chain schedules. , 1990, Journal of the experimental analysis of behavior.

[6]  G. Grice The relation of secondary reinforcement to delayed reward in visual discrimination learning. , 1948, Journal of experimental psychology.

[7]  G. Kimble,et al.  Hilgard and Marquis' Conditioning and learning , 1961 .

[8]  B. Skinner,et al.  Science and human behavior , 1953 .

[9]  H. Rachlin Behavior and learning , 1976 .

[10]  R. W. Richards,et al.  A comparison of signaled and unsignaled delay of reinforcement. , 1981, Journal of the experimental analysis of behavior.

[11]  R. M. Elliott,et al.  Behavior of Organisms , 1991 .

[12]  Edmund Fantino,et al.  The delay-reduction hypothesis: Extension to three-alternative choice. , 1983 .

[13]  L. Baptista,et al.  Song development in the white-crowned sparrow: social factors and sex differences , 1986, Animal Behaviour.

[14]  R. Rescorla Effect of a stimulus intervening between CS and US in autoshaping. , 1982, Journal of experimental psychology. Animal behavior processes.

[15]  A. Neuringer,et al.  Response sequence learning as a function of primary versus conditioned reinforcement , 1988 .

[16]  J. Kagel,et al.  Maximization theory in behavioral psychology , 1981, Behavioral and Brain Sciences.

[17]  Effects of delayed conditioned reinforcement in chain schedules. , 1987, Journal of the experimental analysis of behavior.

[18]  E. L. Wike,et al.  Secondary reinforcement : selected experiments , 1966 .

[19]  D. A. Lieberman,et al.  Marking in pigeons: The role of memory in delayed reinforcement. , 1985 .

[20]  T. S. Hyde The effect of Pavlovian stimuli on the acquisition of a new response , 1976 .

[21]  A. Neuringer,et al.  Animals Respond for Food in the Presence of Free Food , 1969, Science.

[22]  H. B. Daly Preference for unpredictable food rewards occurs with high proportion of reinforced trials or alcohol if rewards are not delayed. , 1989, Journal of experimental psychology. Animal behavior processes.

[23]  L. Gollub,et al.  INFORMATION ON CONDITIONED REINFORCEMENT , 1970 .

[24]  B. Williams Partial reinforcement effects on discrimination learning , 1989 .

[25]  Patricia B. Cronin Reinstatement of postresponse stimuli prior to reward in delayed-reward discrimination learning by pigeons , 1980 .

[26]  Studies of instrumental behavior with sexual reinforcement in male rats (Rattus norvegicus): I. Control by brief visual stimuli paired with a receptive female. , 1987 .

[27]  C. C. Perkins,et al.  Stimulus duration and conditioned reinforcing value measured by a learning-tests procedure , 1985 .

[28]  Michael Davison The matching law , 1987 .

[29]  Garry L. Martin,et al.  Behavior Modification: What it is and how to do it , 2019, Psychology Teaching Review.

[30]  A. Neuringer,et al.  Learning by Following a Food Source , 1974, Science.

[31]  Facilitation of responding in a filled-delay trace autoshaping procedure: An occasion-setting hypothesis , 1989 .

[32]  E Fantino,et al.  Journal of the Experimental Analysis of Behavior Human Obser Ving: Maintained by Nega Tive Informative Stimuli Only If Correlated with Improvement in Response Efficiency , 2022 .

[33]  Wyckoff Lb The role of observing responses in discrimination learning. Part I. , 1952 .

[34]  Jonathan Katz,et al.  A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys. , 1979, Journal of The Experimental Analysis of Behavior.

[35]  J. Dinsmoor Observing and conditioned reinforcement , 1983, Behavioral and Brain Sciences.

[36]  Abram Amsel Frustration theory: Contents , 1992 .

[37]  B A Williams,et al.  Preference for conditioned reinforcement. , 1991, Journal of the experimental analysis of behavior.

[38]  P. Killeen On the measurement of reinforcement frequency in the study of preference. , 1968, Journal of the experimental analysis of behavior.

[39]  R. T. Kelleher CONDITIONED REINFORCEMENT IN SECOND‐ORDER SCHEDULES1 , 1966 .

[40]  Alan E. Kazdin The Token Economy , 1977 .

[41]  R. Herrnstein,et al.  Food-avoidance in hungry pigeons, and other perplexities. , 1972, Journal of the experimental analysis of behavior.

[42]  L. Baptista,et al.  Social interaction, sensitive phases and the song template hypothesis in the white-crowned sparrow , 1984, Animal Behaviour.

[43]  R. Klein Intermittent primary reinforcement as a parameter of secondary reinforcement. , 1959, Journal of experimental psychology.

[44]  H. Hoffman,et al.  A reinforcement model of imprinting: Implications for socialization in monkeys and men. , 1973 .

[45]  B. Williams Marking and bridging versus conditioned reinforcement , 1991 .

[46]  J. E. Mazur Choice between single and multiple delayed reinforcers. , 1986, Journal of the experimental analysis of behavior.

[47]  N. Mann,et al.  The influence of visual stimuli on song tutor choice in the zebra finch, Taeniopygia guttata , 1991, Animal Behaviour.

[48]  R. Shull,et al.  Delay and number of food reinforcers: Effects on choice and latencies. , 1990, Journal of the experimental analysis of behavior.

[49]  R. Bugelski Extinction with and without sub-goal reinforcement. , 1938 .

[50]  P. Kop Reinforcement, choice and response strength , 1990 .

[51]  A. Amsel Frustration Theory: An Analysis of Dispositional Learning and Memory , 1992 .

[52]  R. Shull,et al.  Delay or rate of food delivery as determiners of response rate. , 1981, Journal of the experimental analysis of behavior.

[53]  R. Dunn,et al.  Substitutability between conditioned and primary reinforcers in discrimination acquisition. , 1991, Journal of the experimental analysis of behavior.

[54]  R. A. Preston,et al.  Conditioned reinforcement value and choice. , 1991, Journal of the experimental analysis of behavior.

[55]  G. Jensen Preference for bar pressing over "freeloading" as a function of number of rewarded presses. , 1963, Journal of experimental psychology.

[56]  S. Osborne The free food (contrafreeloading) phenomenon: A review and analysis , 1977 .

[57]  D. A. Lieberman,et al.  Learning when reward is delayed: a marking hypothesis. , 1979, Journal of experimental psychology. Animal behavior processes.

[58]  J. Cowles Food-tokens as incentives for learning by chimpanzees. , 1937 .

[59]  M. Rashotte,et al.  Signaling functions of the second-order CS: Partial reinforcement during second-order conditioning of the pigeon’s keypeck , 1981 .

[60]  Alan E. Kazdin,et al.  The token economy : a review and evaluation , 1977 .

[61]  A. Amsel,et al.  Frustration theory: Subject index , 1992 .

[62]  P. Hanford,et al.  Effects of conditioned reinforcement frequency in an intermittent free-feeding situation. , 1967, Journal of the experimental analysis of behavior.

[63]  Neal E. Miller,et al.  Personality and Psychotherapy: An Analysis in Terms of Learning, Thinking, and Culture , 1963 .

[64]  Partial reinforcement in serial autoshaping: The role of attentional and associative factors☆ , 1987 .

[65]  Jerome Kagan,et al.  Learning : an introduction to the principles of adaptive bahavior , 1989 .

[66]  Separating the reinforcing and discriminative properties of brief-stimulus presentations in second-order schedules. , 1979, Journal of the experimental analysis of behavior.

[67]  The effects of unsignalled delayed reinforcement. , 1976, Journal of the experimental analysis of behavior.

[68]  E. Fantino Choice and rate of reinforcement. , 1969, Journal of the experimental analysis of behavior.

[69]  Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: effects of delay-signal duration. , 1990, Journal of the experimental analysis of behavior.

[70]  R T Kelleher,et al.  Fixed-ratio schedules of conditioned reinforcement with chimpanzees. , 1958, Journal of the experimental analysis of behavior.

[71]  B. F. Skinner,et al.  How to teach animals. , 1951 .

[72]  O. Mowrer LEARNING THEORY AND PERSONALITY DYNAMICS , 1953 .

[73]  H. B. Daly Observing response acquisition: preference for unpredictable appetitive rewards obtained under conditions predicted by DMOD. , 1985, Journal of experimental psychology. Animal behavior processes.

[74]  O. Mowrer Learning theory and the symbolic processes. , 1962 .

[75]  D. Stubbs,et al.  Second-order schedules and the problem of conditioned reinforcement. , 1971, Journal of the experimental analysis of behavior.