Conditioned reinforcement: Neglected or outmoded explanatory construct?

The construct of conditioned reinforcement has been challenged over the past two decades, both as an adequate explanation of behavior in various situations (e.g., behavioral chains) in which it was previously regarded as crucial and in terms of the validity of the concept of conditioned value on which it is based. Recent research is reviewed that answers these criticisms and vindicates the importance of the construct. Also discussed are unanswered empirical issues regarding the concept and its implications for behavioral phenomena of major importance for general-process learning theory, such as autoshaping and imprinting.

[1]  R. M. Elliott,et al.  Behavior of Organisms , 1991 .

[2]  N. Miller,et al.  Social Learning and Imitation , 1942 .

[3]  Neal E. Miller,et al.  Personality and Psychotherapy: An Analysis in Terms of Learning, Thinking, and Culture , 1963 .

[4]  B. Skinner,et al.  Science and human behavior , 1953 .

[5]  O. Mowrer.  LEARNING THEORY AND PERSONALITY DYNAMICS , 1953 .

[6]  J. Deutsch.  The structural basis of behavior , 1960 .

[7]  G. Kimble,et al.  Hilgard and Marquis' Conditioning and learning , 1961 .

[8]  J. E. Mazur,et al.  Learning and Behavior , 1966 .

[9]  R. T. Kelleher.  CONDITIONED REINFORCEMENT IN SECOND‐ORDER SCHEDULES1 , 1966 .

[10]  E. L. Wike,et al.  Secondary reinforcement : selected experiments , 1966 .

[11]  W. K. Honig.  Operant behavior : areas of research and application , 1966 .

[12]  P. Hanford,et al.  Effects of conditioned reinforcement frequency in an intermittent free-feeding situation. , 1967, Journal of the experimental analysis of behavior.

[13]  R. Bolles.  Theory of Motivation , 1967 .

[14]  P. L. Brown,et al.  Auto-shaping of the pigeon's key-peck. , 1968, Journal of the experimental analysis of behavior.

[15]  P. Killeen.  On the measurement of reinforcement frequency in the study of preference. , 1968, Journal of the experimental analysis of behavior.

[16]  D. R. Williams,et al.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. , 1969, Journal of the experimental analysis of behavior.

[17]  H. B. Daly.  Learning of a hurdle-jump response to escape cues paired with reduced reward or frustrative nonreward. , 1969, Journal of experimental psychology.

[18]  E. Fantino.  Choice and rate of reinforcement. , 1969, Journal of the experimental analysis of behavior.

[19]  L. Gollub,et al.  INFORMATION ON CONDITIONED REINFORCEMENT , 1970 .

[20]  B. Williams.  The effects of intertrial interval on discrimination reversal learning in the pigeon , 1971 .

[21]  R. Herrnstein,et al.  Food-avoidance in hungry pigeons, and other perplexities. , 1972, Journal of the experimental analysis of behavior.

[22]  H. Hoffman,et al.  A reinforcement model of imprinting: Implications for socialization in monkeys and men. , 1973 .

[23]  W M Baum,et al.  The correlation-based law of effect. , 1973, Journal of the experimental analysis of behavior.

[24]  H. M. Jenkins,et al.  The form of the auto-shaped response with food or water reinforcers. , 1973, Journal of the experimental analysis of behavior.

[25]  N. Mackintosh.  The psychology of animal learning , 1974 .

[26]  M. Morgan.  Resistance to satiation , 1974 .

[27]  M. Wessells.  The effects of reinforcement upon the prepecking behaviors of pigeons in the autoshaping experiment. , 1974, Journal of the experimental analysis of behavior.

[28]  A. Neuringer,et al.  Learning by Following a Food Source , 1974, Science.

[29]  H. M. Jenkins,et al.  Sign-tracking : the stimulus-reinforcer relation and directed action , 1974 .

[30]  W. Brewer.  There is no convincing evidence for operant or classical conditioning in adult humans. , 1974 .

[31]  E. Hearst.  Pavlovian Conditioning and Directed Movements , 1975 .

[32]  R. Rescorla,et al.  The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning. , 1975, Journal of experimental psychology. Animal behavior processes.

[33]  The effects of unsignalled delayed reinforcement. , 1976, Journal of the experimental analysis of behavior.

[34]  B. Williams.  Short-term retention of response outcome as a determinant of serial reversal learning , 1976 .

[35]  H. Rachlin.  Behavior and learning , 1976 .

[36]  Walter B. Weimer,et al.  Cognition and Symbolic Processes , 1976 .

[37]  M. Branch.  Signalled and unsignalled percentage reinforcement of performance under a chained schedule. , 1977, Journal of the experimental analysis of behavior.

[38]  Richard J. Herrnstein,et al.  The evolution of behaviorism. , 1977 .

[39]  E. Hearst,et al.  Persistent Approaches to a Signal for Food Despite Food Omission for Approaching. , 1977 .

[40]  D. Bullock,et al.  Social learning by following: an analysis. , 1977, Journal of the experimental analysis of behavior.

[41]  O. J. Sizemore,et al.  Unsignalled delay of reinforcement in variable-interval schedules. , 1978, Journal of the experimental analysis of behavior.

[42]  D. A. Lieberman,et al.  Learning when reward is delayed: a marking hypothesis. , 1979, Journal of experimental psychology. Animal behavior processes.

[43]  Patricia B. Cronin.  Reinstatement of postresponse stimuli prior to reward in delayed-reward discrimination learning by pigeons , 1980 .

[44]  H. Terrace,et al.  Autoshaping and Conditioning Theory , 1980 .

[45]  James S. Nairne,et al.  Second-order conditioning with diffuse auditory reinforcers in the pigeon☆ , 1981 .

[46]  R. Shull,et al.  Delay or rate of food delivery as determiners of response rate. , 1981, Journal of the experimental analysis of behavior.

[47]  K. Keller,et al.  Contingency, contiguity, correlation, and the concept of causation , 1981 .

[48]  R. Rescorla.  Effect of a stimulus intervening between CS and US in autoshaping. , 1982, Journal of experimental psychology. Animal behavior processes.

[49]  M. Domjan.  The principles of learning and behavior , 1982 .

[50]  N. Mackintosh,et al.  Conditioning And Associative Learning , 1983 .

[51]  D. A. Lieberman,et al.  Marking in pigeons: The role of memory in delayed reinforcement. , 1985 .

[52]  J. Gibbon,et al.  Cognition and behavior in studies of choice , 1986 .

[53]  J. E. Mazur.  Choice between single and multiple delayed reinforcers. , 1986, Journal of the experimental analysis of behavior.

[54]  J. Pearce,et al.  An Evaluation of the Associative Strength of a Partially Reinforced Serial CS , 1987 .

[55]  Effects of delayed conditioned reinforcement in chain schedules. , 1987, Journal of the experimental analysis of behavior.

[56]  Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement. , 1987, Journal of the experimental analysis of behavior.

[57]  Terence A. Shimp,et al.  Classical Conditioning of Consumer Attitudes: Four Experiments in an Advertising Context , 1987 .

[58]  M N Branch,et al.  Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement. , 1988, Journal of the experimental analysis of behavior.

[59]  A. S. Winton,et al.  Preference for simple interval schedules of reinforcement in concurrent chains: Effects of segmentation ratio. , 1988, Journal of the experimental analysis of behavior.

[60]  K. Holyoak,et al.  A Theory of Conditioning: Inductive Learning within Rule-Based Default Hierarchies. , 1989 .

[61]  R. Shull,et al.  Delay and number of food reinforcers: Effects on choice and latencies. , 1990, Journal of the experimental analysis of behavior.

[62]  P. Kop.  Reinforcement, choice and response strength , 1990 .

[63]  F. Baeyens,et al.  Contingency awareness in evaluative conditioning: A case for unaware affective-evaluative learning , 1990 .

[64]  J. Bolhuis,et al.  Filial Imprinting and Associative Learning , 1990 .

[65]  K. Lattal,et al.  Response acquisition with delayed reinforcement. , 1990, Journal of experimental psychology. Animal behavior processes.

[66]  Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: effects of delay-signal duration. , 1990, Journal of the experimental analysis of behavior.

[67]  C. Gallistel.  The organization of learning , 1990 .

[68]  R. A. Preston,et al.  Conditioned reinforcement value and choice. , 1991, Journal of the experimental analysis of behavior.

[69]  B A Williams,et al.  Preference for conditioned reinforcement. , 1991, Journal of the experimental analysis of behavior.

[70]  B. Williams.  Behavioral contrast and reinforcement value , 1991 .

[71]  J. E. Mazur.  Choice with probabilistic reinforcement: effects of delay and conditioned reinforcers. , 1991, Journal of the experimental analysis of behavior.

[72]  B. Williams.  Marking and bridging versus conditioned reinforcement , 1991 .

[73]  R. Dunn,et al.  Substitutability between conditioned and primary reinforcers in discrimination acquisition. , 1991, Journal of the experimental analysis of behavior.

[74]  E. Levin,et al.  Inter-relationships between conditioned and primary reinforcement in the maintenance of cigarette smoking. , 1991 .

[75]  O. Van den Bergh,et al.  Human evaluative conditioning: acquisition trials, presentation schedule, evaluative style and contingency awareness. , 1992, Behaviour research and therapy.

[76]  J. E. Mazur.  Predicting the Strength of a Conditioned Reinforcer: Effects of Delay and Uncertainty , 1993 .