Conditioned reinforcement dynamics in three-link chained schedules.

In two experiments rats were trained on three-link concurrent-chains schedules of reinforcement. In Experiment 1, additional entries to one terminal link were added during one of the middle links to a baseline schedule that was otherwise equal for the two chains, and, depending on the condition, these additional terminal-link presentations ended either in food or in no food. When food occurred, preference was always in favor of the chain with the additional terminal-link presentations (which also entailed a higher rate of reinforcement). When no food occurred at the end of the additional terminal links, the outcome depended on the nature of the stimuli associated with these additional terminal links. When stimuli different from the reinforced baseline terminal links were used for the no-food terminal links, preference was against the choice alternative that led to the extra periods of extinction. When the same stimulus was used for the two kinds of terminal links, preference was near indifference, that is, significantly greater than when different stimuli were used. In Experiment 2, rats learned repeated reversals of a simultaneous discrimination under a three-link concurrent-chains schedule, in which the food or no-food choice outcomes were delayed until the end of the chain. Different conditions were defined by the point in the chain at which differential stimuli occurred. When the middle and terminal links provided no differential stimuli, discrimination was acquired more slowly than when differential stimuli occurred in both links. When differential stimuli occurred in the middle but not the terminal links, acquisition rates were intermediate. Both experiments together show that the effects of stimuli in a chain schedule are due partly to the time to food correlated with the stimuli and partly to the time to the next conditioned reinforcer in the sequence.

[1]  H S HOFFMAN,et al.  A progression for generating variable-interval schedules. , 1962, Journal of the experimental analysis of behavior.

[2]  R. Herrnstein SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. , 1964, Journal of the experimental analysis of behavior.

[3]  P. Killeen On the measurement of reinforcement frequency in the study of preference. , 1968, Journal of the experimental analysis of behavior.

[4]  The effects of unsignalled delayed reinforcement. , 1976, Journal of the experimental analysis of behavior.

[5]  D. A. Lieberman,et al.  Learning when reward is delayed: a marking hypothesis. , 1979, Journal of experimental psychology. Animal behavior processes.

[6]  L. Green Preference as a function of the correlation between stimuli and reinforcement outcomes , 1980 .

[7]  H. Hurwitz,et al.  Depriving rats of food: A reappraisal of two techniques. , 1983, Journal of the experimental analysis of behavior.

[8]  Effects of delayed conditioned reinforcement in chain schedules. , 1987, Journal of the experimental analysis of behavior.

[9]  B. Williams,et al.  Conditioned reinforcement versus time to reinforcement in chain schedules. , 1990, Journal of the experimental analysis of behavior.

[10]  B A Williams,et al.  Preference for conditioned reinforcement. , 1991, Journal of the experimental analysis of behavior.

[11]  Context specificity of conditioned-reinforcement effects on discrimination acquisition. , 1994, Journal of the experimental analysis of behavior.

[12]  Blocking despite changes in reinforcer identity , 1994 .

[13]  B. Williams Conditioned reinforcement: Neglected or outmoded explanatory construct? , 1994, Psychonomic bulletin & review.

[14]  B. Williams,et al.  Stimulus devaluation and extinction of chain schedule performance , 1995 .