Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length.

Pigeons' choice between reliable (100%) and unreliable (50%) reinforcement was studied using a concurrent-chains procedure. Initial links were fixed-ratio 1 schedules, and terminal links were equal fixed-time schedules. The duration of the terminal links was varied across conditions. The terminal link on the reliable side always ended in food; the terminal link on the unreliable side ended with food 50% of the time and otherwise with blackout. Different stimuli present during the 50% terminal links signaled food or blackout outcomes under signaled conditions but were uncorrelated with outcomes under unsignaled conditions. In signaled conditions, most pigeons displayed a nearly exclusive preference for the 100% alternative when terminal links were short (5 or 10 s), but with terminal links of 30 s or longer, preference for the 100% alternative was sharply reduced (often to below .5). In unsignaled conditions, most pigeons showed extreme preference for the 100% alternative with either short (5 s) or longer (30 s) terminal links. Thus, pigeons' choice between reliable and unreliable reinforcement is influenced by both the signal conditions on the unreliable alternative and the duration of the terminal-link delay. With a long delay and signaled outcomes, many pigeons display a suboptimal tendency to choose the unreliable side.

[1]  E. Fantino.  Immediate reward followed by extinction vs. later reward without extinction , 1966 .

[2]  Effects of percentage reinforcement on choice in a concurrent chain schedule , 1968 .

[3]  E. Fantino.  Choice and rate of reinforcement. , 1969, Journal of the experimental analysis of behavior.

[4]  R N Wilton,et al.  Observing responses and informative stimuli. , 1971, Journal of the experimental analysis of behavior.

[5]  S. B. Kendall,et al.  Preference for intermittent reinforcement. , 1974, Journal of the experimental analysis of behavior.

[6]  G. Ainslie,et al.  Impulse control in pigeons. , 1974, Journal of the experimental analysis of behavior.

[7]  S. B. Kendall.  Enhancement of conditioned reinforcement by uncertainty. , 1975, Journal of the experimental analysis of behavior.

[8]  Edmund Fantino,et al.  Self-control and general models of choice. , 1976 .

[9]  Choice and percentage reinforcement in pigeons , 1976 .

[10]  M. Branch.  Signalled and unsignalled percentage reinforcement of performance under a chained schedule. , 1977, Journal of the experimental analysis of behavior.

[11]  R. Menlove,et al.  Preference for fixed over variable access to food , 1979 .

[12]  Percentage reinforcement and choice. , 1979, Journal of the experimental analysis of behavior.

[13]  J. Pearce,et al.  A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980 .

[14]  J. Pearce,et al.  The Influence of Partial Reinforcement on Serial Autoshaping with Pigeons , 1983, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[15]  S. B. Kendall.  A further study of choice and percentage reinforcement , 1985, Behavioural Processes.

[16]  J. Pearce,et al.  Predictive Accuracy and the Effects of Partial Reinforcement on Serial Autoshaping , 1985 .

[17]  R. Dunn,et al.  OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR CHOICE BETWEEN RELIABLE AND UNRELIABLE OUTCOMES : MIXED PERCENTAGE-REINFORCEMENT IN CONCURRENT CHAINS , 2005 .

[18]  Sara J. Shettleworth,et al.  Risk aversion in pigeons. , 1987 .

[19]  Marcia L. Spetch,et al.  Choice with uncertain outcomes: conditioned reinforcement effects. , 1990, Journal of the experimental analysis of behavior.