Another look at contrast in multiple schedules.

Recent research on multiple schedule interactions is reviewed. Contrary to formulations that view contrast as the result of elicited behavior controlled by the stimulus-reinforcer contingency (e.g., additivity theory), the major controlling variable is the relative rate of reinforcement, which cannot be reduced to some combination of stimulus-reinforcer and response-reinforcer effects. Other recent theoretical formulations are also reviewed and all are found to face serious counterevidence. The best description of the available data continues to be in terms of the "context of reinforcement," but Herrnstein's (1970) formulation of the basis of such context effects appears to be inadequate. An alternative conception is provided by Catania's concept of "inhibition by reinforcement," by which rate of responding is inversely related to the average rate of reinforcement in the situation. Such a conception is related to Gibbon's recent scalar-expectancy account of autoshaping and Fantino's delay-reduction model of conditioned reinforcement, suggesting that a common set of principles determines several diverse conditioning phenomena. However, the empirical status of such a description remains uncertain, because recent evidence shows that schedule interactions are temporally asymmetric, depending primarily upon the conditions of reinforcement that follow a schedule component.

[1]  The effect of discrimination training on the response rate and response duration of the rat , 1977 .

[2]  H. Leitenberg,et al.  “Time-out from positive reinforcement” as the UCS in a CER paradigm with rats , 1968 .

[3]  N. Azrin,et al.  Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli. , 1969, Journal of the experimental analysis of behavior.

[4]  James R. Sutterer,et al.  POSITIVE AND NEGATIVE BEHAVIORAL CONTRAST IN THE RAT1 , 1975 .

[5]  W. Henton,et al.  Classical Conditioning and Operant Conditioning , 1978 .

[6]  G. Woodruff Behavioral contrast and type of reward: Role of elicited response topography , 1979 .

[7]  C. N. Uhl,et al.  Omission training compared with yoked controls and extinction in multiple-schedule discrimination learning , 1974 .

[8]  J. Kagel,et al.  Substitutability in time allocation. , 1980 .

[9]  C. Shimp Probabilistically reinforced choice behavior in pigeons. , 1966, Journal of the experimental analysis of behavior.

[10]  B A Williams Elicited responding to signals for reinforcement: the effects of overall versus local changes in reinforcement probability. , 1976, Journal of the experimental analysis of behavior.

[11]  R D Spealman,et al.  Interactions in multiple schedules: the role of the stimulus-reinforcer contingency. , 1976, Journal of the experimental analysis of behavior.

[12]  J C Todorov,et al.  Component duration and relative response rates in multiple schedules. , 1972, Journal of the experimental analysis of behavior.

[13]  W. Merigan,et al.  Short-component multiple schedules: effects of relative reinforcement duration. , 1975, Journal of the experimental analysis of behavior.

[14]  Barry Schwartz Discriminative stimulus location as a determinant of positive and negative behavioral contrast in the pigeon. , 1975, Journal of the experimental analysis of behavior.

[15]  C. C. Perkins,et al.  The role of autopecking in behavioral contrast. , 1974, Journal of the experimental analysis of behavior.

[16]  J. Staddon,et al.  The "supersitition" experiment: A reexamination of its implications for the principles of adaptive behavior. , 1971 .

[17]  B. Schwartz Behavioral contrast in the pigeon depends upon the location of the stimulus , 1974 .

[18]  D M Wilkie,et al.  Signalled reinforcement in multiple and concurrent schedules. , 1973, Journal of the experimental analysis of behavior.

[19]  F. Mcsweeney Differences between rates of responding emitted during simple and multiple schedules , 1980 .

[20]  J. Staddon,et al.  Contrast effects in maintained generalization gradients. , 1973, Journal of the experimental analysis of behavior.

[21]  William M. Baum,et al.  BEHAVIORAL CONTRAST OF TIME ALLOCATION1 , 1976 .

[22]  John A. Nevin,et al.  RESPONSE STRENGTH IN MULTIPLE SCHEDULES1 , 1974 .

[23]  B A Williams,et al.  The following schedule of reinforcement as a fundamental determinant of steady state contrast in multiple schedules. , 1981, Journal of the experimental analysis of behavior.

[24]  H. Rachlin Contrast and Matching. , 1973 .

[25]  B. Freeman,et al.  Behavioral contrast: Reinforcement frequency or response suppression? , 1971 .

[26]  E. Hearst,et al.  Contrast and stimulus generalization following prolonged discrimination training. , 1971, Journal of the experimental analysis of behavior.

[27]  Dale M. Brethower,et al.  A facilitative effect of punishment on unpunished behavior. , 1962, Journal of the experimental analysis of behavior.

[28]  R J Herrnstein,et al.  Hunger and contrast in a multiple schedule. , 1974, Journal of the experimental analysis of behavior.

[29]  Positive conditioned suppression: Transfer of performance between contingent and noncontingent reinforcement situations. , 1980, Journal of the experimental analysis of behavior.

[30]  A molecular analysis of multiple schedule interactions: negative contrast. , 1977, Journal of the experimental analysis of behavior.

[31]  R. J. Irwin,et al.  Multiple schedules: effects of the distribution of reinforcements between component on the distribution of responses between conponents. , 1968, Journal of the experimental analysis of behavior.

[32]  K G White,et al.  Behavioral contrast as differential time allocation. , 1978, Journal of the experimental analysis of behavior.

[33]  D L Myers,et al.  Undermatching: a reappraisal of performance on concurrent variable-interval schedules of reinforcement. , 1977, Journal of the experimental analysis of behavior.

[34]  R. Wilton,et al.  Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component. , 1969, Journal of the experimental analysis of behavior.

[35]  J. Staddon Operant behavior as adaptation to constraint. , 1979 .

[36]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[37]  T. Bloomfield Behavioral contrast and relative reinforcement frequency in two multiple schedules. , 1967, Journal of the experimental analysis of behavior.

[38]  B. Hamilton,et al.  Behavioral contrast in the pigeon: a study of the duration of key pecking maintained on multiple schedules of reinforcement. , 1975, Journal of the experimental analysis of behavior.

[39]  L R Gollub,et al.  Behavioral interactions in multiple variable-interval schedules. , 1974, Journal of the experimental analysis of behavior.

[40]  Operant and Pavlovian factors in cross-response transfer of inhibitory stimulus control , 1978 .

[41]  B. Schwartz Maintenance of key pecking by response-independent food presentation: the role of the modality of the signal for food. , 1973, Journal of the experimental analysis of behavior.

[42]  G S REYNOLDS,et al.  Relativity of response rate and reinforcement frequency in a multiple schedule. , 1961, Journal of the experimental analysis of behavior.

[43]  T. Bloomfield Two types of behavioral contrast in discrimination learning. , 1966, Journal of the experimental analysis of behavior.

[44]  Howard Rachlin,et al.  Economic and biological influences on a pigeon's key peck. , 1975, Journal of the experimental analysis of behavior.

[45]  J A Nevin,et al.  On the form of the relation between response rates in a multiple schedule. , 1974, Journal of the experimental analysis of behavior.

[46]  N. Mackintosh,et al.  Some determinants of behavioral contrast in pigeons and rats , 1972 .

[47]  M. Rilling,et al.  Procedural antecedents of behavioral contrast: a re-examination of errorless learning. , 1976, Journal of the experimental analysis of behavior.

[48]  W M Baum,et al.  On two types of deviation from the matching law: bias and undermatching. , 1974, Journal of the experimental analysis of behavior.

[49]  A. Catania,et al.  Concurrent performances: reinforcement interaction and response independence. , 1963, Journal of the experimental analysis of behavior.

[50]  B. Williams The role of local interactions in behavioral contrast , 1974 .

[51]  B. Schwartz Stimulus-reinforcer contingencies and local behavioral contrast. , 1978, Journal of the experimental analysis of behavior.

[52]  J. Farley,et al.  Reinforcement and punishment effects in concurrent schedules: A test of two models. , 1980, Journal of the experimental analysis of behavior.

[53]  J. Farley Automaintenance, contrast, and contingencies: Effects of local vs. overall and prior vs. impending reinforcement context , 1980 .

[54]  P. Blough Behavioral and dimensional contrast in rats. , 1980, Journal of the experimental analysis of behavior.

[55]  M Davison,et al.  The effects of different component response requirements in multiple and concurrent schedules. , 1978, Journal of the experimental analysis of behavior.

[56]  Rates of responding in the pigeon generated by simple and complex schedules which provide the same rates of reinforcement , 1976 .

[57]  J. Nevin Differential reinforcement and stimulus control of not responding. , 1968, Journal of the experimental analysis of behavior.

[58]  C. Flaherty,et al.  Anticipation of incentive gain , 1982 .

[59]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[60]  B. Schwartz,et al.  The maintenance of key pecking by stimulus-contingent and response-independent food presentation. , 1973, Journal of the experimental analysis of behavior.

[61]  E. L. Edmon Multiple schedule component duration: a reanalysis of Shimp and Wheatley (1971) and Todorov (1972). , 1978, Journal of the experimental analysis of behavior.

[62]  G E Zuriff A comparison of variable-ratio and variable-interval schedules of reinforcement. , 1970, Journal of the experimental analysis of behavior.

[63]  A. Silberberg,et al.  The Structure of Choice , 1978 .

[64]  D M Wilkie,et al.  Variable-time reinforcement in multiple and concurrent schedules. , 1972, Journal of the experimental analysis of behavior.

[65]  David R. Thomas,et al.  Effects of interdimensional training on stimulus generalization: II. Within-subjects design , 1967 .

[66]  A. Charles Catania,et al.  Inhibition and behavioral contrast , 1964 .

[67]  A. V. Bacotti Home cage feeding time controls responding under multiple schedules , 1976 .

[68]  J E Staddon,et al.  On Herrnstein's equation and related forms. , 1977, Journal of the experimental analysis of behavior.

[69]  R. Beninger,et al.  Behavioral contrast in rats with different reinforcers and different response topographies. , 1975, Journal of the experimental analysis of behavior.

[70]  A. Padilla Analysis of incentive and behavioral contrast in the rat. , 1971 .

[71]  C. Bradshaw,et al.  Behaviour of Rats in Multiple Schedules of Response-Contingent and Response-Independent Food Presentation , 1978 .

[72]  R. Herrnstein,et al.  Toward a law of response strength. , 1976 .

[73]  R. Hamm,et al.  Differential conditioning of conditioned enhancement and positive conditioned suppression , 1978 .

[74]  K G White,et al.  Undermatching and contrast within components of multiple schedules. , 1981, Journal of the experimental analysis of behavior.

[75]  C. Rovee-Collier,et al.  Positive behavioral contrast in 3-month-old infants on multiple conjugate reinforcement schedules. , 1979, Journal of the experimental analysis of behavior.

[76]  R N Wilton,et al.  Behavioral contrast as a function of the duration of an immediately preceding period of extinction. , 1971, Journal of the experimental analysis of behavior.

[77]  H S Terrace,et al.  Discrimination learning, the peak shift, and behavioral contrast. , 1968, Journal of the experimental analysis of behavior.

[78]  D. Stewart,et al.  Line-orientation generalization following signalled-reinforcer training. , 1977, Journal of the experimental analysis of behavior.

[79]  S. Pliskoff RATE-CHANGE EFFECTS WITH EQUAL POTENTIAL REINFORCEMENTS DURING THE "WARNING" STIMULUS. , 1963, Journal of the experimental analysis of behavior.

[80]  E. Hearst,et al.  Some tests of the additivity (autoshaping) theory of behavioral contrast , 1976, Animal learning & behavior.

[81]  M. Rilling,et al.  Comparison of time-out and extinction as determinants of behavioral contrast: An analysis of sequential effects , 1972 .

[82]  J. Allison Contrast, induction, facilitation, suppression, and conservation. , 1976, Journal of the experimental analysis of behavior.

[83]  J. Malone Local contrast and Pavlovian induction. , 1976, Journal of the experimental analysis of behavior.

[84]  M. Davison,et al.  On the effects of component durations and component reinforcement rates in multiple schedules. , 1982, Journal of the experimental analysis of behavior.

[85]  K L Wheatley,et al.  Matching to relative reinforcement frequency in multiple schedules with a short component duration. , 1971, Journal of the experimental analysis of behavior.

[86]  R. Boakes,et al.  Successive discrimination training with equated reinforcement frequencies: failure to obtain behavioral contrast. , 1976, Journal of the experimental analysis of behavior.

[87]  Positive behavioral contrast when pigeons press treadles during multiple schedules. , 1983, Journal of the experimental analysis of behavior.

[88]  J A Nevin,et al.  An analysis of contrast effects in multiple schedules. , 1966, Journal of the experimental analysis of behavior.

[89]  P. D. Villiers,et al.  Toward a quantitative theory of punishment. , 1980, Journal of the experimental analysis of behavior.

[90]  F. Mcsweeney Positive and negative contrast as a function of component duration for key pecking and treadle pressing. , 1982, Journal of the experimental analysis of behavior.

[91]  B. Williams,et al.  Determinants of contrast in the signal-key procedure: Evidence against additivity theory. , 1981, Journal of the experimental analysis of behavior.

[92]  Behavioral contrast without response-rate reduction. , 1974, Journal of the experimental analysis of behavior.

[93]  D. Meltzer,et al.  Conditioned suppression and conditioned enhancement with the same positive UCS: an effect of CS duration. , 1970, Journal of the experimental analysis of behavior.

[94]  Signalled reinforcement and multiple schedules. , 1976, Journal of the experimental analysis of behavior.

[95]  W. Baum,et al.  Matching, undermatching, and overmatching in studies of choice. , 1979, Journal of the experimental analysis of behavior.

[96]  S. Sadowsky Behavioral contrast with timeout, blackout, or extinction as the negative condition. , 1973, Journal of the experimental analysis of behavior.

[97]  A. Kaufman Response suppression in the CER paradigm with extinction as the aversive event , 1969 .

[98]  R. Weisman Some determinants of inhibitory stimulus control. , 1969, Journal of the experimental analysis of behavior.

[99]  A. Catania,et al.  Self-inhibiting effects of reinforcement. , 1973, Journal of the experimental analysis of behavior.

[100]  R. F. Westbrook Failure to obtain positive contrast when pigeons press a bar. , 1973, Journal of the experimental analysis of behavior.

[101]  H. Leitenberg,et al.  Conditioned acceleration and conditioned suppression in pigeons. , 1966, Journal of the experimental analysis of behavior.

[102]  C. A. Boneau,et al.  Work decrement and reminiscence in pigeon operant responding. , 1962, Journal of experimental psychology.

[103]  Behavioral contrast in pigeons depends upon the operant. , 1973, Journal of comparative and physiological psychology.

[104]  J. Hinson,et al.  Behavioral competition: a mechanism for schedule interactions. , 1978, Science.

[105]  E Fantino,et al.  The symmetrical law of effect and the matching relation in choice behavior. , 1978, Journal of the experimental analysis of behavior.

[106]  Positive contrast in the rat: a test of the additivity theory. , 1979, The American journal of psychology.

[107]  B. Williams Contrast, component duration, and the following schedule of reinforcement. , 1979, Journal of experimental psychology. Animal behavior processes.

[108]  K. Keller The role of elicited responding in behavioral contrast. , 1974, Journal of the experimental analysis of behavior.

[109]  The role of response-independent reinforcement in producing behavioral contrast effects in the rat , 1971 .

[110]  D. Wilkie Behavioral contrast produced by a signaled decrease in local rate of reinforcement , 1977 .

[111]  B. Williams Behavioral contrast as a function of the temporal location of reinforcement. , 1976, Journal of the experimental analysis of behavior.

[112]  Behavioral contrast in pigeons learning an auditory discrimination , 1975 .

[113]  Ronald G. Hughes,et al.  The role of response suppression in behavioral contrast: Signaled reinforcement , 1970 .

[114]  B. Williams Contrast, Signaled Reinforcement, and the Relative Law of Effect , 1980 .

[115]  F K McSweeney,et al.  Three versions of the additive theories of behavioral contrast. , 1981, Journal of the experimental analysis of behavior.

[116]  W. Selekman Behavioral contrast and inhibitory stimulus control as related to extended training. , 1973, Journal of the experimental analysis of behavior.

[117]  A. Gutman Positive contrast, negative induction, and inhibitory stimulus control in the rat. , 1977, Journal of the experimental analysis of behavior.

[118]  D. Fenner The role of contingencies and "principles of behavioral variation" in pigeons' pecking. , 1980, Journal of the experimental analysis of behavior.

[119]  J. Malone,et al.  Multiple-schedule interactions and discrimination , 1981 .

[120]  S PLISKOFF,et al.  Rate-change effects during a pre-schedule-change stimulus. , 1961, Journal of the experimental analysis of behavior.

[121]  J. Hinson,et al.  Effects of component length and of the transitions among components in multiple schedules. , 1978, Journal of the experimental analysis of behavior.

[122]  M C Davison,et al.  Multiple and concurrent schedule performance: independence from concurrent and successive schedule contexts. , 1977, Journal of the experimental analysis of behavior.

[123]  B A Williams,et al.  A re-examination of local contrast in multiple schedules. , 1975, Journal of the experimental analysis of behavior.