Response variability in pigeons in a pavlovian task

Instrumental response variation is inversely related to reward probability. Gharib, Derby, and Roberts (2001) theorized that individuals behave more variably when their expectation of reward is low. They postulate that this behavioral rule assists the discovery of alternative actions when a target response is unlikely to be reinforced. This suggests that response variability may be unaffected in a situation in which an animal’s behavior is inconsequential to outcome delivery. We trained 6 pigeons in a within-subjects Pavlovian autoshaping procedure. On any given trial, the pigeons were presented with one of six colored discs on a touchscreen; each stimulus was associated with a particular probability of food, ranging from 100% to 0.6%. Pecking was more variable with low probabilities of food delivery, thus extending the rule relating variability and expectation to a Pavlovian situation.

[1]  S. Roberts,et al.  Control of variation by reward probability. , 2004, Journal of experimental psychology. Animal behavior processes.

[2]  L. Bizo,et al.  Satiation causes within-session decreases in instrumental responding. , 1998, Journal of experimental psychology. Animal behavior processes.

[3]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[4]  G. Atnip,et al.  Stimulus- and response-reinforcer contingencies in autoshaping, operant, classical, and omission training procedures in rats. , 1977, Journal of the experimental analysis of behavior.

[5]  J. R. Millenson,et al.  Some temporal and sequential properties of behavior during conditioning and extinction. , 1961, Journal of the experimental analysis of behavior.

[6]  D. R. Williams,et al.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. , 1969, Journal of the experimental analysis of behavior.

[7]  R. Rescorla,et al.  Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. , 1967, Psychological review.

[8]  J. M. Notterman Force emission during bar pressing. , 1959, Journal of experimental psychology.

[9]  B. Schwartz Interval and ratio reinforcement of a complex sequential operant in pigeons. , 1982, Journal of the experimental analysis of behavior.

[10]  R. A. Bromberger,et al.  LEVER DISPLACEMENT UNDER A VARIABLE RATIO SCHEDULE AND SUBSEQUENT EXTINCTION. , 1965, Journal of comparative and physiological psychology.

[11]  P. L. Brown,et al.  Auto-shaping of the pigeon's key-peck. , 1968, Journal of the experimental analysis of behavior.

[12]  Aaron P Blaisdell,et al.  Effect of reward probability on spatial and temporal variation. , 2010, Journal of experimental psychology. Animal behavior processes.

[13]  W C STEBBINS,et al.  Response latency as a function of reinforcement schedule. , 1962, Journal of the experimental analysis of behavior.

[14]  K. Spence Behavior Theory and Conditioning , 1978 .

[15]  B. Skinner Superstition in the pigeon. , 1948, Journal of experimental psychology.

[16]  W. O’Donohue Learning and Behavior Therapy , 1997 .

[17]  A. Neuringer,et al.  Reinforced variability decreases with approach to reinforcers. , 1996, Journal of experimental psychology. Animal behavior processes.

[18]  A. Neuringer Operant variability and repetition as functions of interresponse time. , 1991 .

[19]  J. J. Antonitis,et al.  Response variability in the white rat during conditioning, extinction, and reconditioning. , 1951, Journal of experimental psychology.

[20]  A. Neuringer,et al.  Stability and variability in extinction. , 2001, Journal of experimental psychology. Animal behavior processes.

[21]  Notterman Jm Force emission during bar pressing. , 1959 .

[22]  S. Roberts,et al.  Timing and the control of variation. , 2001, Journal of experimental psychology. Animal behavior processes.

[23]  P. Killeen,et al.  Satiation, capacity, and within-session responding. , 1999, Journal of the experimental analysis of behavior.

[24]  A. Neuringer,et al.  Variability is an operant. , 1985 .

[25]  R. Lanson,et al.  Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction. , 1969, Journal of the experimental analysis of behavior.