The distribution of response bout lengths and its sensitivity to differential reinforcement.

Response bouts are clusters of responses that occur in rapid succession and are punctuated by pauses during which the response does not occur. Under variable interval schedules of reinforcement, the number of responses in each bout (the bout length) varies among bouts. This experiment was aimed at determining whether the relative rate of reinforcement influenced the relative frequency of bouts of different lengths. Lever pressing in rats was reinforced under a tandem variable time (VT) 150-s fixed ratio (FR) X, where X could be 1 or 5 and varied randomly after each reinforcer. Two conditions were included: majority FR1 (mFR1) and majority FR5 (mFR5). In mFR1, 75% of reinforcers had a tandem FR requirement of 1 and 25% had a tandem FR requirement of 5; this distribution was reversed in mFR5. The dynamic bi-exponential refractory model of response bouts was fitted to the interresponse times (IRTs) in each condition. Model parameter estimates and IRTs were then used to simulate probable distributions of bout lengths. These distributions comprised a mixture of short geometrically-distributed bout lengths and long negative-binomially-distributed bout lengths. Long bouts were significantly longer in the mFR5 condition than in the mFR1 condition. In conjunction with previous data, the present study suggests that the prevalence of long bouts increases with the proportion of reinforcers with FR5 requirement. These results suggest that bouts of different lengths are sensitive to the rate at which they are reinforced.

[1]  B. Schwartz.  Interval and ratio reinforcement of a complex sequential operant in pigeons. , 1982, Journal of the experimental analysis of behavior.

[2]  Federico Sanabria,et al.  The isolation of motivational, motoric, and schedule effects on operant performance: a modeling approach. , 2011, Journal of the experimental analysis of behavior.

[3]  W M Baum,et al.  The correlation-based law of effect. , 1973, Journal of the experimental analysis of behavior.

[4]  Wendy D. Donlin,et al.  Response inhibition is impaired by developmental methylmercury exposure: Acquisition of low-rate lever-pressing , 2013, Behavioural Brain Research.

[5]  A. Catania,et al.  Reinforcement schedules: the role of responses preceding the one that produces the reinforcer. , 1971, Journal of the experimental analysis of behavior.

[6]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[7]  I Kyriazakis,et al.  The biologically relevant unit for the analysis of short-term feeding behavior of dairy cows. , 2000, Journal of dairy science.

[8]  Federico Sanabria,et al.  An affordance analysis of unconditioned lever pressing in rats and hamsters , 2013, Behavioural Processes.

[9]  P. Killeen.  Mathematical principles of reinforcement , 1994 .

[10]  M. C. Newland,et al.  High-rate operant behavior in two mouse strains: A response-bout analysis , 2009, Behavioural Processes.

[11]  R. Herrnstein.  On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[12]  B. Schwartz.  Allocation of complex, sequential operants on multiple and concurrent schedules of reinforcement. , 1986, Journal of the experimental analysis of behavior.

[13]  R. Shull,et al.  Response rate viewed as engagement bouts: effects of relative reinforcement and schedule type. , 2001, Journal of the experimental analysis of behavior.

[14]  Kimberly S. Kirkpatrick,et al.  Packet theory of conditioning and timing , 2002, Behavioural Processes.

[15]  R. Shull,et al.  Bouts of responding on variable-interval schedules: effects of deprivation level. , 2004, Journal of the experimental analysis of behavior.

[16]  Federico Sanabria,et al.  Characterizing operant hyperactivity in the Spontaneously Hypertensive Rat , 2012, Behavioral and Brain Functions.

[17]  M. Reilly,et al.  Response acquisition with delayed reinforcement in a rodent model of attention-deficit/hyperactivity disorder (ADHD) , 2006, Behavioural Brain Research.

[18]  H S HOFFMAN,et al.  A progression for generating variable-interval schedules. , 1962, Journal of the experimental analysis of behavior.

[19]  Ryan D Ward,et al.  Resistance to change of responding maintained by unsignaled delays to reinforcement: a response-bout analysis. , 2006, Journal of the experimental analysis of behavior.

[20]  Raymond C Pitts,et al.  Concurrent performance as bouts of behavior. , 2014, Journal of the experimental analysis of behavior.

[21]  Michael Davis,et al.  Facilitation of Conditioned Fear Extinction by Systemic Administration or Intra-Amygdala Infusions of d-Cycloserine as Assessed with Fear-Potentiated Startle in Rats , 2002, The Journal of Neuroscience.

[22]  F. Mechner,et al.  Effects of deprivation upon counting and timing in rats. , 1962, Journal of the experimental analysis of behavior.

[23]  Federico Sanabria,et al.  Extinction under a behavioral microscope: Isolating the sources of decline in operant response rate , 2012, Behavioural Processes.

[24]  M. Berdoy.  Defining bouts of behaviour: a three-process model , 1993, Animal Behaviour.

[25]  R. Shull,et al.  Bouts of responding from variable-interval reinforcement of lever pressing by rats. , 2003, Journal of the experimental analysis of behavior.

[26]  J. Evenden,et al.  The psychopharmacology of impulsive behaviour in rats VIII: effects of amphetamine, methylphenidate, and other drugs on responding maintained by a fixed consecutive number avoidance schedule , 2005, Psychopharmacology.

[27]  Federico Sanabria,et al.  Extinction learning deficit in a rodent model of attention-deficit hyperactivity disorder , 2012, Behavioral and Brain Functions.

[28]  P. Shizgal,et al.  Operant tempo varies with reinforcement rate: implications for measurement of reward efficacy , 2001, Behavioural Processes.

[29]  R. Shull,et al.  Response rate viewed as engagement bouts: resistance to extinction. , 2002, Journal of the experimental analysis of behavior.

[30]  P. Killeen,et al.  Behavioral variability, elimination of responses, and delay-of-reinforcement gradients in SHR and WKY rats , 2007, Behavioral and Brain Functions.

[31]  A. Catania,et al.  A quantitative analysis of the behavior maintained by delayed reinforcers. , 2015, Journal of the experimental analysis of behavior.

[32]  M. C. Newland,et al.  Using pentobarbital to assess the sensitivity and independence of response-bout parameters in two mouse strains , 2011, Pharmacology Biochemistry and Behavior.

[33]  Federico Sanabria,et al.  A microstructural analysis of schedule-induced polydipsia reveals incentive-induced hyperactivity in an animal model of ADHD , 2015, Behavioural Brain Research.

[34]  C. Shimp.  Choice and behavioral patterning. , 1982, Journal of the experimental analysis of behavior.

[35]  R. Shull,et al.  Bouts of responding: the relation between bout rate and the rate of variable-interval reinforcement. , 2004, Journal of the experimental analysis of behavior.

[36]  R. Shull.  Bouts, Changeovers, and Units of Operant Behavior , 2011 .

[37]  A. K. Reid,et al.  Resurgence of integrated behavioral units. , 2007, Journal of the experimental analysis of behavior.

[38]  Albert-László Barabási,et al.  The origin of bursts and heavy tails in human dynamics , 2005, Nature.

[39]  I. J. Myung,et al.  Tutorial on maximum likelihood estimation , 2003 .

[40]  W. Löscher,et al.  Anticonvulsant effects of the glycine/NMDA receptor ligands d‐cycloserine and d‐serine but not R‐(+)‐HA‐966 in amygdala‐kindled rats , 1994, British journal of pharmacology.

[41]  A. Neuringer.  Operant variability: Evidence, functions, and theory , 2002, Psychonomic bulletin & review.

[42]  C. Shimp.  Magnitude and frequency of reinforcement and frequencies of interresponse times. , 1968, Journal of the experimental analysis of behavior.