Extinction learning deficit in a rodent model of attention-deficit hyperactivity disorder

BackgroundDeficient operant extinction has been hypothesized to be constitutive of ADHD dysfunction. In order to elucidate the behavioral mechanisms underlying this deficit, the performance of an animal model of ADHD, the spontaneously hypertensive rat (SHR), was compared against the performance of a control strain, the Wistar-Kyoto rat (WKY) during extinction.MethodFollowing extensive training of lever pressing under variable interval schedules of food reinforcement (reported previously), SHR and WKY rats were exposed to two sessions of extinction training. Extinction data was analyzed using the Dynamic Bi-Exponential Refractory Model (DBERM) of operant performance. DBERM assumes that operant responses are organized in bouts separated by pauses; during extinction, bouts may decline across multiple dimensions, including frequency and length. DBERM parameters were estimated using hierarchical Bayesian modeling.ResultsSHR responded more than WKY during the first extinction session. DBERM parameter estimates revealed that, at the onset of extinction, SHR produced more response bouts than WKY. Over the course of extinction, response bouts progressively shortened for WKY but not for SHR.ConclusionsBased on prior findings on the sensitivity of DBERM parameters to motivational and schedule manipulations, present data suggests that (1) more frequent response bouts in SHR are likely related to greater incentive motivation, and (2) the persistent length of bouts in SHR are likely related to a slower updating of the response-outcome association. Overall, these findings suggest specific motivational and learning deficits that may explain ADHD-related impairments in operant performance.

[1]  B. Alsop.  Problems with spontaneously hypertensive rats (SHR) as a model of attention-deficit/hyperactivity disorder (AD/HD) , 2007, Journal of Neuroscience Methods.

[2]  R. Shull,et al.  Bouts of responding on variable-interval schedules: effects of deprivation level. , 2004, Journal of the experimental analysis of behavior.

[3]  Espen Borgå Johansen,et al.  The spontaneously hypertensive rat model of ADHD – The importance of selecting the appropriate reference strain , 2009, Neuropharmacology.

[4]  J. Swanson,et al.  Effect of Reinforcement on Facial Responsivity and Persistence in Children with Attention-Deficit Hyperactivity Disorder , 1998, Behavior modification.

[5]  R. Rescorla.  Inhibitory associations between S and R in extinction , 1993 .

[6]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[7]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[8]  Clive D. L. Wynne,et al.  Models of action : mechanisms for adaptive behavior , 1998 .

[9]  T. Lehtimäki,et al.  Behavioral and Brain Functions , 2008 .

[10]  S. Knardahl,et al.  Behavior of hypertensive and hyperactive rat strains: Hyperactivity is not unitarily determined , 1992, Physiology & Behavior.

[11]  Markus Frings,et al.  Timing of conditioned eyeblink responses is impaired in children with attention-deficit/hyperactivity disorder , 2010, Experimental Brain Research.

[12]  S. Kollins,et al.  Experimental analysis of childhood psychopathology: A laboratory matching analysis of the behavior of children diagnosed with Attention-Deficit Hyperactivity Disorder (ADHD) , 1997 .

[13]  D. Bindra.  How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcements , 1978, Behavioral and Brain Sciences.

[14]  J. Wickens,et al.  Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD. , 2008, Journal of child psychology and psychiatry, and allied disciplines.

[15]  Ryan D Ward,et al.  Resistance to change of responding maintained by unsignaled delays to reinforcement: a response-bout analysis. , 2006, Journal of the experimental analysis of behavior.

[16]  R. Shull,et al.  Response rate viewed as engagement bouts: effects of relative reinforcement and schedule type. , 2001, Journal of the experimental analysis of behavior.

[17]  V. Douglas,et al.  Effects of reward and nonreward on frustration and attention in attention deficit disorder , 1994, Journal of abnormal child psychology.

[18]  F. Iaboni,et al.  Psychophysiological response of ADHD children to reward and extinction. , 1997, Psychophysiology.

[19]  Federico Sanabria,et al.  Extinction under a behavioral microscope: Isolating the sources of decline in operant response rate , 2012, Behavioural Processes.

[20]  R. Shull,et al.  Bouts of responding from variable-interval reinforcement of lever pressing by rats. , 2003, Journal of the experimental analysis of behavior.

[21]  Charles Kemp,et al.  Bayesian models of cognition , 2008 .

[22]  T. Sagvolden,et al.  Behavioral effects of intra-cranial self-stimulation in an animal model of attention-deficit/hyperactivity disorder (ADHD) , 2005, Behavioural Brain Research.

[23]  V. Russell,et al.  A dynamic developmental theory of attention-deficit/hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. , 2005, The Behavioral and brain sciences.

[24]  T. Sagvolden,et al.  Slower extinction of responses maintained by intra-cranial self-stimulation (ICSS) in an animal model of attention-deficit/hyperactivity disorder (ADHD) , 2005, Behavioural Brain Research.

[25]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[26]  M. Bouton.  Context and behavioral processes in extinction. , 2004, Learning & memory.

[27]  Jun Lu,et al.  An introduction to Bayesian hierarchical models with an application in the theory of signal detection , 2005, Psychonomic bulletin & review.

[28]  T. Sagvolden,et al.  Response disinhibition may be explained as an extinction deficit in an animal model of attention-deficit/hyperactivity disorder (ADHD) , 2004, Behavioural Brain Research.

[29]  Federico Sanabria,et al.  Characterizing operant hyperactivity in the Spontaneously Hypertensive Rat , 2012, Behavioral and Brain Functions.

[30]  A. Catania,et al.  The operant reserve: A computer simulation in (accelerated) real time , 2005, Behavioural Processes.

[31]  A. Meneses,et al.  Effects of aging and hypertension on learning, memory, and activity in rats , 1996, Physiology & Behavior.

[32]  N. Guttman,et al.  Operant conditioning, extinction, and periodic reinforcement in relation to concentration of sucrose used as reinforcing agent. , 1953, Journal of experimental psychology.

[33]  P. Killeen,et al.  Evidence for impulsivity in the Spontaneously Hypertensive Rat drawn from complementary response-withholding tasks , 2008, Behavioral and Brain Functions.

[34]  Federico Sanabria,et al.  The isolation of motivational, motoric, and schedule effects on operant performance: a modeling approach. , 2011, Journal of the experimental analysis of behavior.

[35]  P. Holland,et al.  Conditioning of simultaneous and serial feature-positive discriminations , 1981 .

[36]  K. Lattal,et al.  Facets of Pavlovian and operant extinction , 2012, Behavioural Processes.

[37]  P. Killeen.  Mathematical principles of reinforcement , 1994 .

[38]  M. C. Newland,et al.  High-rate operant behavior in two mouse strains: A response-bout analysis , 2009, Behavioural Processes.

[39]  An experimental analysis of steady-state response rate components on variable ratio and variable interval schedules of reinforcement. , 2011, Journal of experimental psychology. Animal behavior processes.

[40]  Michael D. Lee,et al.  A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods , 2008, Cogn. Sci..

[41]  T. Sagvolden,et al.  Attention-deficit/hyperactivity disorder (ADHD) behaviour explained by dysfunctioning reinforcement and extinction processes , 2002, Behavioural Brain Research.

[42]  P. Shizgal,et al.  Operant tempo varies with reinforcement rate: implications for measurement of reward efficacy , 2001, Behavioural Processes.

[43]  R. Shull,et al.  Response rate viewed as engagement bouts: resistance to extinction. , 2002, Journal of the experimental analysis of behavior.

[44]  A. Scheres,et al.  Identifying the neurobiology of altered reinforcement sensitivity in ADHD: A review and research agenda , 2010, Neuroscience & Biobehavioral Reviews.

[45]  Christopher A. Podlesnik,et al.  Repeated extinction and reversal learning of an approach response supports an arousal-mediated learning model , 2011, Behavioural Processes.

[46]  Hiroyuki Uno,et al.  Orbitofrontal cortex dysfunction in attention-deficit hyperactivity disorder revealed by reversal and extinction tasks , 2002, Neuroreport.