Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients

Substance dependence is characterized by compulsive drug-taking despite negative consequences. Animal research suggests an underlying imbalance between goal-directed and habitual action control with chronic drug use. However, this imbalance, and its associated neurophysiological mechanisms, has not yet been experimentally investigated in human drug abusers. The aim of the present study therefore was to assess the balance between goal-directed and habit-based learning and its neural correlates in abstinent alcohol-dependent (AD) patients. A total of 31 AD patients and 19 age, gender and education matched healthy controls (HC) underwent functional magnetic resonance imaging (fMRI) during completion of an instrumental learning task designed to study the balance between goal-directed and habit learning. Task performance and task-related blood oxygen level-dependent activations in the brain were compared between AD patients and healthy matched controls. Findings were additionally associated with duration and severity of alcohol dependence. The results of this study provide evidence for an overreliance on stimulus-response habit learning in AD compared with HC, which was accompanied by decreased engagement of brain areas implicated in goal-directed action (ventromedial prefrontal cortex and anterior putamen) and increased recruitment of brain areas implicated in habit learning (posterior putamen) in AD patients. In conclusion, this is the first human study to provide experimental evidence for a disturbed balance between goal-directed and habitual control by use of an instrumental learning task, and to directly implicate cortical dysfunction to overreliance on inflexible habits in AD patients.

[1]  T. Robbins,et al.  Response Perseveration in Stimulant Dependence Is Associated with Striatal Dysfunction and Can Be Ameliorated by a D2/3 Receptor Agonist , 2011, Biological Psychiatry.

[2]  Leonardo Franklin Fontenelle,et al.  Obsessive-Compulsive Disorder, Impulse Control Disorders and Drug Addiction , 2011, Drugs.

[3]  K. R. Ridderinkhof,et al.  Corticostriatal Connectivity Underlies Individual Differences in the Balance between Habitual and Goal-Directed Action Control , 2012, The Journal of Neuroscience.

[4]  B. Balleine,et al.  On habits and addiction: An associative analysis of compulsive drug seeking. , 2008, Drug discovery today. Disease models.

[5]  L. Hogarth.  Goal-directed and transfer-cue-elicited drug-seeking are dissociated by pharmacotherapy: evidence for independent additive controllers. , 2012, Journal of experimental psychology. Animal behavior processes.

[6]  B. Everitt,et al.  Differential Roles of the Dorsolateral and Midlateral Striatum in Punished Cocaine Seeking , 2012, The Journal of Neuroscience.

[7]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[8]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[9]  D. Hommer,et al.  Translating the neuroscience of alcoholism into clinical treatments: From blocking the buzz to curing the blues , 2010, Neuroscience & Biobehavioral Reviews.

[10]  P. Cuijpers,et al.  The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods , 2008, International journal of methods in psychiatric research.

[11]  S. Killcross,et al.  Amphetamine Exposure Enhances Habit Formation , 2006, The Journal of Neuroscience.

[12]  A. Dickinson,et al.  Associative theories of goal-directed behaviour: a case for animal–human translational models , 2009, Psychological research.

[13]  F. Woodward Hopf,et al.  Rescuing cocaine-induced prefrontal cortex hypoactivity prevents compulsive cocaine seeking , 2013, Nature.

[14]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[15]  B. Balleine,et al.  Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions , 2008, The Journal of Neuroscience.

[16]  B. Balleine,et al.  The role of prelimbic cortex in instrumental conditioning , 2003, Behavioural Brain Research.

[17]  T. Robbins,et al.  Disruption in the Balance Between Goal-Directed Behavior and Habit Learning in Obsessive-Compulsive Disorder , 2011, The American journal of psychiatry.

[18]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[19]  N. Volkow,et al.  Neurocircuitry of Addiction , 2010, Neuropsychopharmacology.

[20]  T. Robbins,et al.  Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[21]  A. Rush,et al.  The Inventory of Depressive Symptomatology (IDS): psychometric properties , 1996, Psychological Medicine.

[22]  A T McLellan,et al.  Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. , 2000, JAMA.

[23]  B. Everitt,et al.  Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration , 2004, Science.

[24]  L. Hogarth,et al.  Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. , 2011, Journal of experimental psychology. Animal behavior processes.

[25]  W. van den Brink,et al.  Response Inhibition during Cue Reactivity in Problem Gamblers: An fMRI Study , 2012, PloS one.

[26]  Michael A. Nader,et al.  Behavioral/systems/cognitive Cocaine Self-administration Produces a Progressive Involvement of Limbic, Association, and Sensorimotor Striatal Domains , 2022 .

[27]  L. Schwabe,et al.  Stress Prompts Habit Behavior in Humans , 2009, The Journal of Neuroscience.

[28]  A. Aleman,et al.  Functional MRI correlates of visuospatial planning in out‐patient depression and anxiety , 2011, Acta psychiatrica Scandinavica.

[29]  T. Robbins,et al.  Reliance on habits at the expense of goal-directed control following dopamine precursor depletion , 2011, Psychopharmacology.

[30]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[31]  B. Everitt,et al.  Cocaine Seeking Habits Depend upon Dopamine-Dependent Serial Connectivity Linking the Ventral with the Dorsal Striatum , 2008, Neuron.

[32]  Trevor W. Robbins,et al.  High Impulsivity Predicts the Switch to Compulsive Cocaine-Taking , 2008, Science.

[33]  Karl Mann,et al.  Initial, habitual and compulsive alcohol use is characterized by a shift of cue processing from ventral to dorsal striatum. , 2010, Addiction.

[34]  C. Naranjo,et al.  Assessment of alcohol withdrawal: the revised clinical institute withdrawal assessment for alcohol scale (CIWA-Ar). , 1989, British journal of addiction.

[35]  H. Kranzler,et al.  Early detection of harmful alcohol consumption: comparison of clinical, laboratory, and self-report screening procedures. , 1989, Addictive behaviors.

[36]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[37]  L. Hogarth,et al.  Impaired goal-directed behavioural control in human impulsivity , 2010, Quarterly journal of experimental psychology.

[38]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[39]  A. Dickinson,et al.  Alcohol Seeking by Rats: Action or Habit? , 2002, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[40]  A. Leshner.  Addiction is a brain disease, and it matters. , 1997, Science.

[41]  A. Heinz,et al.  Dopamine and the diseased brain. , 2006, CNS & neurological disorders drug targets.

[42]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[43]  A. Dickinson,et al.  Stimulus-outcome interactions during instrumental discrimination learning by rats and humans. , 2007, Journal of experimental psychology. Animal behavior processes.

[44]  Van Strien,et al.  Classificatie van links- en rechtshandige proefpersonen. , 1992 .

[45]  A. Dickinson,et al.  Differential Engagement of the Ventromedial Prefrontal Cortex by Goal-Directed and Habitual Behavior toward Food Pictures in Humans , 2009, The Journal of Neuroscience.

[46]  L. Vanderschuren,et al.  Compulsive drug use and its neural substrates , 2012, Reviews in the neurosciences.

[47]  Roshan Cools,et al.  Habitual versus Goal-directed Action Control in Parkinson Disease , 2011, Journal of Cognitive Neuroscience.

[48]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[49]  L. Kozlowski,et al.  The Fagerström Test for Nicotine Dependence: a revision of the Fagerström Tolerance Questionnaire. , 1991, British journal of addiction.

[50]  A. Zapata,et al.  Shift from Goal-Directed to Habitual Cocaine Seeking after Prolonged Experience in Rats , 2010, The Journal of Neuroscience.

[51]  B. Everitt,et al.  Involvement of the Dorsal Striatum in Cue-Controlled Cocaine Seeking , 2005, The Journal of Neuroscience.

[52]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[53]  A. Dickinson,et al.  Oral cocaine seeking by rats: action or habit? , 2003, Behavioral neuroscience.

[54]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[55]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[56]  B. Balleine,et al.  Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning , 2005, The European journal of neuroscience.

[57]  A. Farmer,et al.  The Composite International Diagnostic Interview. An epidemiologic Instrument suitable for use in conjunction with different diagnostic systems and in different cultures. , 1988, Archives of general psychiatry.

[58]  A. Beck,et al.  An inventory for measuring clinical anxiety: psychometric properties. , 1988, Journal of consulting and clinical psychology.

[59]  C. O'brien,et al.  Myths about the treatment of addiction , 1996, The Lancet.

[60]  P. Janak,et al.  Habitual Alcohol Seeking: Time Course and the Contribution of Subregions of the Dorsal Striatum , 2012, Biological Psychiatry.

[61]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[62]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[63]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[64]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[65]  D. Newlin,et al.  The Habitual Brain: An “Adapted Habit” Theory of Substance Use Disorders , 2007, Substance use & misuse.

[66]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.