The role of habit in compulsivity

Compulsivity has been recently characterized as a manifestation of an imbalance between the brain׳s goal-directed and habit-learning systems. Habits are perhaps the most fundamental building block of animal learning, and it is therefore unsurprising that there are multiple ways in which the development and execution of habits can be promoted/discouraged. Delineating these neurocognitive routes may be critical to understanding if and how habits contribute to the many faces of compulsivity observed across a range of psychiatric disorders. In this review, we distinguish the contribution of excessive stimulus-response habit learning from that of deficient goal-directed control over action and response inhibition, and discuss the role of stress and anxiety as likely contributors to the transition from goal-directed action to habit. To this end, behavioural, pharmacological, neurobiological and clinical evidence are synthesised and a hypothesis is formulated to capture how habits fit into a model of compulsivity as a trans-diagnostic psychiatric trait.

[1]  H. Westenberg,et al.  The role of dopamine in obsessive-compulsive disorder: preclinical and clinical evidence. , 2004, The Journal of clinical psychiatry.

[2]  T. Robbins,et al.  Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry , 2012, Trends in Cognitive Sciences.

[3]  B. Balleine,et al.  The role of prelimbic cortex in instrumental conditioning , 2003, Behavioural Brain Research.

[4]  P Pietrini,et al.  Cerebral glucose metabolism in childhood-onset obsessive-compulsive disorder. Revisualization during pharmacotherapy. , 1992, Archives of general psychiatry.

[5]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[6]  E. Hollander,et al.  A Double-Blind, Placebo-Controlled Trial of Clonazepam in Obsessive-Compulsive Disorder , 2003, The world journal of biological psychiatry : the official journal of the World Federation of Societies of Biological Psychiatry.

[7]  Christopher D. Adams Post-Conditioning Devaluation of an Instrumental Reinforcer has no Effect on Extinction Performance , 1980 .

[8]  J. O'Doherty,et al.  Differentiating neural systems mediating the acquisition vs. expression of goal‐directed and habitual behavioral control , 2015, The European journal of neuroscience.

[9]  B. Sahakian,et al.  Tryptophan depletion disinhibits punishment but not reward prediction: implications for resilience , 2011, Psychopharmacology.

[10]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[11]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[12]  A. Dickinson,et al.  Differential Engagement of the Ventromedial Prefrontal Cortex by Goal-Directed and Habitual Behavior toward Food Pictures in Humans , 2009, The Journal of Neuroscience.

[13]  T. Robbins,et al.  Reconciling the Role of Serotonin in Behavioral Inhibition and Aversion: Acute Tryptophan Depletion Abolishes Punishment-Induced Inhibition in Humans , 2009, The Journal of Neuroscience.

[14]  J. Herman,et al.  Neural regulation of endocrine and autonomic stress responses , 2009, Nature Reviews Neuroscience.

[15]  N. Fineberg,et al.  Pharmacotherapy of obsessive-compulsive disorder: Evidence-based treatment and beyond , 2013, The Australian and New Zealand journal of psychiatry.

[16]  B. Balleine,et al.  Amygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits , 2012, The Journal of Neuroscience.

[17]  Edward T. Bullmore,et al.  Drug research: A plan for mental illness , 2012, Nature.

[18]  X.L. Chen,et al.  Deep Brain Stimulation , 2013, Interventional Neurology.

[19]  Shinsuke Shimojo,et al.  Neural Computations Underlying Arbitration between Model-Based and Model-free Learning , 2013, Neuron.

[20]  H. Selye The evolution of the stress concept. , 1973, American scientist.

[21]  L. V. van Velzen,et al.  Response Inhibition and Interference Control in Obsessive–Compulsive Spectrum Disorders , 2014, Front. Hum. Neurosci..

[22]  M E Phelps,et al.  Systematic changes in cerebral glucose metabolic rate after successful behavior modification treatment of obsessive-compulsive disorder. , 1996, Archives of general psychiatry.

[23]  N. Daw,et al.  Valence-dependent influence of serotonin depletion on model-based choice strategy , 2015, Molecular Psychiatry.

[24]  K. N’diaye,et al.  Excessive checking for non-anxiogenic stimuli in obsessive-compulsive disorder , 2013, European Psychiatry.

[25]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[26]  B. Balleine,et al.  Associative learning mechanisms underpinning the transition from recreational drug use to addiction , 2013, Annals of the New York Academy of Sciences.

[27]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[28]  A. Arnsten Stress signalling pathways that impair prefrontal cortex structure and function , 2009, Nature Reviews Neuroscience.

[29]  M. Phillips,et al.  Distinct neural correlates of washing, checking, and hoarding symptom dimensions in obsessive-compulsive disorder. , 2004, Archives of general psychiatry.

[30]  Steven C. R. Williams,et al.  Neural correlates of anxiety associated with obsessive-compulsive symptom dimensions in normal volunteers , 2003, Biological Psychiatry.

[31]  Michael Davis,et al.  The amygdala: vigilance and emotion , 2001, Molecular Psychiatry.

[32]  E. Hollander,et al.  Is obsessive–compulsive disorder an anxiety disorder? , 2006, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[33]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[34]  Roshan Cools,et al.  Habitual versus Goal-directed Action Control in Parkinson Disease , 2011, Journal of Cognitive Neuroscience.

[35]  M. Iwakiri,et al.  Effects of behavior therapy on regional cerebral blood flow in obsessive–compulsive disorder , 2003, Psychiatry Research: Neuroimaging.

[36]  L. Deserno,et al.  Devaluation and sequential decisions: linking goal-directed and model-based behavior , 2014, Front. Hum. Neurosci..

[37]  On the role of US expectancies in avoidance behavior , 2008, Psychonomic bulletin & review.

[38]  T. Robbins,et al.  Drug addiction: bad habits add up , 1999, Nature.

[39]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[40]  T. Robbins,et al.  Disruption in the Balance Between Goal-Directed Behavior and Habit Learning in Obsessive-Compulsive Disorder , 2011, The American journal of psychiatry.

[41]  B. Balleine,et al.  Binge-Like Consumption of a Palatable Food Accelerates Habitual Control of Behavior and Is Dependent on Activation of the Dorsolateral Striatum , 2014, The Journal of Neuroscience.

[42]  B. Balleine,et al.  Impairments in Goal-Directed Actions Predict Treatment Response to Cognitive-Behavioral Therapy in Social Anxiety Disorder , 2014, PloS one.

[43]  N. Alpert,et al.  Regional cerebral blood flow measured during symptom provocation in obsessive-compulsive disorder using oxygen 15-labeled carbon dioxide and positron emission tomography. , 1994, Archives of general psychiatry.

[44]  T. Robbins,et al.  Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients , 2013, Translational Psychiatry.

[45]  M. Weissman,et al.  Social Phobia: Comorbidity and Morbidity in an Epidemiologic Sample , 1992 .

[46]  B. Sahakian,et al.  Which Is the Driver, the Obsessions or the Compulsions, in OCD? , 2015, Neuropsychopharmacology.

[47]  David M. Lovinger,et al.  It could be habit forming: drugs of abuse and striatal synaptic plasticity , 2003, Trends in Neurosciences.

[48]  I. Engelhard,et al.  Perseveration causes automatization of checking behavior in obsessive-compulsive disorder. , 2015, Behaviour research and therapy.

[49]  Trevor W Robbins,et al.  Lesions of the Medial Striatum in Monkeys Produce Perseverative Impairments during Reversal Learning Similar to Those Produced by Lesions of the Orbitofrontal Cortex , 2008, The Journal of Neuroscience.

[50]  M. Brammer,et al.  Methylphenidate Normalizes Fronto-Striatal Underactivation During Interference Inhibition in Medication-Naïve Boys with Attention-Deficit Hyperactivity Disorder , 2011, Neuropsychopharmacology.

[51]  K. R. Ridderinkhof,et al.  Corticostriatal Connectivity Underlies Individual Differences in the Balance between Habitual and Goal-Directed Action Control , 2012, The Journal of Neuroscience.

[52]  Christopher D. Adams,et al.  The Effect of the Instrumental Training Contingency on Susceptibility to Reinforcer Devaluation , 1983 .

[53]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[54]  P. Salkovskis,et al.  Obsessional-compulsive problems: a cognitive-behavioural analysis. , 1985, Behaviour research and therapy.

[55]  Barbara J. Sahakian,et al.  What do experts think we should do to achieve brain health? , 2014, Neuroscience & Biobehavioral Reviews.

[56]  R. Park,et al.  Compulsivity in anorexia nervosa: a transdiagnostic concept , 2014, Front. Psychol..

[57]  T. Robbins,et al.  Prefrontal Serotonin Depletion Affects Reversal Learning But Not Attentional Set Shifting , 2005, The Journal of Neuroscience.

[58]  S. Whiteside,et al.  A meta–analysis of functional neuroimaging in obsessive–compulsive disorder , 2004, Psychiatry Research: Neuroimaging.

[59]  A. Zapata,et al.  Shift from Goal-Directed to Habitual Cocaine Seeking after Prolonged Experience in Rats , 2010, The Journal of Neuroscience.

[60]  G. Feng,et al.  Optogenetic Stimulation of Lateral Orbitofronto-Striatal Pathway Suppresses Compulsive Behaviors , 2013, Science.

[61]  M. Vink,et al.  Deep brain stimulation restores frontostriatal network activity in obsessive-compulsive disorder , 2013, Nature Neuroscience.

[62]  H. Groenewegen,et al.  Does an imbalance between the dorsal and ventral striatopallidal systems play a role in Tourette's syndrome? A neuronal circuit approach , 2003, Brain and Development.

[63]  T. Robbins,et al.  Counterfactual Processing of Economic Action-Outcome Alternatives in Obsessive-Compulsive Disorder: Further Evidence of Impaired Goal-Directed Behavior , 2014, Biological Psychiatry.

[64]  A. Markman,et al.  The Curse of Planning: Dissecting Multiple Reinforcement-Learning Systems by Taxing the Central Executive , 2013 .

[65]  Melissa J. Green,et al.  Corticostriatal Control of Goal-Directed Action Is Impaired in Schizophrenia , 2015, Biological Psychiatry.

[66]  J. D. McGaugh,et al.  Amygdala modulation of hippocampal-dependent and caudate nucleus-dependent memory processes. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[68]  S. Killcross,et al.  Amphetamine Exposure Enhances Habit Formation , 2006, The Journal of Neuroscience.

[69]  R. Costa,et al.  Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions , 2013, Nature Communications.

[70]  Edward T. Bullmore,et al.  Brain functional connectivity in stimulant drug dependence and obsessive–compulsive disorder , 2012, NeuroImage.

[71]  J. Rapoport,et al.  Cerebral glucose metabolism in childhood-onset obsessive-compulsive disorder. , 1989, Archives of general psychiatry.

[72]  M. Kozak,et al.  Randomized, placebo-controlled trial of exposure and ritual prevention, clomipramine, and their combination in the treatment of obsessive-compulsive disorder. , 2007, The American journal of psychiatry.

[73]  M. D’Esposito,et al.  Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control , 2011, Biological Psychiatry.

[74]  J. Mazziotta,et al.  Caudate glucose metabolic rate changes with both drug and behavior therapy for obsessive-compulsive disorder. , 1992, Archives of general psychiatry.

[75]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[76]  B. Balleine Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits , 2005, Physiology & Behavior.

[77]  A. Faure,et al.  Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation , 2005, The Journal of Neuroscience.

[78]  P. Blier,et al.  Alteration of Serotonin Release in the Guinea Pig Orbito-Frontal Cortex by Selective Serotonin Reuptake Inhibitors , 1995, Neuropsychopharmacology.

[79]  A. Dickinson,et al.  Alcohol Seeking by Rats: Action or Habit? , 2002, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[80]  T. Robbins,et al.  Impaired cognitive flexibility and motor inhibition in unaffected first-degree relatives of patients with obsessive-compulsive disorder. , 2007, The American journal of psychiatry.

[81]  Christopher D. Adams Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[82]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[83]  K. Deisseroth,et al.  Repeated Cortico-Striatal Stimulation Generates Persistent OCD-Like Behavior , 2013, Science.

[84]  E. Foa,et al.  Continuous exposure and complete response prevention in the treatment of obsessive-compulsive neurosis , 1978 .

[85]  Y. D. van der Werf,et al.  Altered inhibition‐related frontolimbic connectivity in obsessive–compulsive disorder , 2015, Human brain mapping.

[86]  L. Schwabe,et al.  Stress Prompts Habit Behavior in Humans , 2009, The Journal of Neuroscience.

[87]  Nan M Laird,et al.  Familiality and heritability of binge eating disorder: results of a case-control family study and a twin study. , 2008, The International journal of eating disorders.

[88]  L. Koran,et al.  Obsessive-compulsive disorder (OCD) with schizotypy vs. schizophrenia with OCD: diagnostic dilemmas and therapeutic implications. , 2005, Journal of psychiatric research.

[89]  S. Holland,et al.  fMRI of neuronal activation with symptom provocation in unmedicated patients with obsessive compulsive disorder. , 2000, Journal of psychiatric research.

[90]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[91]  P. Dayan,et al.  Disorders of compulsivity: a common bias towards learning habits , 2014, Molecular Psychiatry.

[92]  B. Balleine,et al.  Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action , 2010, Neuropsychopharmacology.

[93]  R. Dolan,et al.  Dopamine Enhances Model-Based over Model-Free Choice Behavior , 2012, Neuron.

[94]  L. Schwabe,et al.  Concurrent Glucocorticoid and Noradrenergic Activity Shifts Instrumental Behavior from Goal-Directed to Habitual Control , 2010, The Journal of Neuroscience.

[95]  J. Deakin,et al.  The role of serotonin in reward, punishment and behavioural inhibition in humans: Insights from studies with acute tryptophan depletion , 2014, Neuroscience & Biobehavioral Reviews.

[96]  T. Robbins,et al.  Reliance on habits at the expense of goal-directed control following dopamine precursor depletion , 2011, Psychopharmacology.

[97]  B. Harvey,et al.  Animal models of obsessive-compulsive disorder: rationale to understanding psychobiology and pharmacology. , 2006, The Psychiatric clinics of North America.

[98]  M. Pessiglione,et al.  Similar Improvement of Reward and Punishment Learning by Serotonin Reuptake Inhibitors in Obsessive-Compulsive Disorder , 2012, Biological Psychiatry.

[99]  Nathaniel D. Daw,et al.  Cognitive Control Predicts Use of Model-based Reinforcement Learning , 2014, Journal of Cognitive Neuroscience.

[100]  V. Meyer,et al.  Modification of expectations in cases with obsessional rituals. , 1966, Behaviour research and therapy.

[101]  B. Balleine,et al.  The integrative function of the basal ganglia in instrumental conditioning , 2009, Behavioural Brain Research.

[102]  A. Dickinson,et al.  The neuropsychological basis of addictive behaviour , 2001, Brain Research Reviews.

[103]  T. Robbins,et al.  Inhibition and impulsivity: Behavioral and neural basis of response control , 2013, Progress in Neurobiology.

[104]  N. Sousa,et al.  Stress-induced changes in human decision-making are reversible , 2012, Translational Psychiatry.

[105]  S. Rauch,et al.  Deficits in conditioned fear extinction in obsessive-compulsive disorder and neurobiological changes in the fear circuit. , 2013, JAMA psychiatry.

[106]  Erno J. Hermans,et al.  From Specificity to Sensitivity: How Acute Stress Affects Amygdala Processing of Biologically Salient Stimuli , 2009, Biological Psychiatry.

[107]  T. Robbins,et al.  Functional neuroimaging of avoidance habits in obsessive-compulsive disorder. , 2015, The American journal of psychiatry.

[108]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[109]  Ann M Graybiel,et al.  Toward a Neurobiology of Obsessive-Compulsive Disorder , 2000, Neuron.

[110]  C. Kennard,et al.  A UK strategy for mental health and wellbeing , 2010, The Lancet.

[111]  Scott A Huettel,et al.  Abstinence-Induced Changes in Self-Report Craving Correlate with Event-Related fMRI Responses to Smoking Cues , 2005, Neuropsychopharmacology.

[112]  G. Feng,et al.  Striatal circuits, habits, and implications for obsessive–compulsive disorder , 2014, Current Opinion in Neurobiology.

[113]  M. Packard,et al.  Amygdala Is Critical for Stress-Induced Modulation of Hippocampal Long-Term Potentiation and Learning , 2001, The Journal of Neuroscience.

[114]  Y. D. van der Werf,et al.  Presupplementary motor area hyperactivity during response inhibition: a candidate endophenotype of obsessive-compulsive disorder. , 2012, The American journal of psychiatry.

[115]  T. Robbins,et al.  UvA-DARE ( Digital Academic Repository ) Tryptophan depletion promotes habitual over goal-directed control of appetitive responding in humans , 2015 .

[116]  T. Robbins,et al.  Enhanced Avoidance Habits in Obsessive-Compulsive Disorder , 2014, Biological Psychiatry.

[117]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[118]  R. Costa,et al.  Chronic Stress Causes Frontostriatal Reorganization and Affects Decision-Making , 2009, Science.

[119]  P. Blier,et al.  Mechanisms of action of current and potential pharmacotherapies of obsessive-compulsive disorder , 2006, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[120]  H. Berendse,et al.  Depression and impulse control disorders in Parkinson's disease: Two sides of the same coin? , 2014, Neuroscience & Biobehavioral Reviews.

[121]  W. Brown Animal Intelligence: Experimental Studies , 1912, Nature.

[122]  C. Büchel,et al.  Relevance of orbitofrontal neurochemistry for the outcome of cognitive-behavioural therapy in patients with obsessive–compulsive disorder , 2012, European Archives of Psychiatry and Clinical Neuroscience.

[123]  Guillén Fernández,et al.  Persistent and reversible consequences of combat stress on the mesofrontal circuit and cognition , 2012, Proceedings of the National Academy of Sciences.

[124]  G. V. van Wingen,et al.  Perceived threat predicts the neural sequelae of combat stress , 2011, Molecular Psychiatry.

[125]  Damiaan Denys,et al.  Deep Brain Stimulation , 2012 .

[126]  M. Bellgrove,et al.  Insights into the neural basis of response inhibition from cognitive and clinical neuroscience , 2009, Neuroscience & Biobehavioral Reviews.

[127]  G. Fernández,et al.  Acute Psychological Stress Reduces Working Memory-Related Activity in the Dorsolateral Prefrontal Cortex , 2009, Biological Psychiatry.

[128]  K. N’diaye,et al.  Decrease of Prefrontal Metabolism After Subthalamic Stimulation in Obsessive-Compulsive Disorder: A Positron Emission Tomography Study , 2010, Biological Psychiatry.

[129]  R. Dolan,et al.  Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making , 2015, Proceedings of the National Academy of Sciences.

[130]  N. Daw,et al.  Model-based learning protects against forming habits , 2015, Cognitive, Affective, & Behavioral Neuroscience.

[131]  M. Munafo,et al.  Acute alcohol impairs human goal-directed action , 2012, Biological Psychology.

[132]  Alice Y. Chiang,et al.  Working-memory capacity protects model-based learning from stress , 2013, Proceedings of the National Academy of Sciences.

[133]  L. Schwabe,et al.  Preventing the Stress-Induced Shift from Goal-Directed to Habit Action with a β-Adrenergic Antagonist , 2011, The Journal of Neuroscience.

[134]  C. Pittenger,et al.  Meta-analysis of the dose-response relationship of SSRI in obsessive-compulsive disorder , 2010, Molecular Psychiatry.

[135]  S. M. Stahl,et al.  Innovative solutions to novel drug development in mental health , 2013, Neuroscience & Biobehavioral Reviews.

[136]  S. Rachman,et al.  A cognitive theory of obsessions. , 1997, Behaviour research and therapy.

[137]  E. Bullmore,et al.  Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: The orbitofronto-striatal model revisited , 2008, Neuroscience & Biobehavioral Reviews.

[138]  B. Sahakian,et al.  Acute Tryptophan Depletion in Healthy Volunteers Enhances Punishment Prediction but Does not Affect Reward Prediction , 2008, Neuropsychopharmacology.

[139]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[140]  J. Buhmann,et al.  Dissecting psychiatric spectrum disorders by generative embedding☆☆☆ , 2013, NeuroImage: Clinical.

[141]  P. Janak,et al.  Habitual Alcohol Seeking: Time Course and the Contribution of Subregions of the Dorsal Striatum , 2012, Biological Psychiatry.

[142]  Guy B. Williams,et al.  Abnormal Brain Structure Implicated in Stimulant Drug Addiction , 2012, Science.

[143]  K. N’diaye,et al.  Dynamics of psychotherapy-related cerebral haemodynamic changes in obsessive compulsive disorder using a personalized exposure task in functional magnetic resonance imaging , 2013, Psychological Medicine.

[144]  Matthew D. Lieberman,et al.  Person-specific Theory of Mind in Medial pFC , 2015, Journal of Cognitive Neuroscience.

[145]  K. Jellinger,et al.  Brain dopamine and the syndromes of Parkinson and Huntington. Clinical, morphological and neurochemical correlations. , 1973, Journal of the neurological sciences.

[146]  T. Robbins,et al.  Goal-directed learning and obsessive–compulsive disorder , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[147]  T. Robbins,et al.  Punishment promotes response control deficits in obsessive-compulsive disorder: evidence from a motivational go/no-go task , 2012, Psychological Medicine.

[148]  Trevor W Robbins,et al.  Motor inhibition and cognitive flexibility in obsessive-compulsive disorder and trichotillomania. , 2006, The American journal of psychiatry.

[149]  M. Packard,et al.  Amygdala and “emotional” modulation of the relative use of multiple memory systems , 2004, Neurobiology of Learning and Memory.