Simultaneous Glucocorticoid and Noradrenergic Activity Disrupts the Neural Basis of Goal-Directed Action in the Human Brain

Stress promotes a shift from goal-directed action–outcome learning toward habitual stimulus–response learning. This shift is mediated by an interaction of noradrenergic activity and glucocorticoid stress hormones. In the present experiment, we examined the neural correlates of the stress (hormone)-induced shift from goal-directed to habit learning in the human brain. Healthy participants were administered hydrocortisone, the α2-adrenoceptor antagonist yohimbine, or both before they were trained in two instrumental actions leading to two distinct food rewards. After training, one of the rewards was devalued by feeding participants to satiety on that food. Finally, participants were presented the two instrumental actions in extinction. We collected functional magnetic resonance images both during instrumental training and during extinction testing. Our behavioral data confirmed that the simultaneous administration of hydrocortisone and yohimbine renders instrumental behavior insensitive to the outcome devaluation (and thus habitual), whereas hydrocortisone or yohimbine alone have no such effect. At the neural level, the combined administration of hydrocortisone and yohimbine reduced the sensitivity of the orbitofrontal and medial prefrontal cortex to changes in outcome value. Brain areas that have been previously implicated in habit learning were not modulated by hydrocortisone and yohimbine. These findings suggest that concurrent glucocorticoid and noradrenergic activity disrupts the neural bases of goal-directed action and thus renders behavior habitual.

[1]  Christopher D. Adams Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[2]  D. Charney,et al.  Noradrenergic function in panic anxiety. Effects of yohimbine in healthy subjects and patients with agoraphobia and panic disorder. , 1984, Archives of general psychiatry.

[3]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[4]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[5]  Rolf Steyer,et al.  Testtheoretische Analysen des Mehrdimensionalen Befindlichkeitsfragebogen (MDBF). , 1994 .

[6]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[7]  G A Hudgens,et al.  Salivary alpha-amylase as a measure of endogenous adrenergic activity. , 1996, Clinical physiology.

[8]  Gerald A. Hudgens,et al.  Salivary α‐amylase as a measure of endogenous adrenergic activity , 1996 .

[9]  B. Balleine,et al.  The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety , 1998 .

[10]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[11]  M. Le Moal,et al.  The role of stress in drug self-administration. , 1998, Trends in pharmacological sciences.

[12]  P. Björntorp,et al.  Journal of Clinical Endocrinology and Metabolism Printed in U.S.A. Copyright © 1998 by The Endocrine Society Stress-Related Cortisol Secretion in Men: Relationships with Abdominal Obesity and Endocrine, Metabolic and , 2022 .

[13]  T. Robbins,et al.  Drug addiction: bad habits add up , 1999, Nature.

[14]  D. M. Lyons,et al.  Glucocorticoid and mineralocorticoid receptor mRNA expression in squirrel monkey brain. , 2000, Journal of psychiatric research.

[15]  D. M. Lyons,et al.  Stress-Level Cortisol Treatment Impairs Inhibitory Control of Behavior in Monkeys , 2000, The Journal of Neuroscience.

[16]  M. Packard,et al.  Amygdala Is Critical for Stress-Induced Modulation of Hippocampal Long-Term Potentiation and Learning , 2001, The Journal of Neuroscience.

[17]  G. Schoenbaum,et al.  Encoding Predicted Outcome and Acquired Value in Orbitofrontal Cortex during Cue Sampling Depends upon Input from Basolateral Amygdala , 2003, Neuron.

[18]  J. O'Doherty,et al.  Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex , 2003, Science.

[19]  B. Balleine,et al.  Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats , 2003, The European journal of neuroscience.

[20]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[21]  J. Westermann,et al.  Determination of cortisol in saliva and serum by a luminescence-enhanced enzyme immunoassay. , 2004, Clinical laboratory.

[22]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[23]  S. Thorpe,et al.  The orbitofrontal cortex: Neuronal activity in the behaving monkey , 2004, Experimental Brain Research.

[24]  J. D. McGaugh,et al.  The Basolateral Amygdala Interacts with the Medial Prefrontal Cortex in Regulating Glucocorticoid Effects on Working Memory Impairment , 2004, The Journal of Neuroscience.

[25]  C. A. Morgan,et al.  Yohimbine — facilitated acoustic startle reflex in humans , 2005, Psychopharmacology.

[26]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[27]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[28]  B. Balleine,et al.  Lesions of Medial Prefrontal Cortex Disrupt the Acquisition But Not the Expression of Goal-Directed Learning , 2005, The Journal of Neuroscience.

[29]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[30]  J. D. McGaugh,et al.  Glucocorticoids interact with emotion-induced noradrenergic activation in influencing different memory functions , 2006, Neuroscience.

[31]  J. D. McGaugh,et al.  Glucocorticoid enhancement of memory requires arousal-induced noradrenergic activation in the basolateral amygdala. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[32]  E. Gordis,et al.  Salivary alpha-amylase in biobehavioral research: recent developments and applications. , 2007, Annals of the New York Academy of Sciences.

[33]  L. Schwabe,et al.  Stress modulates the use of spatial versus stimulus-response learning strategies in humans. , 2007, Learning & memory.

[34]  Rajita Sinha,et al.  The role of stress in addiction relapse , 2007, Current psychiatry reports.

[35]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[36]  Adam M. Campbell,et al.  The Temporal Dynamics Model of Emotional Memory Processing: A Synthesis on the Neurobiological Basis of Stress-Induced Amnesia, Flashbulb and Traumatic Memories, and the Yerkes-Dodson Law , 2007, Neural plasticity.

[37]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[38]  A. Arnsten Stress signalling pathways that impair prefrontal cortex structure and function , 2009, Nature Reviews Neuroscience.

[39]  L. Schwabe,et al.  Stress Prompts Habit Behavior in Humans , 2009, The Journal of Neuroscience.

[40]  R. Costa,et al.  Chronic Stress Causes Frontostriatal Reorganization and Affects Decision-Making , 2009, Science.

[41]  Ingo Aberle,et al.  Go no-go performance under psychosocial stress: Beneficial effects of implementation intentions , 2009, Neurobiology of Learning and Memory.

[42]  U. Nater,et al.  Salivary alpha-amylase as a non-invasive biomarker for the sympathetic nervous system: Current state of research , 2009, Psychoneuroendocrinology.

[43]  Lars Schwabe,et al.  Socially evaluated cold pressor stress after instrumental learning favors habits over goal-directed action , 2010, Psychoneuroendocrinology.

[44]  L. Schwabe,et al.  Concurrent Glucocorticoid and Noradrenergic Activity Shifts Instrumental Behavior from Goal-Directed to Habitual Control , 2010, The Journal of Neuroscience.

[45]  Lars Schwabe,et al.  Corticosteroids Operate as a Switch between Memory Systems , 2010, Journal of Cognitive Neuroscience.

[46]  Lars Schwabe,et al.  Memory formation under stress: Quantity and quality , 2010, Neuroscience & Biobehavioral Reviews.

[47]  B. Balleine,et al.  Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action , 2010, Neuropsychopharmacology.

[48]  L. Schwabe,et al.  Stress-induced modulation of instrumental behavior: From goal-directed to habitual control of action , 2011, Behavioural Brain Research.

[49]  L. Schwabe,et al.  Preventing the Stress-Induced Shift from Goal-Directed to Habit Action with a β-Adrenergic Antagonist , 2011, The Journal of Neuroscience.

[50]  L. Schwabe,et al.  Stress Modulates the Engagement of Multiple Memory Systems in Classification Learning , 2012, The Journal of Neuroscience.