Corticolimbic catecholamines in stress: a computational model of the appraisal of controllability

Appraisal of a stressful situation and the possibility to control or avoid it is thought to involve frontal-cortical mechanisms. The precise mechanism underlying this appraisal and its translation into effective stress coping (the regulation of physiological and behavioural responses) are poorly understood. Here, we propose a computational model which involves tuning motivational arousal to the appraised stressing condition. The model provides a causal explanation of the shift from active to passive coping strategies, i.e. from a condition characterised by high motivational arousal, required to deal with a situation appraised as stressful, to a condition characterised by emotional and motivational withdrawal, required when the stressful situation is appraised as uncontrollable/unavoidable. The model is motivated by results acquired via microdialysis recordings in rats and highlights the presence of two competing circuits dominated by different areas of the ventromedial prefrontal cortex: these are shown having opposite effects on several subcortical areas, affecting dopamine outflow in the striatum, and therefore controlling motivation. We start by reviewing published data supporting structure and functioning of the neural model and present the computational model itself with its essential neural mechanisms. Finally, we show the results of a new experiment, involving the condition of repeated inescapable stress, which validate most of the model’s predictions.

[1]  M. Coltheart Hemispheric asymmetry , 1978, Nature.

[2]  L. Swanson The Rat Brain in Stereotaxic Coordinates, George Paxinos, Charles Watson (Eds.). Academic Press, San Diego, CA (1982), vii + 153, $35.00, ISBN: 0 125 47620 5 , 1984 .

[3]  G. Glavin Stress and brain noradrenaline: A review , 1985, Neuroscience & Biobehavioral Reviews.

[4]  H. Groenewegen,et al.  Efferent connections of the prelimbic (area 32) and the infralimbic (area 25) cortices: An anterograde tracing study in the cat , 1985, The Journal of comparative neurology.

[5]  S. Folkman,et al.  Dynamics of a stressful encounter: cognitive appraisal, coping, and encounter outcomes. , 1986, Journal of personality and social psychology.

[6]  E. Abercrombie,et al.  Differential Effect of Stress on In Vivo Dopamine Release in Striatum, Nucleus Accumbens, and Medial Frontal Cortex , 1989, Journal of neurochemistry.

[7]  S. Cabib,et al.  Acute stress induces time-dependent responses in dopamine mesolimbic system , 1991, Brain Research.

[8]  R. Vertes A PHA‐L analysis of ascending projections of the dorsal raphe nucleus in the rat , 1991, The Journal of comparative neurology.

[9]  A. Imperato,et al.  Repeated stressful experiences differently affect limbic dopamine release during and following stress , 1992, Brain Research.

[10]  M. Meaney,et al.  The role of the medial prefrontal cortex (cingulate gyrus) in the regulation of hypothalamic-pituitary-adrenal responses to stress , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  R. Lazarus Coping theory and research: past, present, and future. , 1993, Psychosomatic medicine.

[12]  Stefano Puglisi-Allegra,et al.  Repeated stressful experiences differently affect the time-dependent responses of the mesolimbic dopamine system to the stressor , 1993, Brain Research.

[13]  S. Cabib,et al.  Opposite responses of mesolimbic dopamine system to controllable and uncontrollable aversive experiences , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Peter W. Kalivas,et al.  Selective activation of dopamine transmission in the shell of the nucleus accumbens by stress , 1995, Brain Research.

[15]  David M. Tate,et al.  A genetic algorithm approach to curve fitting , 1995 .

[16]  D. Joel,et al.  The connections of the primate subthalamic nucleus: indirect pathways and the open-interconnected scheme of basal ganglia-thalamocortical circuitry , 1997, Brain Research Reviews.

[17]  S. R. Nash,et al.  Dopamine receptors: from structure to function. , 1998, Physiological reviews.

[18]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[19]  Isaac Abrahams,et al.  The use of genetic algorithms in the non-linear regression of immittance data , 1998 .

[20]  Jean-Marc Fellous,et al.  Computational Models of Neuromodulation , 1998, Neural Computation.

[21]  M. Barrot,et al.  Functional heterogeneity in dopamine release and in the expression of Fos‐like proteins within the rat striatal complex , 1999, The European journal of neuroscience.

[22]  B. Moghaddam,et al.  Dopaminergic Innervation of the Amygdala Is Highly Responsive to Stress , 1999, Journal of neurochemistry.

[23]  E. Rüther,et al.  The stress-reaction process and the adaptive modification and reorganization of neuronal networks , 1999, Psychiatry Research.

[24]  F. Zhou,et al.  Dopamine modulation of membrane and synaptic properties of interneurons in rat cerebral cortex. , 1999, Journal of neurophysiology.

[25]  Jonathan D. Cohen,et al.  Role of locus coeruleus in attention and behavioral flexibility , 1999, Biological Psychiatry.

[26]  S. Haber,et al.  The central nucleus of the amygdala projection to dopamine subpopulations in primates , 2000, Neuroscience.

[27]  P. Gisquet-Verrier,et al.  Functional role of rat prelimbic-infralimbic cortices in spatial memory: evidence for their involvement in attention and behavioural flexibility , 2000, Behavioural Brain Research.

[28]  M. Barrot,et al.  The dopaminergic hyper‐responsiveness of the shell of the nucleus accumbens is hormone‐dependent , 2000, The European journal of neuroscience.

[29]  N. Osborne,et al.  Betaxolol, a beta(1)-adrenoceptor antagonist, reduces Na(+) influx into cortical synaptosomes by direct interaction with Na(+) channels: comparison with other beta-adrenoceptor antagonists. , 2000, British journal of pharmacology.

[30]  B. Lewis,et al.  Ventral tegmental area afferents to the prefrontal cortex maintain membrane potential 'up' states in pyramidal neurons via D(1) dopamine receptors. , 2000, Cerebral cortex.

[31]  N. Osborne,et al.  Betaxolol, a β1‐adrenoceptor antagonist, reduces Na+ influx into cortical synaptosomes by direct interaction with Na+ channels: comparison with other β‐adrenoceptor antagonists , 2000 .

[32]  S. Sesack,et al.  Projections from the Rat Prefrontal Cortex to the Ventral Tegmental Area: Target Specificity in the Synaptic Associations with Mesoaccumbens and Mesocortical Neurons , 2000, The Journal of Neuroscience.

[33]  Michael Davis,et al.  The amygdala: vigilance and emotion , 2001, Molecular Psychiatry.

[34]  M. Jackson,et al.  Stimulation of prefrontal cortex at physiologically relevant frequencies inhibits dopamine release in the nucleus accumbens , 2001, Journal of neurochemistry.

[35]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[36]  R. Bandler,et al.  Parallel circuits mediating distinct emotional coping reactions to different types of stress , 2001, Neuroscience & Biobehavioral Reviews.

[37]  E. V. Van Bockstaele,et al.  Opposing regulation of the locus coeruleus by corticotropin-releasing factor and opioids , 2001, Psychopharmacology.

[38]  E. V. Bockstaele,et al.  Topographic architecture of stress-related pathways targeting the noradrenergic locus coeruleus , 2001, Physiology & Behavior.

[39]  R. Sullivan,et al.  Behavioral effects of excitotoxic lesions of ventral medial prefrontal cortex in the rat are hemisphere-dependent , 2002, Brain Research.

[40]  Jonathan D. Cohen,et al.  Computational perspectives on dopamine function in prefrontal cortex , 2002, Current Opinion in Neurobiology.

[41]  G. Quirk Memory for extinction of conditioned fear is long-lasting and persists following spontaneous recovery. , 2002, Learning & memory.

[42]  A. Phillips,et al.  Modulation by Central and Basolateral Amygdalar Nuclei of Dopaminergic Correlates of Feeding to Satiety in the Rat Nucleus Accumbens and Medial Prefrontal Cortex , 2002, The Journal of Neuroscience.

[43]  S. Cabib,et al.  Genetic susceptibility of mesocortical dopamine to stress determines liability to inhibition of mesoaccumbens dopamine and to behavioral ‘despair’ in a mouse model of depression , 2002, Neuroscience.

[44]  S. Cabib,et al.  Opposite imbalances between mesocortical and mesoaccumbens dopamine responses to stress by the same genotype depending on living conditions , 2002, Behavioural Brain Research.

[45]  R. Valentino,et al.  Corticotropin‐Releasing Factor Neurones of the Central Nucleus of the Amygdala Mediate Locus Coeruleus Activation by Cardiovascular Stress , 2002, Journal of neuroendocrinology.

[46]  S. Maier,et al.  Stressor Controllability Modulates Stress-Induced Dopamine and Serotonin Efflux and Morphine-Induced Serotonin Efflux in the Medial Prefrontal Cortex , 2003, Neuropsychopharmacology.

[47]  J. Salamone,et al.  Nucleus Accumbens Dopamine and the Regulation of Effort in Food-Seeking Behavior: Implications for Studies of Natural Motivation, Psychiatry, and Drug Abuse , 2003, Journal of Pharmacology and Experimental Therapeutics.

[48]  S. Maier,et al.  Stressor controllability modulates stress‐induced serotonin but not dopamine efflux in the nucleus accumbens shell , 2003, Synapse.

[49]  A. Phillips,et al.  Independent modulation of basal and feeding-evoked dopamine efflux in the nucleus accumbens and medial prefrontal cortex by the central and basolateral amygdalar nuclei in the rat , 2003, Neuroscience.

[50]  J. Fudge,et al.  The extended amygdala and the dopamine system: another piece of the dopamine puzzle. , 2003, The Journal of neuropsychiatry and clinical neurosciences.

[51]  C. Berridge,et al.  The locus coeruleus–noradrenergic system: modulation of behavioral state and state-dependent cognitive processes , 2003, Brain Research Reviews.

[52]  S. Onat,et al.  Phasic Activation of Locus Ceruleus Neurons by the Central Nucleus of the Amygdala , 2003, The Journal of Neuroscience.

[53]  A. Grace,et al.  Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission , 2003, Nature Neuroscience.

[54]  S. Killcross,et al.  Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats , 2003, Behavioural Brain Research.

[55]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[56]  G. Quirk,et al.  Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex. , 2004, Learning & memory.

[57]  R. Sullivan,et al.  Hemispheric Asymmetry in Stress Processing in Rat Prefrontal Cortex and the Role of Mesocortical Dopamine , 2004, Stress.

[58]  Jennifer C. Britton,et al.  Neural correlates of individual ratings of emotional salience: a trial-related fMRI study , 2004, NeuroImage.

[59]  H. Eriksen,et al.  The cognitive activation theory of stress , 2004, Psychoneuroendocrinology.

[60]  Simon Killcross,et al.  Lesions of rat infralimbic cortex enhance recovery and reinstatement of an appetitive Pavlovian response. , 2004, Learning & memory.

[61]  R. Vertes Differential projections of the infralimbic and prelimbic cortex in the rat , 2004, Synapse.

[62]  A. Grace,et al.  Corticotropin-Releasing Hormone Directly Activates Noradrenergic Neurons of the Locus Ceruleus Recorded In Vitro , 2004, The Journal of Neuroscience.

[63]  G. Chiara,et al.  Mianserin markedly and selectively increases extracellular dopamine in the prefrontal cortex as compared to the nucleus accumbens of the rat , 2005, Psychopharmacology.

[64]  G. Chiara,et al.  On the preferential release of dopamine in the nucleus accumbens by amphetamine: further evidence obtained by vertically implanted concentric dialysis probes , 2005, Psychopharmacology.

[65]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[66]  S. Maier,et al.  Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus , 2005, Nature Neuroscience.

[67]  H. Anisman,et al.  Stress, depression, and anhedonia: Caveats concerning animal models , 2005, Neuroscience & Biobehavioral Reviews.

[68]  James P. Herman,et al.  Limbic system mechanisms of stress regulation: Hypothalamo-pituitary-adrenocortical axis , 2005, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[69]  S. Maier,et al.  Stressor controllability and learned helplessness: The roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor , 2005, Neuroscience & Biobehavioral Reviews.

[70]  M. Walton,et al.  Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine , 2007, Psychopharmacology.

[71]  P. Gisquet-Verrier,et al.  The role of the rat prelimbic/infralimbic cortex in working memory: Not involved in the short-term maintenance but in monitoring and processing functions , 2006, Neuroscience.

[72]  J. Salamone,et al.  Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits , 2007, Psychopharmacology.

[73]  Paul E. Sawchenko,et al.  Regional Differentiation of the Medial Prefrontal Cortex in Regulating Adaptive Responses to Acute Emotional Stress , 2006, The Journal of Neuroscience.

[74]  P. Balsam,et al.  Mice with Chronically Elevated Dopamine Exhibit Enhanced Motivation, but not Learning, for a Food Reward , 2006, Neuropsychopharmacology.

[75]  S. Rauch,et al.  Microstimulation reveals opposing influences of prelimbic and infralimbic cortex on the expression of conditioned fear. , 2006, Learning & memory.

[76]  Elyssa B. Margolis,et al.  Kappa opioids selectively control dopaminergic neurons projecting to the prefrontal cortex. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[77]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[78]  Richard J. Davidson,et al.  Individual Differences in the Effects of Perceived Controllability on Pain Perception: Critical Role of the Prefrontal Cortex , 2007, Journal of Cognitive Neuroscience.

[79]  Şenol Erdoğmuş,et al.  Genetic algorithms in parameter estimation for nonlinear regression models: an experimental approach , 2007 .

[80]  M. Sarter,et al.  Modulators in concert for cognition: Modulator interactions in the prefrontal cortex , 2007, Progress in Neurobiology.

[81]  A. Kelley,et al.  Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding , 2007, Psychopharmacology.

[82]  Stefano Puglisi-Allegra,et al.  The medial prefrontal cortex determines the accumbens dopamine response to stress through the opposing influences of norepinephrine and dopamine. , 2007, Cerebral cortex.

[83]  A. Gratton,et al.  Medial prefrontal cortical alpha1 adrenoreceptor modulation of the nucleus accumbens dopamine response to stress in Long–Evans rats , 2007, Psychopharmacology.

[84]  D. S. Zahm,et al.  Glutamatergic Afferents of the Ventral Tegmental Area in the Rat , 2007, The Journal of Neuroscience.

[85]  S. Amir,et al.  Corticotropin-releasing factor projections from limbic forebrain and paraventricular nucleus of the hypothalamus to the region of the ventral tegmental area , 2007, Neuroscience.

[86]  A. Grace,et al.  Regulation of firing of dopaminergic neurons and control of goal-directed behaviors , 2007, Trends in Neurosciences.

[87]  Jens C. Pruessner,et al.  Deactivation of the Limbic System During Acute Psychosocial Stress: Evidence from Positron Emission Tomography and Functional Magnetic Resonance Imaging Studies , 2008, Biological Psychiatry.

[88]  Stan B. Floresco,et al.  Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making , 2008, Cognitive, affective & behavioral neuroscience.

[89]  S. Lammel,et al.  Unique Properties of Mesoprefrontal Neurons within a Dual Mesocorticolimbic Dopamine System , 2008, Neuron.

[90]  G. Quirk,et al.  Neural Mechanisms of Extinction Learning and Retrieval , 2008, Neuropsychopharmacology.

[91]  M. Furey,et al.  Brain structural and functional abnormalities in mood disorders: implications for neurocircuitry models of depression , 2008, Brain Structure and Function.

[92]  Tetsuya Iidaka,et al.  Imaging brain and immune association accompanying cognitive appraisal of an acute stressor , 2008, NeuroImage.

[93]  Huibert D. Mansvelder,et al.  Prelimbic and Infralimbic Prefrontal Cortex Interact during Fast Network Oscillations , 2008, PloS one.

[94]  P. Sawchenko,et al.  Noradrenergic Innervation of the Dorsal Medial Prefrontal Cortex Modulates Hypothalamo-Pituitary-Adrenal Responses to Acute Emotional Stress , 2008, The Journal of Neuroscience.

[95]  Brent L. Hughes,et al.  Prefrontal-Subcortical Pathways Mediating Successful Emotion Regulation , 2008, Neuron.

[96]  J. Deniau,et al.  Dopamine modulates temporal dynamics of feedforward inhibition in rat prefrontal cortex in vivo. , 2008, Cerebral cortex.

[97]  E. Coutureau,et al.  Goal-directed responding is sensitive to lesions to the prelimbic cortex or basolateral nucleus of the amygdala but not to their disconnection. , 2009, Behavioral neuroscience.

[98]  A. Arnsten Stress signalling pathways that impair prefrontal cortex structure and function , 2009, Nature Reviews Neuroscience.

[99]  R. F. Tavares,et al.  Opposite role of infralimbic and prelimbic cortex in the tachycardiac response evoked by acute restraint stress in rats , 2009, Journal of neuroscience research.

[100]  P. Sawchenko,et al.  A Discrete GABAergic Relay Mediates Medial Prefrontal Cortical Inhibition of the Neuroendocrine Stress Response , 2009, The Journal of Neuroscience.

[101]  G. Koob,et al.  Brain stress systems in the amygdala and addiction , 2009, Brain Research.

[102]  J. Peters,et al.  Extinction circuits for fear and addiction overlap in prefrontal cortex. , 2009, Learning & memory.

[103]  Nagalingam Rajakumar,et al.  Prefrontal cortical D1 dopamine receptors modulate subcortical D2 dopamine receptor-mediated stress responsiveness. , 2009, The international journal of neuropsychopharmacology.

[104]  Francisco Sotres-Bayon,et al.  Prefrontal control of fear: more than just extinction , 2010, Current Opinion in Neurobiology.

[105]  William H. Alexander,et al.  Computational Models of Performance Monitoring and Cognitive Control , 2010, Top. Cogn. Sci..

[106]  R. Kötter,et al.  Connecting Mean Field Models of Neural Activity to EEG and fMRI Data , 2010, Brain Topography.

[107]  S. Maier,et al.  Role of the medial prefrontal cortex in coping and resilience , 2010, Brain Research.

[108]  S. Sesack,et al.  Periaqueductal gray afferents synapse onto dopamine and GABA neurons in the rat ventral tegmental area , 2009, Journal of neuroscience research.

[109]  Francesco Mannella,et al.  The roles of the amygdala in the affective regulation of body, brain, and behaviour , 2010, Connect. Sci..

[110]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[111]  J. Nacher,et al.  Chronic stress induces changes in the structure of interneurons and in the expression of molecules related to neuronal structural plasticity and inhibitory neurotransmission in the amygdala of adult mice , 2011, Experimental Neurology.

[112]  G. Quirk,et al.  Fear extinction as a model for translational neuroscience: ten years of progress. , 2012, Annual review of psychology.

[113]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[114]  S. Cabib,et al.  The mesoaccumbens dopamine in coping with stress , 2012, Neuroscience & Biobehavioral Reviews.

[115]  Karl J. Friston,et al.  Computational psychiatry (vol 16, pg 72, 2012) , 2012 .

[116]  J. Nacher,et al.  Chronic stress alters inhibitory networks in the medial prefrontal cortex of adult mice , 2012, Brain Structure and Function.

[117]  Sachie K. Ogawa,et al.  Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons , 2012, Neuron.

[118]  K. Gurney,et al.  The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis , 2013, Front. Behav. Neurosci..

[119]  Francesco Mannella,et al.  Intrinsically motivated action-outcome learning and goal-based action recall: a system-level bio-constrained computational model. , 2013, Neural networks : the official journal of the International Neural Network Society.

[120]  Raymond J. Dolan,et al.  Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot , 2014, Front. Psychol..