Reward signals, attempted suicide, and impulsivity in late-life depression.

IMPORTANCE—Suicide can be viewed as an escape from unendurable punishment at the cost of any future rewards. Could faulty estimation of these outcomes predispose to suicidal behavior? In behavioral studies, many of those who have attempted suicide misestimate expected rewards on gambling and probabilistic learning tasks.OBJECTIVES—To describe the neural circuit abnormalities that underlie disadvantageous choices in people at risk for suicide and to relate these abnormalities to impulsivity, which is one of the components of vulnerability to suicide.DESIGN—Case-control functional magnetic resonance imaging study of reward learning using are inforcement learning model.SETTING—University hospital and outpatient clinic.PATIENTS—Fifty-three participants 60 years or older, including 15 depressed patients who had attempted suicide, 18 depressed patients who had never attempted suicide (depressed control subjects), and 20 psychiatrically healthy controls.MAIN OUTCOMES AND MEASURES—Components of the cortical blood oxygenation level–dependent response tracking expected and unpredicted rewards.RESULTS—Depressed elderly participants displayed 2 distinct disruptions of control over reward-guided behavior. First, impulsivity and a history of suicide attempts (particularly poorly planned ones) were associated with a weakened expected reward signal in the paralimbic cortex,which in turn predicted the behavioral insensitivity to contingency change. Second, depression was associated with disrupted corticostriatothalamic encoding of unpredicted rewards, which in turn predicted the behavioral over sensitivity to punishment. These results were robust to the effects of possible brain damage from suicide attempts, depressive severity, co-occurring substance use and anxiety disorders, antidepressant and anticholinergic exposure, lifetime exposure to electroconvulsive therapy, vascular illness, and incipient dementia.CONCLUSIONS AND RELEVANCE—Altered paralimbic reward signals and impulsivity and/or carelessness may facilitate unplanned suicidal acts. This pattern, also seen in gambling and cocaine use, may reflect a primary deficit in the paralimbic cortex or in its mesolimbic input. The over reactivity to punishment in depression may be caused in part by a disruption of appetitive learning in the corticostriatothalamic circuits.

[1]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[2]  Danielle van Westen,et al.  Size of basal ganglia in suicide attempters, and its association with temperament and serotonin transporter density , 2010, Psychiatry Research: Neuroimaging.

[3]  S. Strejilevich,et al.  Decision making in euthymic bipolar I and bipolar II disorders , 2010, Psychological Medicine.

[4]  R. E. Nelson,et al.  Selective recall of positive and negative feedback, self-control behaviors, and depression. , 1977, Journal of abnormal psychology.

[5]  W. Maier,et al.  Executive performance of depressed suicide attempters: the role of suicidal ideation , 2008, European Archives of Psychiatry and Clinical Neuroscience.

[6]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[7]  T. Robbins,et al.  Neuropsychological impairment in patients with major depressive disorder: the effects of feedback on task performance , 2003, Psychological Medicine.

[8]  K. Dujardin,et al.  A multicentre study on suicide outcomes following subthalamic stimulation for Parkinson's disease. , 2008, Brain : a journal of neurology.

[9]  H. Akiskal,et al.  Stable trait components of hopelessness: baseline and sensitivity to depression. , 1996, Journal of abnormal psychology.

[10]  G. Fénelon,et al.  Attempted and completed suicides after subthalamic nucleus stimulation for Parkinson’s disease , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[11]  B. Sahakian,et al.  Impairment in risk-sensitive decision-making in older suicide attempters with depression. , 2011, Psychology and aging.

[12]  M Tagliati,et al.  Subthalamic deep brain stimulation and impulse control in Parkinson’s disease , 2009, European journal of neurology.

[13]  Guy B. Williams,et al.  Neural basis of abnormal response to negative feedback in unmedicated mood disorders , 2008, NeuroImage.

[14]  M. Oquendo,et al.  Aggressiveness, not impulsiveness or hostility, distinguishes suicide attempters with major depression , 2006, Psychological Medicine.

[15]  R. Baumeister,et al.  Suicide as escape from self. , 1990, Psychological review.

[16]  T. Robbins,et al.  Abnormal response to negative feedback in unipolar depression: evidence for a diagnosis specific impairment , 1997, Journal of neurology, neurosurgery, and psychiatry.

[17]  Thomas E. Hazy,et al.  PVLV: the primary value and learned value Pavlovian learning algorithm. , 2007, Behavioral neuroscience.

[18]  H. Wagner,et al.  Performance feedback deficit in geriatric depression , 2001, Biological Psychiatry.

[19]  Timothy Edward John Behrens,et al.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[20]  Andrew J Lees,et al.  Intact Reward Learning but Elevated Delay Discounting in Parkinson's Disease Patients With Impulsive-Compulsive Spectrum Behaviors , 2010, Neuropsychopharmacology.

[21]  M. Farah,et al.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. , 2003, Brain : a journal of neurology.

[22]  A. McGirr,et al.  Impulsive-aggressive behaviours and completed suicide across the life cycle: a predisposition for younger age of suicide , 2007, Psychological Medicine.

[23]  M. Pérez-García,et al.  Neuropsychological profiling of impulsivity and compulsivity in cocaine dependent individuals , 2011, Psychopharmacology.

[24]  Peter Olausson,et al.  Impairments of Reversal Learning and Response Perseveration after Repeated, Intermittent Cocaine Administrations to Monkeys , 2002, Neuropsychopharmacology.

[25]  T. Robbins,et al.  Dissociable Contributions of the Orbitofrontal and Infralimbic Cortex to Pavlovian Autoshaping and Discrimination Reversal Learning: Further Evidence for the Functional Heterogeneity of the Rodent Frontal Cortex , 2003, The Journal of Neuroscience.

[26]  L. Siever,et al.  Suicide, impulsive aggression, and HTR1B genotype , 2001, Biological Psychiatry.

[27]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[28]  M. Leboyer,et al.  Impaired decision making in suicide attempters. , 2005, The American journal of psychiatry.

[29]  Christine L. Cox,et al.  Your Resting Brain CAREs about Your Risky Behavior , 2010, PloS one.

[30]  E. Rolls,et al.  Value, Pleasure and Choice in the Ventral Prefrontal Cortex , 2022 .

[31]  C. Büchel,et al.  Neural representations of subjective reward value , 2010, Behavioural Brain Research.

[32]  T. Robbins,et al.  Neuropsychological impairments in unipolar depression: the influence of perceived failure on subsequent performance , 1996, Psychological Medicine.

[33]  Markus Ullsperger,et al.  Adaptive Coding of Action Values in the Human Rostral Cingulate Zone , 2009, The Journal of Neuroscience.

[34]  P. Moberg,et al.  Association of dopamine agonist use with impulse control disorders in Parkinson disease. , 2006, Archives of neurology.

[35]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[36]  S. Maier,et al.  Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus , 2005, Nature Neuroscience.

[37]  B. D. Martino The Effect of Context on Choice and Value , 2012 .

[38]  Camelia M. Kuhnen,et al.  Variability in Nucleus Accumbens Activity Mediates Age-Related Suboptimal Financial Risk Taking , 2010, The Journal of Neuroscience.

[39]  A. Beck,et al.  Hopelessness and suicidal behavior. An overview. , 1975, JAMA.

[40]  M. Milders,et al.  Abnormal Temporal Difference Reward-learning Signals in Major Depression Department of Radiology And , 2022 .

[41]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[42]  J. Patton,et al.  Factor structure of the Barratt impulsiveness scale. , 1995, Journal of clinical psychology.

[43]  Maria A Oquendo,et al.  Aggressivity, suicide attempts, and depression: relationship to cerebrospinal fluid monoamine metabolite levels , 2001, Biological Psychiatry.

[44]  B. Sahakian,et al.  Lethal Forethought: Delayed Reward Discounting Differentiates High- and Low-Lethality Suicide Attempts in Old Age , 2011, Biological Psychiatry.

[45]  L. Fellows,et al.  Beyond Reversal: A Critical Role for Human Orbitofrontal Cortex in Flexible Learning from Probabilistic Feedback , 2010, The Journal of Neuroscience.

[46]  B. Balleine,et al.  Double Dissociation of Basolateral and Central Amygdala Lesions on the General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer , 2005, The Journal of Neuroscience.

[47]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[48]  T. Robbins,et al.  Response Perseveration in Stimulant Dependence Is Associated with Striatal Dysfunction and Can Be Ameliorated by a D2/3 Receptor Agonist , 2011, Biological Psychiatry.

[49]  Catherine A. Cole,et al.  The Orbitofrontal Cortex, Real‐World Decision Making, and Normal Aging , 2007, Annals of the New York Academy of Sciences.

[50]  Luke Clark,et al.  Gambling Severity Predicts Midbrain Response to Near-Miss Outcomes , 2010, The Journal of Neuroscience.

[51]  Mark Hallett,et al.  Impulsive choice and response in dopamine agonist-related impulse control behaviors , 2009, Psychopharmacology.

[52]  J. Mann,et al.  Attention deficit in depressed suicide attempters , 2008, Psychiatry Research.

[53]  E. Rolls,et al.  Reward-related Reversal Learning after Surgical Excisions in Orbito-frontal or Dorsolateral Prefrontal Cortex in Humans , 2004, Journal of Cognitive Neuroscience.

[54]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[55]  H. Sackeim,et al.  Neuropsychological dysfunction in depressed suicide attempters. , 2001, The American journal of psychiatry.

[56]  T. Robbins,et al.  Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans , 2008, Psychopharmacology.

[57]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[58]  C. Reynolds,et al.  High Levels of Hopelessness Persist in Geriatric Patients with Remitted Depression and a History of Attempted Suicide , 1998, Journal of the American Geriatrics Society.

[59]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[60]  Y. Conwell,et al.  Gambling and completed suicide in Hong Kong: a review of coroner court files. , 2010, Primary care companion to the Journal of clinical psychiatry.

[61]  Wim van den Brink,et al.  Response Perseveration and Ventral Prefrontal Sensitivity to Reward and Punishment in Male Problem Gamblers and Smokers , 2009, Neuropsychopharmacology.

[62]  Ramin V Parsey,et al.  Positron emission tomography of regional brain metabolic responses to a serotonergic challenge and lethality of suicide attempts in major depression. , 2003, Archives of general psychiatry.

[63]  P. Dayan,et al.  Human Pavlovian–Instrumental Transfer , 2008, The Journal of Neuroscience.

[64]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[65]  G. Turecki Dissecting the suicide phenotype: the role of impulsive-aggressive behaviours. , 2005, Journal of psychiatry & neuroscience : JPN.

[66]  Natalia S. Lawrence,et al.  Decreased activation of lateral orbitofrontal cortex during risky choices under uncertainty is associated with disadvantageous decision-making and suicidal behavior , 2010, NeuroImage.

[67]  J. Williams,et al.  Psychology and suicidal behaviour: elaborating the entrapment model , 2005 .

[68]  Edward T Bullmore,et al.  Probing Compulsive and Impulsive Behaviors, from Animal Models to Endophenotypes: A Narrative Review , 2010, Neuropsychopharmacology.

[69]  C F Reynolds,et al.  The temptation of suicide: striatal gray matter, discounting of delayed rewards, and suicide attempts in late-life depression , 2011, Psychological Medicine.

[70]  K. Hawton Prevention and treatment of suicidal behaviour: from science to practice , 2005 .

[71]  Donna J. Calu,et al.  Withdrawal from cocaine self-administration produces long-lasting deficits in orbitofrontal-dependent reversal learning in rats. , 2007, Learning & memory.

[72]  Matthew K Nock,et al.  Attentional bias toward suicide-related stimuli predicts suicidal behavior. , 2010, Journal of abnormal psychology.

[73]  P. Houck,et al.  When the solution is part of the problem: problem solving in elderly suicide attempters , 2009, International journal of geriatric psychiatry.

[74]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[75]  Raymond J. Dolan,et al.  Neuroscience of Preference and Choice , 2011 .

[76]  T. Robbins,et al.  Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[77]  Dirk Ifenthaler,et al.  Stochastic Models of Learning , 2012 .

[78]  M. Åsberg,et al.  Suicidal behavior and cognitive flexibility: design and verbal fluency after attempted suicide. , 1990, Suicide & life-threatening behavior.

[79]  L. Clark,et al.  Deterministic learning and attempted suicide among older depressed individuals: cognitive assessment using the Wisconsin Card Sorting Task. , 2012, Journal of psychiatric research.

[80]  Michael J. Frank,et al.  Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism , 2007, Science.

[81]  M. Roesch,et al.  Neural Correlates of Inflexible Behavior in the Orbitofrontal–Amygdalar Circuit after Cocaine Exposure , 2007, Annals of the New York Academy of Sciences.

[82]  H. Corrêa,et al.  Suicide behavior and neuropsychological assessment of type I bipolar patients. , 2009, Journal of affective disorders.

[83]  D. Dougherty,et al.  Increased impulsivity associated with severity of suicide attempt history in patients with bipolar disorder. , 2005, The American journal of psychiatry.

[84]  A. Beck,et al.  Classification of suicidal behaviors: I. Quantifying intent and medical lethality. , 1975, The American journal of psychiatry.

[85]  G. Waiter,et al.  Expected value and prediction error abnormalities in depression and schizophrenia. , 2011, Brain : a journal of neurology.

[86]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[87]  Luke Clark,et al.  Reward/Punishment reversal learning in older suicide attempters. , 2010, The American journal of psychiatry.

[88]  L. Vijayakumar,et al.  Substance use and suicide , 2011, Current opinion in psychiatry.

[89]  C. Benkelfat,et al.  α-[11C]Methyl-l-tryptophan trapping in the orbital and ventral medial prefrontal cortex of suicide attempters , 2006, European Neuropsychopharmacology.

[90]  James M Provenzale,et al.  MRI correlates of suicide attempt history in unipolar depression , 2001, Biological Psychiatry.

[91]  G. Campanella,et al.  Suicide risk in Huntington's disease. , 1993, Journal of medical genetics.

[92]  E. Foncke,et al.  Suicide after deep brain stimulation of the internal globus pallidus for dystonia , 2006, Neurology.

[93]  F. Rasmussen,et al.  Low intelligence test scores in 18 year old men and risk of suicide: cohort study , 2004, BMJ : British Medical Journal.