Impaired adaptation of learning to contingency volatility in internalizing psychopathology

Using a contingency volatility manipulation, we tested the hypothesis that difficulty adapting probabilistic decision-making to second-order uncertainty might reflect a core deficit that cuts across anxiety and depression and holds regardless of whether outcomes are aversive or involve reward gain or loss. We used bifactor modeling of internalizing symptoms to separate symptom variance common to both anxiety and depression from that unique to each. Across two experiments, we modeled performance on a probabilistic decision-making under volatility task using a hierarchical Bayesian framework. Elevated scores on the common internalizing factor, with high loadings across anxiety and depression items, were linked to impoverished adjustment of learning to volatility regardless of whether outcomes involved reward gain, electrical stimulation, or reward loss. In particular, high common factor scores were linked to dampened learning following better-than-expected outcomes in volatile environments. No such relationships were observed for anxiety- or depression-specific symptom factors.

[1]  Rebecca L. Bond,et al.  Altered learning under uncertainty in unmedicated mood and anxiety disorders , 2019, Nature Human Behaviour.

[2]  O. Robinson,et al.  Learning and Choice in Mood Disorders: Searching for the Computational Parameters of Anhedonia , 2017, Computational Psychiatry.

[3]  P. Dayan,et al.  Modeling Avoidance in Mood and Anxiety Disorders Using Reinforcement Learning , 2017, Biological Psychiatry.

[4]  M. Browning,et al.  Affective bias as a rational response to the statistics of rewards and punishments , 2017, eLife.

[5]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[6]  Mathias Pessiglione,et al.  Opponent Brain Systems for Reward and Punishment Learning: Causal Evidence From Drug and Lesion Studies in Humans , 2017 .

[7]  Cheng-Hsien Li Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares , 2016, Behavior research methods.

[8]  P. Dayan,et al.  Striatal structure and function predict individual biases in learning to avoid pain , 2016, Proceedings of the National Academy of Sciences.

[9]  John Salvatier,et al.  Probabilistic programming in Python using PyMC3 , 2016, PeerJ Comput. Sci..

[10]  P. Dayan,et al.  Depression: a decision-theoretic analysis. , 2015, Annual review of neuroscience.

[11]  Sylvia M. L. Cox,et al.  Striatal D1 and D2 signaling differentially predict learning from positive and negative outcomes , 2015, NeuroImage.

[12]  Timothy E. J. Behrens,et al.  Anxious individuals have difficulty learning the causal statistics of aversive environments , 2015, Nature Neuroscience.

[13]  C. H. Donahue,et al.  Dynamic Routing of Task-relevant Signals for Decision Making in Dorsolateral Prefrontal Cortex , 2015, Nature Neuroscience.

[14]  P. Hewson Bayesian Data Analysis 3rd edn A. Gelman, J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari and D. B. Rubin, 2013 Boca Raton, Chapman and Hall–CRC 676 pp., £44.99 ISBN 1‐439‐84095‐4 , 2015 .

[15]  K. Sakai,et al.  Autonomous Mechanism of Internal Choice Estimate Underlies Decision Inertia , 2014, Neuron.

[16]  Peter Bossaerts,et al.  The Neural Representation of Unexpected Uncertainty during Value-Based Decision Making , 2013, Neuron.

[17]  James F. Boswell,et al.  Intolerance of uncertainty: a common factor in the treatment of emotional disorders. , 2013, Journal of clinical psychology.

[18]  S. Reise The Rediscovery of Bifactor Measurement Models , 2012 .

[19]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[20]  R. Carleton,et al.  Increasingly certain about uncertainty: Intolerance of uncertainty across anxiety and depression. , 2012, Journal of anxiety disorders.

[21]  Emily Bell,et al.  Striatal topography of probability and magnitude information for decisions under uncertainty , 2012, NeuroImage.

[22]  Steven P Reise,et al.  Invited Paper: The Rediscovery of Bifactor Measurement Models. , 2012, Multivariate behavioral research.

[23]  Ian M Goodyer,et al.  General and specific components of depression and anxiety in an adolescent population , 2011, BMC psychiatry.

[24]  A. M. Ruscio,et al.  A meta-analysis of the relation of intolerance of uncertainty to symptoms of generalized anxiety disorder, major depressive disorder, and obsessive-compulsive disorder. , 2011, Clinical psychology review.

[25]  Peter M. Bentler,et al.  Exploratory Bi-Factor Analysis , 2011, Psychometrika.

[26]  N. Daw,et al.  Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction , 2011, The Journal of Neuroscience.

[27]  R. Dolan,et al.  The Known Unknowns: Neural Representation of Second-Order Uncertainty, and Ambiguity , 2011, The Journal of Neuroscience.

[28]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[29]  Sumio Watanabe,et al.  Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory , 2010, J. Mach. Learn. Res..

[30]  P. Dayan,et al.  Opponency Revisited: Competition and Cooperation Between Dopamine and Serotonin , 2010, Neuropsychopharmacology.

[31]  K. Doya,et al.  Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia , 2009, The Journal of Neuroscience.

[32]  A. Beck,et al.  Common and Specific Dimensions of Self-Reported Anxiety and Depression in Adolescent Outpatients , 2008 .

[33]  David Watson,et al.  Parsing the general and specific components of depression and anxiety with bifactor modeling , 2008, Depression and anxiety.

[34]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[35]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[36]  Klaus P. Ebmeier,et al.  Blunted response to feedback information in depressive illness. , 2007, Brain : a journal of neurology.

[37]  C. Grillon,et al.  Classical fear conditioning in the anxiety disorders: a meta-analysis. , 2005, Behaviour research and therapy.

[38]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[39]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[40]  R. Ladouceur,et al.  Intolerance of Uncertainty and Worry: Investigating Specificity in a Nonclinical Sample , 2001, Cognitive Therapy and Research.

[41]  R A Steer,et al.  Common and specific dimensions of self-reported anxiety and depression: the BDI-II versus the BDI-IA. , 1999, Behaviour research and therapy.

[42]  M. Freeston,et al.  Generalized anxiety disorder: a preliminary test of a conceptual model. , 1998, Behaviour research and therapy.

[43]  T. Robbins,et al.  Abnormal response to negative feedback in unipolar depression: evidence for a diagnosis specific impairment , 1997, Journal of neurology, neurosurgery, and psychiatry.

[44]  D. Barlow,et al.  Structure of anxiety and the anxiety disorders: a hierarchical model. , 1996, Journal of abnormal psychology.

[45]  R A Steer,et al.  Common and specific dimensions of self-reported anxiety and depression: a replication. , 1995, Journal of abnormal psychology.

[46]  F. Floyd,et al.  Factor analysis in the development and refinement of clinical assessment instruments. , 1995 .

[47]  Robert Ladouceur,et al.  Why do people worry , 1994 .

[48]  A. Beck,et al.  Common and specific dimensions of self-reported anxiety and depression: implications for the cognitive and tripartite models. , 1994, Journal of abnormal psychology.

[49]  Karl G. Jöreskog,et al.  On the estimation of polychoric correlations and their asymptotic covariance matrix , 1994 .

[50]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[51]  D. Watson,et al.  Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. , 1991, Journal of abnormal psychology.

[52]  T J Meyer,et al.  Development and validation of the Penn State Worry Questionnaire. , 1990, Behaviour research and therapy.

[53]  C. Spielberger,et al.  Manual for the state-trait anxiety inventory (form Y) : "self-evaluation questionnaire" , 1983 .

[54]  L. Radloff The CES-D Scale , 1977 .

[55]  G. Claridge Manual of the Eysenck personality questionnaire (junior and adult): H. J. Eysenck and Sybil Eysenck Hodder and Stoughton (1975). 47 pp., together with test blanks and scoring keys for junior and adult versions. Specimen set £1.80 , 1977 .

[56]  Richard G. Montanelli,et al.  An Investigation of the Parallel Analysis Criterion for Determining the Number of Common Factors , 1975 .

[57]  J. Horn A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[58]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[59]  John Schmid,et al.  The development of hierarchical factor solutions , 1957 .

[60]  Herman Rubin,et al.  Statistical Inference in Factor Analysis , 1956 .