Decision-Theoretic Psychiatry

Psychiatric disorders profoundly impair many aspects of decision making. Poor choices have negative consequences in the moment and make it very hard to navigate complex social environments. Computational neuroscience provides normative, neurobiologically informed descriptions of the components of decision making that serve as a platform for a principled exploration of dysfunctions. Here, we identify and discuss three classes of failure modes arising in these formalisms. They stem from abnormalities in the framing of problems or tasks, from the mechanisms of cognition used to solve the tasks, or from the historical data available from the environment.

[1]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[3]  M. Wegman.  International classification of diseases. , 1959, Pediatrics.

[4]  K. Breland,et al.  The misbehavior of organisms. , 1961 .

[5]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[6]  W. H. Morse,et al.  Modulation of Elicited Behavior by a Fixed-Interval Schedule of Electric Shock Presentation , 1967, Science.

[7]  D. R. Williams,et al.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. , 1969, Journal of the experimental analysis of behavior.

[8]  J. Anson,et al.  Sources of reinforcement in the establishment of self-punitive behavior. , 1969, Journal of comparative and physiological psychology.

[9]  H. Simon,et al.  Perception in chess , 1973 .

[10]  W. Timberlake,et al.  Auto-Shaping in Rats to the Presentation of Another Rat Predicting Food , 1975, Science.

[11]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[12]  J. Gibbon.  Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[13]  F. Jones,et al.  International Classification of Diseases , 1978 .

[14]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[15]  M. Kovács.  Cognitive therapy in depression. , 1980, The Journal of the American Academy of Psychoanalysis.

[16]  R. Bolles,et al.  Comparisons of stimulus learning and response learning in a punishment situation , 1980 .

[17]  S. Lea,et al.  Contemporary Animal Learning Theory, Anthony Dickinson. Cambridge University Press, Cambridge (1981), xii, +177 pp. £12.50 hardback, £3.95 paperback , 1981 .

[18]  W. Timberlake,et al.  Stimulus and response contingencies in the misbehavior of rats. , 1982, Journal of experimental psychology. Animal behavior processes.

[19]  J. Gray,et al.  Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system , 1982, Behavioral and Brain Sciences.

[20]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  C. Carver,et al.  Depression and components of self-punitiveness: high standards, self-criticism, and overgeneralization. , 1983, Journal of abnormal psychology.

[22]  A. Dickinson.  Actions and habits: the development of behavioural autonomy , 1985 .

[23]  W. Hershberger.  An approach through the looking-glass , 1986 .

[24]  J. Smart.  Neurophilosophy: Toward a unified science of the mind-brain Patricia Smith Churchland. Bradford Books, MIT Press, Cambridge, Massachusetts (1986). xiv + 546 pp. , 1987, Neuroscience.

[25]  D. Hemsley.  An Experimental Psychological Model for Schizophrenia , 1987 .

[26]  A. Sims.  Symptoms in the Mind: An Introduction to Descriptive Psychopathology , 1988 .

[27]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[28]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[29]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[30]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[31]  Richard S. Sutton,et al.  Dyna, an integrated architecture for learning, planning, and reacting , 1990, SGAR.

[32]  G. Loewenstein,et al.  Anomalies in Intertemporal Choice: Evidence and an Interpretation , 1992 .

[33]  K. Berridge,et al.  The neural basis of drug craving: An incentive-sensitization theory of addiction , 1993, Brain Research Reviews.

[34]  D. Hemsley.  A simple (or simplistic?) cognitive model for schizophrenia. , 1993, Behaviour research and therapy.

[35]  C. Carver,et al.  Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales , 1994 .

[36]  M. T. Shipley,et al.  Columnar organization in the midbrain periaqueductal gray: modules for emotional expression? , 1994, Trends in Neurosciences.

[37]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[38]  Dc Washington.  Diagnostic and Statistical Manual of Mental Disorders, 4th Ed. , 1994 .

[39]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[40]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  H. Freeman.  Psychological treatment for depression. , 1996, The British journal of psychiatry : the journal of mental science.

[42]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[43]  E. Adelson,et al.  Slow and Smooth: A Bayesian theory for the combination of local motion signals in human vision , 1998 .

[44]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[45]  Bruce Mcewen,et al.  Stress, Adaptation, and Disease: Allostasis and Allostatic Load , 1998, Annals of the New York Academy of Sciences.

[46]  A. Tomie,et al.  Ethanol induces impulsive-like responding in a delay-of-reward operant choice procedure: impulsivity predicts autoshaping , 1998, Psychopharmacology.

[47]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[48]  W. Bickel,et al.  Shortened time horizons and insensitivity to future consequences in heroin addicts. , 1998, Addiction.

[49]  H. Ellis.  Cognitive neuropsychiatry and delusional misidentification syndromes: an exemplary vindication of the new discipline. , 1998, Cognitive neuropsychiatry.

[50]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.

[51]  J. Evenden.  Varieties of impulsivity , 1999, Psychopharmacology.

[52]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[53]  K. Kendler,et al.  Causal relationship between stressful life events and the onset of major depression. , 1999, The American journal of psychiatry.

[54]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999 .

[55]  B. Carter,et al.  Meta-analysis of cue-reactivity in addiction research. , 1999, Addiction.

[56]  R. Bonsall,et al.  Pituitary-adrenal and autonomic responses to stress in women after sexual and physical abuse in childhood. , 2000, JAMA.

[57]  D. Joel,et al.  The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum , 2000, Neuroscience.

[58]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[59]  J. Monahan,et al.  Rethinking Risk Assessment: The MacArthur Study of Mental Disorder and Violence , 2001 .

[60]  G. Ainslie.  Breakdown of will , 2001 .

[61]  Paul J. Harrison,et al.  Shorter Oxford textbook of psychiatry , 2001 .

[62]  DeLiang Wang,et al.  Unsupervised Learning: Foundations of Neural Computation , 2001, AI Mag..

[63]  Refractor.  Vision , 2000, The Lancet.

[64]  P. Halligan,et al.  Cognitive neuropsychiatry: towards a scientific psychopathology , 2001, Nature Reviews Neuroscience.

[65]  Murray Campbell,et al.  Deep Blue , 2002, Artif. Intell..

[66]  K. Dobson,et al.  Cognitive therapy of depression: pretreatment patient predictors of outcome. , 2002, Clinical psychology review.

[67]  M. El-Sabaawi.  Breakdown of Will , 2002 .

[68]  Thomas G. Dietterich,et al.  Editors. Advances in Neural Information Processing Systems , 2002 .

[69]  J. Salamone,et al.  Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine , 2002, Behavioural Brain Research.

[70]  M. Bouton.  Context, ambiguity, and unlearning: sources of relapse after behavioral extinction , 2002, Biological Psychiatry.

[71]  K. Berridge,et al.  Positive and Negative Motivation in Nucleus Accumbens Shell: Bivalent Rostrocaudal Gradients for GABA-Elicited Eating, Taste “Liking”/“Disliking” Reactions, Place Preference/Avoidance, and Fear , 2002, The Journal of Neuroscience.

[72]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .

[73]  Tony Savage,et al.  The grounding of motivation in artificial animals: Indices of motivational behavior , 2003, Cognitive Systems Research.

[74]  Samuel M. McClure,et al.  A computational substrate for incentive salience , 2003, Trends in Neurosciences.

[75]  Sham M. Kakade,et al.  On the sample complexity of reinforcement learning. , 2003 .

[76]  David S. Touretzky,et al.  Model Uncertainty in Classical Conditioning , 2003, NIPS.

[77]  I. Holme,et al.  Exposure therapy and sertraline in social phobia: 1-year follow-up of a randomised controlled trial , 2003, British Journal of Psychiatry.

[78]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[79]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[80]  C. Grillon,et al.  Deficits in hippocampus-mediated pavlovian conditioning in endogenous hypercortisolism , 2004, Biological Psychiatry.

[81]  W. Drevets,et al.  Discovering Endophenotypes for Major Depression , 2004, Neuropsychopharmacology.

[82]  B. Everitt,et al.  Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration , 2004, Science.

[83]  H. Flor,et al.  Cue-induced activation of the striatum and medial prefrontal cortex is associated with subsequent relapse in abstinent alcoholics , 2004, Psychopharmacology.

[84]  David S. Touretzky,et al.  Similarity and Discrimination in Classical Conditioning: A Latent Variable Account , 2004, NIPS.

[85]  R. Bentall.  Abandoning the concept of schizophrenia: The cognitive psychology of hallucinations and delusions , 2004 .

[86]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[87]  K. Lesch,et al.  Sexual dichotomy of an interaction between early adversity and the serotonin transporter gene promoter variant in rhesus macaques. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[88]  A. Redish,et al.  Addiction as a Computational Process Gone Awry , 2004, Science.

[89]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[90]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[91]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[92]  J. Lieberman,et al.  Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. , 2005, The New England journal of medicine.

[93]  Jonathan Williams,et al.  The evolution of hyperactivity, impulsivity and cognitive diversity , 2006, Journal of The Royal Society Interface.

[94]  K. Berridge,et al.  Hedonic Hot Spot in Nucleus Accumbens Shell: Where Do μ-Opioids Cause Increased Hedonic Impact of Sweetness? , 2005, The Journal of Neuroscience.

[95]  Shantanu P. Jadhav,et al.  Stress duration modulates the spatiotemporal patterns of spine formation in the basolateral amygdala. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[96]  G. Dunn,et al.  Reasoning, emotions, and delusional conviction in psychosis. , 2005, Journal of abnormal psychology.

[97]  P. Willner.  Chronic Mild Stress (CMS) Revisited: Consistency and Behavioural-Neurobiological Concordance in the Effects of CMS , 2005, Neuropsychobiology.

[98]  S. Maier,et al.  Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus , 2005, Nature Neuroscience.

[99]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[100]  J. Wingfield,et al.  The Darwinian concept of stress: benefits of allostasis and costs of allostatic load and the trade-offs in health and disease , 2005, Neuroscience & Biobehavioral Reviews.

[101]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[102]  D. Hemsley.  The development of a cognitive model of schizophrenia: Placing it in context , 2005, Neuroscience & Biobehavioral Reviews.

[103]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[104]  P. Dayan,et al.  Dopamine, learning, and impulsivity: a biological account of attention-deficit/hyperactivity disorder. , 2005, Journal of child and adolescent psychopharmacology.

[105]  B. Balleine.  Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits , 2005, Physiology & Behavior.

[106]  D. Pizzagalli,et al.  Toward an objective characterization of an anhedonic phenotype: A signal-detection approach , 2005, Biological Psychiatry.

[107]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[108]  S. Maier,et al.  Stressor controllability and learned helplessness: The roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor , 2005, Neuroscience & Biobehavioral Reviews.

[109]  M. Domjan.  Pavlovian conditioning: a functional perspective. , 2005, Annual review of psychology.

[110]  B. Hubert,et al.  Enhanced Perceptual Functioning in Autism: An Update, and Eight Principles of Autistic Perception , 2006, Journal of autism and developmental disorders.

[111]  D. Clark,et al.  Cognitive therapy versus exposure and applied relaxation in social phobia: A randomized controlled trial. , 2006, Journal of consulting and clinical psychology.

[112]  J. Kruschke.  Locally Bayesian learning with applications to retrospective revaluation and highlighting. , 2006, Psychological review.

[113]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[114]  R. DeRubeis,et al.  Depressive symptoms are associated with unrealistic negative predictions of future life events. , 2006, Behaviour research and therapy.

[115]  Mitsuo Kawato,et al.  Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning , 2006, Neural Networks.

[116]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[117]  Peter Dayan,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[118]  Karl J. Friston,et al.  Synaptic Plasticity and Dysconnection in Schizophrenia , 2006, Biological Psychiatry.

[119]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[120]  U. Frith,et al.  The Weak Coherence Account: Detail-focused Cognitive Style in Autism Spectrum Disorders , 2006, Journal of autism and developmental disorders.

[121]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[122]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[123]  Q. Huys.  Reinforcers and control : towards a computational aetiology of depression , 2007 .

[124]  A. Dickinson,et al.  Planning for the future by western scrub-jays , 2007, Nature.

[125]  W. Meck,et al.  How emotions colour our perception of time , 2007, Trends in Cognitive Sciences.

[126]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[127]  Jadin C. Jackson,et al.  Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. , 2007, Psychological review.

[128]  M. Coltheart.  The 33rd Sir Frederick Bartlett Lecture Cognitive neuropsychiatry and delusional belief , 2007 .

[129]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[130]  M. Coltheart.  Cognitive neuropsychiatry and delusional belief. , 2007, Quarterly journal of experimental psychology.

[131]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[132]  J. Krakauer,et al.  Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation , 2007, The Journal of Neuroscience.

[133]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[134]  Saori C. Tanaka,et al.  Serotonin Differentially Regulates Short- and Long-Term Prediction of Rewards in the Ventral and Dorsal Striatum , 2007, PloS one.

[135]  T. Dalgleish,et al.  Autobiographical Memory Specificity and Emotional Disorder , 2007, Psychological bulletin.

[136]  Benjamin M. Robinson,et al.  Selective Reinforcement Learning Deficits in Schizophrenia Support Predictions from Computational Models of Striatal-Cortical Dysfunction , 2007, Biological Psychiatry.

[137]  Brian Knutson,et al.  Dysfunction of reward processing correlates with alcohol craving in detoxified alcoholics , 2007, NeuroImage.

[138]  B. King-Casas,et al.  The Rupture and Repair of Cooperation in Borderline Personality Disorder , 2008, Science.

[139]  Y. Shaham,et al.  Context-induced relapse to drug seeking: a review , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[140]  M. Sommer,et al.  Corollary discharge across the animal kingdom , 2008, Nature Reviews Neuroscience.

[141]  Peter Dayan,et al.  Serotonin, Inhibition, and Negative Mood , 2007, PLoS Comput. Biol..

[142]  P. Dayan,et al.  A temporal difference account of avoidance learning , 2008, Network.

[143]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[144]  Ryan K. Jessup,et al.  Feedback Produces Divergence From Prospect Theory in Descriptive Choice , 2008, Psychological science.

[145]  R. Lebow.  The Future of Memory , 2008 .

[146]  K. Berridge,et al.  Mesolimbic Dopamine in Desire and Dread: Enabling Motivation to Be Generated by Localized Glutamate Disruptions in Nucleus Accumbens , 2008, The Journal of Neuroscience.

[147]  Samuel M. McClure,et al.  BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area , 2008, Science.

[148]  Adam Johnson,et al.  Computing motivation: Incentive salience boosts of drug or appetite states , 2008, Behavioral and Brain Sciences.

[149]  Saori C. Tanaka,et al.  Low-Serotonin Levels Increase Delayed Reward Discounting in Humans , 2008, The Journal of Neuroscience.

[150]  R. Kahn,et al.  EFFECTIVENESS OF ANTIPSYCHOTIC DRUGS IN FIRST-EPISODE SCHIZOPHRENIA AND SCHIZOPHRENIFORMDISORDER , 2008, Schizophrenia Research.

[151]  L. Hranov,et al.  Effectiveness of antipsychotic drugs in first-episode schizophrenia and schizophreniform disorder: an open randomised clinical trial , 2008, The Lancet.

[152]  D. Javitt,et al.  Circuit-based framework for understanding neurotransmitter and risk gene interactions in schizophrenia , 2008, Trends in Neurosciences.

[153]  Lauren M. Bylsma,et al.  A meta-analysis of emotional reactivity in major depressive disorder. , 2008, Clinical psychology review.

[154]  A. Arnsten.  Stress signalling pathways that impair prefrontal cortex structure and function , 2009, Nature Reviews Neuroscience.

[155]  L. Schwabe,et al.  Stress Prompts Habit Behavior in Humans , 2009, The Journal of Neuroscience.

[156]  S. Stephen.  Risk, resilience, and gene x environment interactions in rhesus monkeys , 2009 .

[157]  Karl J. Friston,et al.  Dysconnection in Schizophrenia: From Abnormal Synaptic Plasticity to Failures of Self-monitoring , 2009, Schizophrenia bulletin.

[158]  Demis Hassabis,et al.  The construction system of the brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[159]  N. Volkow,et al.  Imaging dopamine's role in drug abuse and addiction , 2009, Neuropharmacology.

[160]  ChrisD . Frith,et al.  Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia , 2009, Nature Reviews Neuroscience.

[161]  P. Dayan.  Dopamine, reinforcement learning, and addiction. , 2009, Pharmacopsychiatry.

[162]  P. Dayan,et al.  A Bayesian formulation of behavioral control , 2009, Cognition.

[163]  B. O’Donnell,et al.  Steady state responses: electrophysiological assessment of sensory function in schizophrenia. , 2009, Schizophrenia bulletin.

[164]  Joshua B. Tenenbaum,et al.  Fragment Grammars: Exploring Computation and Reuse in Language , 2009 .

[165]  A. Dickinson,et al.  Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction , 2009, Behavioural Brain Research.

[166]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[167]  T. Robbins,et al.  Reconciling the Role of Serotonin in Behavioral Inhibition and Aversion: Acute Tryptophan Depletion Abolishes Punishment-Induced Inhibition in Humans , 2009, The Journal of Neuroscience.

[168]  D. Blei,et al.  Context, learning, and extinction. , 2010, Psychological review.

[169]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[170]  D. Zald,et al.  Dopaminergic Network Differences in Human Impulsivity , 2010, Science.

[171]  Joseph T. McGuire,et al.  Prefrontal cortex, cognitive control, and the registration of decision costs , 2010, Proceedings of the National Academy of Sciences.

[172]  K. Berridge,et al.  Desire and Dread from the Nucleus Accumbens: Cortical Glutamate and Subcortical GABA Differentially Generate Motivation and Hedonic Impact in the Rat , 2010, PloS one.

[173]  Joseph T. McGuire,et al.  Decision making and the avoidance of cognitive demand. , 2010, Journal of experimental psychology. General.

[174]  P. Fletcher,et al.  Faculty Opinions recommendation of A selective role for dopamine in stimulus-reward learning. , 2011 .

[175]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[176]  T. Robinson,et al.  Rats prone to attribute incentive salience to reward cues are also prone to impulsive action , 2011, Behavioural Brain Research.

[177]  Stuart J. Russell,et al.  Metareasoning for Monte Carlo Tree Search , 2011 .

[178]  Michael Moutoussis,et al.  Are computational models of any use to psychiatry? , 2011, Neural Networks.

[179]  Dylan A. Simon,et al.  Neural Correlates of Forward Planning in a Spatial Decision Task in Humans , 2011, The Journal of Neuroscience.

[180]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[181]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[182]  P. Dayan,et al.  Bayesian modelling of Jumping-to-Conclusions bias in delusional patients , 2011, Cognitive neuropsychiatry.

[183]  M. Frank,et al.  From reinforcement learning models to psychiatric and neurological disorders , 2011, Nature Neuroscience.

[184]  D. Zald,et al.  Reconsidering anhedonia in depression: Lessons from translational neuroscience , 2011, Neuroscience & Biobehavioral Reviews.

[185]  Boris S. Gutkin,et al.  A Reinforcement Learning Theory for Homeostatic Regulation , 2011, NIPS.

[186]  Peter Dayan,et al.  Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees , 2012, PLoS Comput. Biol..

[187]  D. Schacter.  Adaptive constructive processes and the future of memory. , 2012, The American psychologist.

[188]  K. Doya,et al.  The Role of Serotonin in the Regulation of Patience and Impulsivity , 2012, Molecular Neurobiology.

[189]  Peter Dayan,et al.  Semi-rational models of conditioning: The case of trial order , 2012 .

[190]  Christian Grillon,et al.  The adaptive threat bias in anxiety: Amygdala–dorsomedial prefrontal cortex coupling and aversive amplification , 2012, NeuroImage.

[191]  I. Glick,et al.  Can Long-Term Outcomes Be Improved by Shortening the Duration of Untreated Illness in Psychiatric Disorders? A Conceptual Framework , 2012, Psychopathology.

[192]  N. Daw,et al.  The ubiquity of model-based reinforcement learning , 2012, Current Opinion in Neurobiology.

[193]  Z. Kurth-Nelson,et al.  A theoretical account of cognitive effects in delay discounting , 2012, The European journal of neuroscience.

[194]  P. Dayan,et al.  Action controls dopaminergic enhancement of reward representations , 2012, Proceedings of the National Academy of Sciences.

[195]  R. N. Spreng,et al.  The Future of Memory: Remembering, Imagining, and the Brain , 2012, Neuron.

[196]  T. Robinson,et al.  Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues , 2012, PloS one.

[197]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[198]  Y. Niv,et al.  Exploring a latent cause theory of classical conditioning , 2012, Learning & Behavior.

[199]  D. Burr,et al.  When the world becomes ‘too real’: a Bayesian explanation of autistic perception , 2012, Trends in Cognitive Sciences.

[200]  R. Elliott,et al.  Cognitive Mechanisms of Treatment in Depression , 2012, Neuropsychopharmacology.

[201]  P. Dayan.  How to set the switches on this thing , 2012, Current Opinion in Neurobiology.

[202]  Raymond J. Dolan,et al.  Go and no-go learning in reward and punishment: Interactions between affect and effect , 2012, NeuroImage.

[203]  Anatol C. Kreitzer,et al.  Distinct roles for direct and indirect pathway striatal neurons in reinforcement , 2012, Nature Neuroscience.

[204]  Karl J. Friston,et al.  Computational psychiatry (vol 16, pg 72, 2012) , 2012 .

[205]  S. Maier,et al.  Activation of the medial prefrontal cortex by escapable stress is necessary for protection against subsequent inescapable stress‐induced potentiation of morphine conditioned place preference , 2012, The European journal of neuroscience.

[206]  Kyle S. Smith,et al.  Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex , 2012, Proceedings of the National Academy of Sciences.

[207]  L. Wilbrecht,et al.  Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value , 2012, Nature Neuroscience.

[208]  K. Deisseroth,et al.  A prefrontal cortex–brainstem neuronal projection that controls response to behavioural challenge , 2012, Nature.

[209]  J. Brock,et al.  Alternative Bayesian accounts of autistic perception: comment on Pellicano and Burr , 2012, Trends in Cognitive Sciences.

[210]  P. Dayan,et al.  Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis , 2013, Biology of Mood & Anxiety Disorders.

[211]  Anne G E Collins,et al.  How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis , 2012, The European journal of neuroscience.

[212]  L. Schwabe,et al.  Simultaneous Glucocorticoid and Noradrenergic Activity Disrupts the Neural Basis of Goal-Directed Action in the Human Brain , 2012, The Journal of Neuroscience.

[213]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[214]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[215]  Timothy J. O'Donnell,et al.  Compositional Policy Priors , 2013 .

[216]  P. Tobler,et al.  Restricting Temptations: Neural Mechanisms of Precommitment , 2013, Neuron.

[217]  Mehdi Keramati,et al.  Imbalanced Decision Hierarchy in Addicts Emerging from Drug-Hijacked Dopamine Spiraling Circuit , 2013, PloS one.

[218]  F. Woodward Hopf,et al.  Rescuing cocaine-induced prefrontal cortex hypoactivity prevents compulsive cocaine seeking , 2013, Nature.

[219]  P. Cowen,et al.  ‘It's the way that you look at it’—a cognitive neuropsychological account of SSRI action in depression , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[220]  Aaron S. Andalman,et al.  Dopamine neurons modulate neural encoding and expression of depression-related behaviour , 2012, Nature.

[221]  R. Aslin,et al.  Rational snacking: Young children’s decision-making on the marshmallow task is moderated by beliefs about environmental reliability , 2013, Cognition.

[222]  K. Berridge,et al.  Instant Transformation of Learned Repulsion into Motivational “Wanting” , 2013, Current Biology.

[223]  A. Markman,et al.  The Curse of Planning: Dissecting Multiple Reinforcement-Learning Systems by Taxing the Central Executive , 2013 .

[224]  Ian W. Eisenberg,et al.  Frontal Theta Overrides Pavlovian Learning Biases , 2013, The Journal of Neuroscience.

[225]  Ulrik R Beierholm,et al.  Dopamine Modulates Reward-Related Vigor , 2013, Neuropsychopharmacology.

[226]  Hannah T. Boettcher,et al.  D-Cycloserine as an augmentation strategy for cognitive behavioral therapy of anxiety disorders , 2013, Biology of Mood & Anxiety Disorders.

[227]  T. Robbins,et al.  Noradrenergic modulation of cognition: Therapeutic implications , 2013, Journal of psychopharmacology.

[228]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[229]  Karl J. Friston,et al.  The Computational Anatomy of Psychosis , 2013, Front. Psychiatry.

[230]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[231]  Noah D. Goodman,et al.  Learned helplessness and generalization , 2013, CogSci.

[232]  K. Lloyd,et al.  Context-dependent decision-making: a simple Bayesian model , 2013, Journal of The Royal Society Interface.

[233]  D. Lewis,et al.  Inhibitory neurons in human cortical circuits: substrate for cognitive dysfunction in schizophrenia , 2014, Current Opinion in Neurobiology.

[234]  P. Dayan,et al.  Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation , 2014, Cognitive, affective & behavioral neuroscience.

[235]  Samuel M. McClure,et al.  The Decimal Effect: Behavioral and Neural Bases for a Novel Influence on Intertemporal Choice in Healthy Individuals and in ADHD , 2014, Journal of Cognitive Neuroscience.

[236]  Peggy Seriès,et al.  Edinburgh Research Explorer Optimism as a Prior Belief about the Probability of Future Reward , 2022 .

[237]  A. Markman,et al.  Journal of Experimental Psychology : General Retrospective Revaluation in Sequential Decision Making : A Tale of Two Systems , 2012 .

[238]  Shinsuke Shimojo,et al.  Neural Computations Underlying Arbitration between Model-Based and Model-free Learning , 2013, Neuron.

[239]  Peter Dayan,et al.  Interplay of approximate planning strategies , 2015, Proceedings of the National Academy of Sciences.