Special Issue : Cognition in Neuropsychiatric Disorders Computational psychiatry

P. Read Montague, Raymond J. Dolan, Karl J. Friston and Peter Dayan 1 Virginia Tech Carilion Research Institute and Department of Physics, Virginia Tech, 2 Riverside Circle, Roanoke, VA 24016, USA 2 Wellcome Trust Centre for Neuroimaging, University College London, 12 Queen Square, London, WC1N 3BG, UK 3 Gatsby Computational Neuroscience Unit, Alexandra House, 17 Queen Square, London, WC1N 3AR, UK

[1]  K. Berridge,et al.  The incentive sensitization theory of addiction: some current issues , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[3]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[4]  R. O’Reilly.  Biologically Based Computational Models of High-Level Cognition , 2006, Science.

[5]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[6]  J. Cohen,et al.  Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophrenia. , 1992, Psychological review.

[7]  J. Jolles,et al.  Serotonin and cognitive flexibility: neuroimaging studies into the effect of acute tryptophan depletion in healthy volunteers. , 2007, Current medicinal chemistry.

[8]  Thomas R Insel,et al.  Rethinking mental illness. , 2010, JAMA.

[9]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[10]  Daeyeol Lee.  Game theory and neural basis of social decision making , 2008, Nature Neuroscience.

[11]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[12]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  C. Carter,et al.  Anterior cingulate cortex activity and impaired self-monitoring of performance in patients with schizophrenia: an event-related fMRI study. , 2001, The American journal of psychiatry.

[14]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[15]  Karl J. Friston,et al.  Cooperation and Heterogeneity of the Autistic Mind , 2010, The Journal of Neuroscience.

[16]  M. Seligman,et al.  Depression and learned helplessness in man. , 1975, Journal of abnormal psychology.

[17]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[18]  S. Quartz,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[19]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[20]  Karl J. Friston,et al.  Neural Mechanisms of Belief Inference during Cooperative Games , 2010, The Journal of Neuroscience.

[21]  Terrence J. Sejnowski,et al.  Foraging in an Uncertain Environment Using Predictive Hebbian Learning , 1993, NIPS.

[22]  Peter Bossaerts,et al.  Neural correlates of mentalizing-related computations during strategic interactions in humans , 2008, Proceedings of the National Academy of Sciences.

[23]  P. Fletcher,et al.  Glutamatergic Model Psychoses: Prediction Error, Learning, and Inference , 2011, Neuropsychopharmacology.

[24]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[25]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990, Bulletin of mathematical biology.

[26]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[27]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[28]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[29]  P. Montague,et al.  Neuroeconomic Approaches to Mental Disorders , 2010, Neuron.

[30]  James L. McClelland,et al.  Explorations in parallel distributed processing: a handbook of models, programs, and exercises , 1988 .

[31]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[32]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[33]  A. Church.  An Unsolvable Problem of Elementary Number Theory , 1936 .

[34]  J. Deakin,et al.  5-HT and mechanisms of defence. Author's response , 1991, Journal of psychopharmacology.

[35]  F. Goodkin.  Rats learn the relationship between responding and environmental events: An expansion of the learned helplessness hypothesis , 1976 .

[36]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[37]  M. Milders,et al.  Abnormal Temporal Difference Reward-learning Signals in Major Depression Department of Radiology And , 2022 .

[38]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[39]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[40]  P. Soubrié.  Reconciling the role of central serotonin neurons in human and animal behavior , 1986, Behavioral and Brain Sciences.

[41]  Colin Camerer,et al.  Neural signatures of strategic types in a two-person bargaining game , 2010, Proceedings of the National Academy of Sciences.

[42]  W. Singer,et al.  The development of neural synchrony and large-scale cortical networks during adolescence: relevance for the pathophysiology of schizophrenia and neurodevelopmental hypothesis. , 2011, Schizophrenia bulletin.

[43]  Olaf Sporns,et al.  Network structure of cerebral cortex shapes functional connectivity on multiple time scales , 2007, Proceedings of the National Academy of Sciences.

[44]  James L. McClelland,et al.  Electronic Supplementary Material for “ Toward an Executive without a Homunculus ” , 2022 .

[45]  P. Buckley,et al.  The Rupture and Repair of Cooperation in Borderline Personality Disorder , 2009 .

[46]  Jonathan D. Cohen,et al.  Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function , 1999, Biological Psychiatry.

[47]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Raymond J. Dolan,et al.  Computational and dynamic models in neuroimaging , 2010, NeuroImage.

[49]  Raymond J. Dolan,et al.  Game Theory of Mind , 2008, PLoS Comput. Biol..

[50]  S. Maier,et al.  Stressor controllability and learned helplessness: The roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor , 2005, Neuroscience & Biobehavioral Reviews.

[51]  R. Nagel,et al.  Neural correlates of depth of strategic reasoning in medial prefrontal cortex , 2009, Proceedings of the National Academy of Sciences.

[52]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[53]  Colin F Camerer,et al.  Agent-Specific Responses in the Cingulate Cortex During Economic Exchanges , 2006, Science.

[54]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[55]  J. Deakin,et al.  5-HT and mechanisms of defence , 1991, Journal of psychopharmacology.

[56]  Richard S. Sutton,et al.  Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming , 1990, ML.

[57]  B. Sahakian,et al.  Acute Tryptophan Depletion in Healthy Volunteers Enhances Punishment Prediction but Does not Affect Reward Prediction , 2008, Neuropsychopharmacology.

[58]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[59]  S. Becker,et al.  Linking Animal Models of Psychosis to Computational Models of Dopamine Function , 2007, Neuropsychopharmacology.

[60]  Meghana Bhatt,et al.  Self-Referential Thinking and Equilibrium as States of Mind in Games: Fmri Evidence , 2005, Games Econ. Behav..

[61]  Pearl H. Chiu,et al.  Self Responses along Cingulate Cortex Reveal Quantitative Neural Phenotype for High-Functioning Autism , 2008, Neuron.

[62]  M. Seligman,et al.  Learned helplessness: Theory and evidence. , 1976 .

[63]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[64]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[65]  Raymond J. Dolan,et al.  Alterations in Brain Connectivity Underlying Beta Oscillations in Parkinsonism , 2011, PLoS Comput. Biol..

[66]  K. Gödel.  Über formal unentscheidbare Sätze der Principia Mathematica und verwandter Systeme I , 1931 .

[67]  M. Frank,et al.  From reinforcement learning models to psychiatric and neurological disorders , 2011, Nature Neuroscience.

[68]  Peter Dayan,et al.  Bee foraging in uncertain environments using predictive hebbian learning , 1995, Nature.

[69]  D Servan-Schreiber,et al.  A theory of dopamine function and its role in cognitive deficits in schizophrenia. , 1993, Schizophrenia bulletin.

[70]  Marina Vannucci,et al.  Biosensor Approach to Psychopathology Classification , 2010, PLoS Comput. Biol..

[71]  R. O’Reilly,et al.  A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[72]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[73]  S. Baron-Cohen.  Theory of mind and autism: A review , 2000 .

[74]  Huda Akil,et al.  Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction , 2009, Neuropharmacology.

[75]  P. Dayan,et al.  Serotonin in affective control. , 2009, Annual review of neuroscience.

[76]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[77]  Peter Dayan,et al.  Bayesian Model of Behaviour in Economic Games , 2008, NIPS.

[78]  C. Frith,et al.  Functional imaging of ‘theory of mind’ , 2003, Trends in Cognitive Sciences.

[79]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[80]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[81]  K. Berridge,et al.  The psychology and neurobiology of addiction: an incentive-sensitization view. , 2000, Addiction.

[82]  K. Doya,et al.  The computational neurobiology of learning and reward , 2006, Current Opinion in Neurobiology.

[83]  G. Waiter,et al.  Expected value and prediction error abnormalities in depression and schizophrenia. , 2011, Brain : a journal of neurology.

[84]  M. Wood,et al.  Serotonin-dopamine interactions: implications for the design of novel therapeutic agents for psychiatric disorders. , 2008, Progress in brain research.

[85]  J. Rilling,et al.  The neuroscience of social decision-making. , 2011, Annual review of psychology.

[86]  E. Fehr.  A Theory of Fairness, Competition and Cooperation , 1998 .

[87]  P. Dayan,et al.  Opponency Revisited: Competition and Cooperation Between Dopamine and Serotonin , 2010, Neuropsychopharmacology.