Computational Phenotyping in Psychiatry: A Worked Example

Abstract Computational psychiatry is a rapidly emerging field that uses model-based quantities to infer the behavioral and neuronal abnormalities that underlie psychopathology. If successful, this approach promises key insights into (pathological) brain function as well as a more mechanistic and quantitative approach to psychiatric nosology—structuring therapeutic interventions and predicting response and relapse. The basic procedure in computational psychiatry is to build a computational model that formalizes a behavioral or neuronal process. Measured behavioral (or neuronal) responses are then used to infer the model parameters of a single subject or a group of subjects. Here, we provide an illustrative overview over this process, starting from the modeling of choice behavior in a specific task, simulating data, and then inverting that model to estimate group effects. Finally, we illustrate cross-validation to assess whether between-subject variables (e.g., diagnosis) can be recovered successfully. Our worked example uses a simple two-step maze task and a model of choice behavior based on (active) inference and Markov decision processes. The procedural steps and routines we illustrate are not restricted to a specific field of research or particular computational model but can, in principle, be applied in many domains of computational psychiatry.

[1]  B. Efron,et al.  Stein's Estimation Rule and Its Competitors- An Empirical Bayes Approach , 1973 .

[2]  Hagai Attias,et al.  A Variational Bayesian Framework for Graphical Models , 1999 .

[3]  Matthew J. Beal Variational algorithms for approximate Bayesian inference , 2003 .

[4]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[5]  Marc Toussaint,et al.  Probabilistic inference for solving (PO) MDPs , 2006 .

[6]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[7]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[8]  Karl J. Friston,et al.  Reinforcement Learning or Active Inference? , 2009, PloS one.

[9]  Rajesh P. N. Rao,et al.  Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes , 2010, Front. Comput. Neurosci..

[10]  Karl J. Friston,et al.  Observing the Observer (I): Meta-Bayesian Models of Learning and Decision-Making , 2010, PloS one.

[11]  Oguzhan Alagoz,et al.  Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty , 2010, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  Karl J. Friston,et al.  A Bayesian Foundation for Individual Learning Under Uncertainty , 2011, Front. Hum. Neurosci..

[13]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[14]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[15]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[16]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[17]  William D. Penny,et al.  Comparing Dynamic Causal Models using AIC, BIC and Free Energy , 2012, NeuroImage.

[18]  Raymond J. Dolan,et al.  Dopamine, Affordance and Active Inference , 2012, PLoS Comput. Biol..

[19]  Karl J. Friston,et al.  Free Energy, Precision and Learning: The Role of Cholinergic Neuromodulation , 2013, The Journal of Neuroscience.

[20]  Raymond J. Dolan,et al.  The anatomy of choice: active inference and agency , 2013, Front. Hum. Neurosci..

[21]  D. Wolpert,et al.  Cognitive Tomography Reveals Complex, Task-Independent Mental Representations , 2013, Current Biology.

[22]  Karl J. Friston,et al.  The Computational Anatomy of Psychosis , 2013, Front. Psychiatry.

[23]  Daniel Brandeis,et al.  Role of the Medial Prefrontal Cortex in Impaired Decision Making in Juvenile Attention-Deficit/Hyperactivity Disorder , 2014 .

[24]  Raymond J. Dolan,et al.  Model averaging, optimal inference, and habit formation , 2014, Front. Hum. Neurosci..

[25]  Peter Dayan,et al.  Rationalizable Irrationalities of Choice , 2014, Top. Cogn. Sci..

[26]  Karl J. Friston,et al.  Computational psychiatry: the brain as a phantastic organ. , 2014, The lancet. Psychiatry.

[27]  C. Mathys,et al.  Computational approaches to psychiatry , 2014, Current Opinion in Neurobiology.

[28]  Raymond J. Dolan,et al.  The anatomy of choice: dopamine and decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  Karl J. Friston,et al.  Empirical Bayes for Group (DCM) Studies: A Reproducibility Study , 2015, Front. Hum. Neurosci..

[30]  Karl J. Friston,et al.  Optimal inference with suboptimal models: Addiction and active Bayesian inference , 2015, Medical hypotheses.

[31]  Peter Dayan,et al.  Decision-Theoretic Psychiatry , 2015 .

[32]  Karl J. Friston,et al.  Evidence for surprise minimization over value maximization in choice behavior , 2015, Scientific Reports.

[33]  Karl J. Friston,et al.  Active inference and epistemic value , 2015, Cognitive neuroscience.

[34]  Karl J. Friston,et al.  The Dopaminergic Midbrain Encodes the Expected Certainty about Desired Outcomes , 2014, Cerebral cortex.

[35]  Karl J. Friston,et al.  Empirical Bayes for DCM: A Group Inversion Scheme , 2015, Front. Syst. Neurosci..

[36]  K. Stephan,et al.  Translational Perspectives for Computational Neuroimaging , 2015, Neuron.

[37]  Raymond J. Dolan,et al.  Active Inference, Evidence Accumulation, and the Urn Task , 2015, Neural Computation.

[38]  Karl J. Friston,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[39]  M. Frank,et al.  Computational psychiatry as a bridge from neuroscience to clinical applications , 2016, Nature Neuroscience.

[40]  R. Dolan,et al.  Computational Psychiatry of ADHD: Neural Gain Impairments across Marrian Levels of Analysis , 2016, Trends in Neurosciences.

[41]  Adeel Razi,et al.  Bayesian model reduction and empirical Bayes for group (DCM) studies , 2016, NeuroImage.

[42]  Joshua B Tenenbaum,et al.  Toward the neural implementation of structure learning , 2016, Current Opinion in Neurobiology.