Ten simple rules for the computational modeling of behavioral data

Computational modeling of behavioral data has revolutionized psychology and neuroscience. By fitting models to experimental data we can probe the algorithms underlying behavior, find neural correlates of computational variables and more precisely understand the effects of drugs, illness and interventions. But with great power comes great responsibility. In this note we give ten simple rules to ensure that computational modeling is used with care.

[1]  Jorge Nocedal,et al.  A trust region method based on interior point techniques for nonlinear programming , 2000, Math. Program..

[2]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Jorge J. Moré,et al.  Computing a Trust Region Step , 1983 .

[4]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[5]  Noah D. Goodman,et al.  Empirical evidence for resource-rational anchoring and adjustment , 2017, Psychonomic Bulletin & Review.

[6]  Stephen B. Broomell,et al.  Parameter recovery for decision modeling using choice data. , 2014 .

[7]  Alice Y. Chiang,et al.  Working-memory capacity protects model-based learning from stress , 2013, Proceedings of the National Academy of Sciences.

[8]  Andrew Heathcote,et al.  An introduction to good practices in cognitive modeling , 2015 .

[9]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[10]  D. Navarro.  Between the Devil and the Deep Blue Sea: Tensions Between Scientific Judgement and Statistical Model Selection , 2018, Computational Brain & Behavior.

[11]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[12]  Krzysztof J. Gorgolewski,et al.  Reward Learning over Weeks Versus Minutes Increases the Neural Representation of Value in the Human Brain , 2018, The Journal of Neuroscience.

[13]  Q. Huys.  Bayesian Approaches to Learning and Decision-Making , 2018 .

[14]  Joshua I. Gold,et al.  A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems , 2013, PLoS Comput. Biol..

[15]  Birte U. Forstmann,et al.  A Bayesian framework for simultaneously modeling neural and behavioral data , 2013, NeuroImage.

[16]  J. Bradshaw,et al.  Strategic and non-strategic problem gamblers differ on decision-making under risk and ambiguity. , 2014, Addiction.

[17]  Timothy E. J. Behrens,et al.  Dissociable effects of surprise and model update in parietal and anterior cingulate cortex , 2013, Proceedings of the National Academy of Sciences.

[18]  M. Lee,et al.  A Bayesian analysis of human decision-making on bandit problems , 2009 .

[19]  Anne G E Collins,et al.  Cognitive control over learning: creating, clustering, and generalizing task-set structure. , 2013, Psychological review.

[20]  H. Akaike.  A new look at the statistical model identification , 1974 .

[21]  W. Geisler,et al.  Contributions of ideal observer theory to vision research , 2011, Vision Research.

[22]  Joshua T. Abbott,et al.  Random walks on semantic networks can resemble optimal foraging. , 2015, Psychological review.

[23]  N. Daw,et al.  Chapter 15 – Value Learning through Reinforcement: The Basics of Dopamine and Reinforcement Learning , 2013 .

[24]  Thomas V. Wiecki,et al.  Eye tracking and pupillometry are indicators of dissociable latent decision processes. , 2014, Journal of experimental psychology. General.

[25]  Etienne Koechlin,et al.  Foundations of human reasoning in the prefrontal cortex , 2014, Science.

[26]  Jonathan D. Cohen,et al.  The effect of atomoxetine on random and directed exploration in humans , 2017, PloS one.

[27]  Robert C. Wilson,et al.  A causal role for right frontopolar cortex in directed, but not random, exploration , 2016, bioRxiv.

[28]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[29]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[30]  R. Ratcliff,et al.  The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. , 2010, Psychology and aging.

[31]  N. Daw,et al.  Characterizing a psychiatric symptom dimension related to deficits in goal-directed control , 2016, eLife.

[32]  Robert C. Wilson,et al.  Is Model Fitting Necessary for Model-Based fMRI? , 2015, PLoS Comput. Biol..

[33]  E. Wagenmakers,et al.  Hierarchical Bayesian parameter estimation for cumulative prospect theory , 2011, Journal of Mathematical Psychology.

[34]  E. Koechlin,et al.  The Importance of Falsification in Computational Cognitive Modeling , 2017, Trends in Cognitive Sciences.

[35]  Daeyeol Lee,et al.  Feature-based learning improves adaptability without compromising precision , 2017, Nature Communications.

[36]  Yuan Chang Leong,et al.  Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments , 2017, Neuron.

[37]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[38]  K. Kording,et al.  Appreciating diversity of goals in computational neuroscience , 2018 .

[39]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[40]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[41]  Robert C. Wilson,et al.  A causal role for right frontopolar cortex in directed, but not random, exploration , 2016, bioRxiv.

[42]  E. Wagenmakers,et al.  Model Comparison and the Principle of Parsimony , 2015 .

[43]  Matthew R Nassar,et al.  Taming the beast: extracting generalizable knowledge from computational models of cognition , 2016, Current Opinion in Behavioral Sciences.

[44]  Robert C. Wilson,et al.  Charting the Expansion of Strategic Exploratory Behavior During Adolescence , 2017, Journal of experimental psychology. General.

[45]  Robert C Wilson,et al.  Ten simple rules for the computational modeling of behavioral data , 2019, eLife.

[46]  E. Wagenmakers,et al.  AIC model selection using Akaike weights , 2004, Psychonomic bulletin & review.

[47]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[48]  Robert C. Wilson,et al.  Inferring Relevance in a Changing World , 2012, Front. Hum. Neurosci..

[49]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[50]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[51]  Markus Ullsperger,et al.  Real and Fictive Outcomes Are Processed Differently but Converge on a Common Adaptive Mechanism , 2013, Neuron.

[52]  Simon Farrell,et al.  Computational Modeling of Cognition and Behavior , 2018 .

[53]  Julie C. Helmers,et al.  Chunking as a rational strategy for lossy data compression in visual working memory , 2017, bioRxiv.

[54]  M. Lee,et al.  Bayesian Cognitive Modeling: A Practical Course , 2014 .

[55]  G. Box.  Robustness in the Strategy of Scientific Model Building. , 1979 .

[56]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[57]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .