Decomposing conditioned avoidance performance with computational models.

Avoidance towards innocuous stimuli is a key characteristic across anxiety-related disorders and chronic pain. Insights into the relevant learning processes of avoidance are often gained via laboratory procedures, where individuals learn to avoid stimuli or movements that have been previously associated with an aversive stimulus. Typically, statistical analyses of data gathered with conditioned avoidance procedures include frequency data, for example, the number of times a participant has avoided an aversive stimulus. Here, we argue that further insights into the underlying processes of avoidance behavior could be unraveled using computational models of behavior. We then demonstrate how computational models could be used by reanalysing a previously published avoidance data set and interpreting the key findings. We conclude our article by listing some challenges in the direct application of computational modeling to avoidance data sets.

[1]  Michael Moutoussis,et al.  Are computational models of any use to psychiatry? , 2011, Neural Networks.

[2]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[3]  Alexander Etz,et al.  Robust Modeling in Cognitive Science , 2019, Computational Brain & Behavior.

[4]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[5]  Ben R. Newell,et al.  Unpacking the Exploration–Exploitation Tradeoff: A Synthesis of Human and Animal Literatures , 2015 .

[6]  G. Crombez,et al.  Short running title : COMPETING GOALS ATTENUATE AVOIDANCE BEHAVIOR 1 COMPETING GOALS ATTENUATE AVOIDANCE BEHAVIOR IN THE CONTEXT OF PAIN , 2014 .

[7]  Rolf A. Zwaan,et al.  Registered Replication Report , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[8]  J. C. Johnston,et al.  A cognitive theory of avoidance learning. , 1973 .

[9]  M. Lee How cognitive modeling can benefit from hierarchical Bayesian models. , 2011 .

[10]  Robert M Sears,et al.  The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm , 2016, Molecular Psychiatry.

[11]  M. Kindt,et al.  Avoidance learning: a review of theoretical models and recent developments , 2015, Front. Behav. Neurosci..

[12]  Paul Thagard,et al.  Computational Models in Science and Philosophy , 2018 .

[13]  P. Lovibond Fear and Avoidance: An Integrated Expectancy Model. , 2006 .

[14]  Jerome R. Busemeyer,et al.  Comparison of Decision Learning Models Using the Generalization Criterion Method , 2008, Cogn. Sci..

[15]  B. Vervliet,et al.  Low-Cost Avoidance Behaviors are Resistant to Fear Extinction in Humans , 2015, Front. Behav. Neurosci..

[16]  Aki Vehtari,et al.  Understanding predictive information criteria for Bayesian models , 2013, Statistics and Computing.

[17]  Tom Stafford,et al.  What use are computational models of cognitive processes , 2009 .

[18]  M. Fanselow,et al.  Pathways towards the proliferation of avoidance in anxiety and implications for treatment. , 2017, Behaviour research and therapy.

[19]  B. Franke,et al.  Dissociable Effects of Dopamine and Serotonin on Reversal Learning , 2013, Neuron.

[20]  Gunnar Blohm,et al.  Modeling in Neuroscience as a Decision Process , 2019 .

[21]  D. Hassabis,et al.  When Fear Is Near: Threat Imminence Elicits Prefrontal-Periaqueductal Gray Shifts in Humans , 2007, Science.

[22]  T. Lonsdorf,et al.  More than just noise: Inter-individual differences in fear acquisition, extinction and return of fear in humans - Biological, experiential, temperamental factors, and methodological pitfalls , 2017, Neuroscience & Biobehavioral Reviews.

[23]  Robert C Wilson,et al.  Ten simple rules for the computational modeling of behavioral data , 2019, eLife.

[24]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[25]  Heidi Ledford How to solve the world's biggest problems , 2015, Nature.

[26]  Rebecca L. Bond,et al.  Altered learning under uncertainty in unmedicated mood and anxiety disorders , 2019, Nature Human Behaviour.

[27]  O. Mowrer Two-factor learning theory: summary and comment. , 1951, Psychological review.

[28]  John K. Kruschke,et al.  Decision-making in stimulant and opiate addicts in protracted abstinence: evidence from computational modeling with pure users , 2014, Front. Psychol..

[29]  Mathijs Franssen,et al.  Acquisition and extinction of operant pain-related avoidance behavior using a 3 degrees-of-freedom robotic arm , 2016, Pain.

[30]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[31]  Lei Zhang,et al.  Revealing Neurocomputational Mechanisms of Reinforcement Learning and Decision-Making With the hBayesDM Package , 2016, bioRxiv.

[32]  E. Wagenmakers,et al.  An Introduction to Model-Based Cognitive Neuroscience , 2015, Springer New York.

[33]  Robert Whelan,et al.  Derived Avoidance Learning: Transformation of Avoidance Response Functions in Accordance with Same and Opposite Relational Frames , 2008 .

[34]  A. Pittig,et al.  Same fear responses, less avoidance: Rewards competing with aversive outcomes do not buffer fear acquisition, but attenuate avoidance to accelerate subsequent fear extinction. , 2019, Behaviour research and therapy.

[35]  A. Pittig,et al.  Avoidance and its bi-directional relationship with conditioned fear: Mechanisms, moderators, and clinical implications. , 2020, Behaviour research and therapy.

[36]  Eran Eldar,et al.  Computational Models of Anxiety: Nascent Efforts and Future Directions , 2019, Current Directions in Psychological Science.

[37]  A. Olsson,et al.  Racial Bias Shapes Social Reinforcement Learning , 2014, Psychological science.

[38]  G. Crombez,et al.  The fear-avoidance model of pain. , 2016, Pain.

[39]  E. Koechlin,et al.  The Importance of Falsification in Computational Cognitive Modeling , 2017, Trends in Cognitive Sciences.

[40]  Melissa T. Buelow,et al.  Construct Validity of the Iowa Gambling Task , 2009, Neuropsychology Review.

[41]  Kaileigh A. Byrne,et al.  Decomposing the roles of perseveration and expected value representation in models of the Iowa gambling task , 2013, Front. Psychol..

[42]  I. Engelhard,et al.  Testing a novelty-based extinction procedure for the reduction of conditioned avoidance. , 2017, Journal of behavior therapy and experimental psychiatry.

[43]  M. Craske,et al.  Avoidance and decision making in anxiety: An introduction to the special issue. , 2017, Behaviour research and therapy.

[44]  Joseph E LeDoux,et al.  Surviving threats: neural circuit and computational implications of a new taxonomy of defensive behaviour , 2018, Nature Reviews Neuroscience.

[45]  Paul Pauli,et al.  Contextual fear conditioning predicts subsequent avoidance behaviour in a virtual reality environment , 2012, Cognition & emotion.

[46]  Woo-Young Ahn,et al.  The Outcome-Representation Learning Model: A Novel Reinforcement Learning Model of the Iowa Gambling Task , 2018, Cogn. Sci..

[47]  P. Meehl Why Summaries of Research on Psychological Theories are Often Uninterpretable , 1990 .

[48]  Fred L. Drake,et al.  The Python Language Reference Manual , 1999 .

[49]  P. Dayan,et al.  Serotonin Selectively Modulates Reward Value in Human Decision-Making , 2012, The Journal of Neuroscience.

[50]  B. Vervliet,et al.  The validity of human avoidance paradigms. , 2018, Behaviour research and therapy.

[51]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[52]  S. Dymond Overcoming avoidance in anxiety disorders: The contributions of Pavlovian and operant avoidance extinction methods , 2019, Neuroscience & Biobehavioral Reviews.

[53]  Stephan F. Miedl,et al.  Higher threat avoidance costs reduce avoidance behaviour which in turn promotes fear extinction in humans. , 2017, Behaviour research and therapy.

[54]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[55]  M. Frank,et al.  From reinforcement learning models to psychiatric and neurological disorders , 2011, Nature Neuroscience.

[56]  Blair H. Smith,et al.  A classification of chronic pain for ICD-11 , 2015, Pain.