Bayesian analysis of the piecewise diffusion decision model

Most past research on sequential sampling models of decision-making have assumed a time homogeneous process (i.e., parameters such as drift rates and boundaries are constant and do not change during the deliberation process). This has largely been due to the theoretical difficulty in testing and fitting more complex models. In recent years, the development of simulation-based modeling approaches matched with Bayesian fitting methodologies has opened the possibility of developing more complex models such as those with time-varying properties. In the present work, we discuss a piecewise variant of the well-studied diffusion decision model (termed pDDM) that allows evidence accumulation rates to change during the deliberation process. Given the complex, time-varying nature of this model, standard Bayesian parameter estimation methodologies cannot be used to fit the model. To overcome this, we apply a recently developed simulation-based, hierarchal Bayesian methodology called the probability density approximation (PDA) method. We provide an analysis of this methodology and present results of parameter recovery experiments to demonstrate the strengths and limitations of this approach. With those established, we fit pDDM to data from a perceptual experiment where information changes during the course of trials. This extensible modeling platform opens the possibility of applying sequential sampling models to a range of complex non-stationary decision tasks.

[1]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[2]  Cajo J. F. ter Braak,et al.  A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces , 2006, Stat. Comput..

[3]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[4]  Adele Diederich,et al.  A dynamic dual process model of risky decision making. , 2018, Psychological review.

[5]  D. Navarro,et al.  Fast and accurate calculations for first-passage times in Wiener diffusion models , 2009 .

[6]  R. Ratcliff,et al.  Using diffusion models to understand clinical disorders. , 2010, Journal of mathematical psychology.

[7]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[8]  Joachim Vandekerckhove,et al.  Extending JAGS: A tutorial on adding custom distributions to JAGS (with a diffusion model example) , 2013, Behavior Research Methods.

[9]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[10]  G. Logan,et al.  Response inhibition in the stop-signal paradigm , 2008, Trends in Cognitive Sciences.

[11]  Krešimir Josić,et al.  Optimal models of decision-making in dynamic environments , 2018, Current Opinion in Neurobiology.

[12]  Bradley C. Love,et al.  Learning in Noise: Dynamic Decision-Making in a Variable Environment. , 2009, Journal of mathematical psychology.

[13]  Roger Ratcliff,et al.  A note on modeling accumulation of information when the rate of accumulation changes over time , 1980 .

[14]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[15]  Desmond J. Higham,et al.  An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations , 2001, SIAM Rev..

[16]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[17]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Andreas Voss,et al.  A fast numerical algorithm for the estimation of diffusion model parameters , 2008 .

[19]  A. Diederich,et al.  Conflict and the Stochastic-Dominance Principle of Decision Making , 1999 .

[20]  Adele Diederich,et al.  A Dual-process Model of Framing Effects in Risky Choice , 2015, CogSci.

[21]  Francis Tuerlinckx,et al.  Fitting the ratcliff diffusion model to experimental data , 2007, Psychonomic bulletin & review.

[22]  Marius Usher,et al.  Using Time-Varying Evidence to Test Models of Decision Dynamics: Bounded Diffusion vs. the Leaky Competing Accumulator Model , 2012, Front. Neurosci..

[23]  Bruce Tidor,et al.  Sloppy models, parameter uncertainty, and the role of experimental design. , 2010, Molecular bioSystems.

[24]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[25]  William R. Holmes,et al.  A practical guide to the Probability Density Approximation (PDA) with improved implementation and error characterization , 2015 .

[26]  Nathan J Evans A method, framework, and tutorial for efficiently simulating models of decision-making , 2019, Behavior research methods.

[27]  Brandon M. Turner,et al.  A method for efficiently sampling from distributions with correlated dimensions. , 2013, Psychological methods.

[28]  Roger Ratcliff,et al.  Evaluating methods for approximating stochastic differential equations. , 2006, Journal of mathematical psychology.

[29]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[30]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[31]  R. Ratcliff,et al.  The effects of aging on reaction time in a signal detection task. , 2001, Psychology and aging.

[32]  Brandon M. Turner,et al.  A generalized, likelihood-free method for posterior estimation , 2014, Psychonomic bulletin & review.

[33]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[34]  Brandon M. Turner,et al.  Informing cognitive abstractions through neuroimaging: the neural drift diffusion model. , 2015, Psychological review.

[35]  Thomas V. Wiecki,et al.  HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python , 2013, Front. Neuroinform..

[36]  Adele Diederich,et al.  Multi-stage sequential sampling models with finite or infinite time horizon and variable boundaries , 2016 .

[37]  B. Silverman,et al.  Kernel Density Estimation Using the Fast Fourier Transform , 1982 .

[38]  B. Silverman,et al.  Algorithm AS 176: Kernel Density Estimation Using the Fast Fourier Transform , 1982 .

[39]  Vaibhav Srivastava,et al.  A martingale analysis of first passage times of time-dependent Wiener diffusion models. , 2015, Journal of mathematical psychology.

[40]  Paul Cisek,et al.  Decision making by urgency gating: theory and experimental support. , 2012, Journal of neurophysiology.

[41]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[42]  Andreas Voss,et al.  Fast-dm: A free program for efficient diffusion model analysis , 2007, Behavior research methods.

[43]  Francis Tuerlinckx,et al.  Diffusion model analysis with MATLAB: A DMAT primer , 2008, Behavior research methods.

[44]  Andrew Heathcote,et al.  A new framework for modeling decisions about changing information: The Piecewise Linear Ballistic Accumulator model , 2016, Cognitive Psychology.

[45]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[46]  P. Cisek,et al.  Decisions in Changing Conditions: The Urgency-Gating Model , 2009, The Journal of Neuroscience.

[47]  James L. McClelland,et al.  Bayesian analysis of simulation-based models , 2016 .

[48]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[49]  M. Lee,et al.  Hierarchical diffusion models for two-choice response times. , 2011, Psychological methods.

[50]  Marius Usher,et al.  Testing Multi-Alternative Decision Models with Non-Stationary Evidence , 2011, Front. Neurosci..

[51]  A. Bröder,et al.  Adaptive flexibility and maladaptive routines in selecting fast and frugal decision strategies. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[52]  William R. Holmes,et al.  Response-time data provide critical constraints on dynamic models of multi-alternative, multi-attribute choice , 2019, Psychonomic Bulletin & Review.

[53]  Gordon D. Logan,et al.  Dependence and independence in responding to double stimulation: A comparison of stop, change, and dual-task paradigms. , 1986 .

[54]  F. Tuerlinckx The efficient computation of the cumulative distribution and probability density functions in the diffusion model , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.