THEORETICAL NOTE Optimal Decision Making in Neural Inhibition Models

In their influential Psychological Review article, Bogacz, Brown, Moehlis, Holmes, and Cohen (2006) discussed optimal decision making as accomplished by the drift diffusion model (DDM). The authors showed that neural inhibition models, such as the leaky competing accumulator model (LCA) and the feedforward inhibition model (FFI), can mimic the DDM and accomplish optimal decision making. Here we show that these conclusions depend on how the models handle negative activation values and (for the LCA) across-trial variability in response conservativeness. Negative neural activations are undesirable for both neurophysiological and mathematical reasons. However, when negative activations are truncated to 0, the equivalence to the DDM is lost. Simulations show that this concern has practical ramifications: The DDM generally outperforms truncated versions of the LCA and the FFI, and the parameter estimates from the neural models can no longer be mapped onto those of the DDM in a simple fashion. We show that for both models, truncation may be avoided by assuming a baseline activity for each accumulator. This solution allows the LCA to approximate the DDM and the FFI to be identical to the DDM.

[1]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[2]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[3]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[4]  D. Sparks,et al.  Dissociation of visual and saccade-related responses in superior colliculus neurons. , 1980, Journal of neurophysiology.

[5]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[6]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[7]  S. Grossberg Neural Networks and Natural Intelligence , 1988 .

[8]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[9]  J. Schall Neuronal activity related to visually guided saccades in the frontal eye fields of rhesus monkeys: comparison with supplementary eye fields. , 1991, Journal of neurophysiology.

[10]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[11]  R. Wurtz,et al.  Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells. , 1995, Journal of neurophysiology.

[12]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[13]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[14]  J. Schall,et al.  Role of frontal eye fields in countermanding saccades: visual, movement, and fixation activity. , 1998, Journal of neurophysiology.

[15]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[16]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[17]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[18]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[19]  R. Ratcliff,et al.  Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability , 2002, Psychonomic bulletin & review.

[20]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[21]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.

[22]  R. Ratcliff,et al.  A diffusion model analysis of the effects of aging in the lexical-decision task. , 2004, Psychology and aging.

[23]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[24]  Adele Diederich,et al.  Contrast effects or loss aversion? Comment on Usher and McClelland (2004). , 2005, Psychological review.

[25]  Jochen Ditterich Stochastic models of decisions about motion direction: behavior and physiology , 2006 .

[26]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[27]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[28]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[29]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[30]  Karl Christoph Klauer,et al.  Process components of the Implicit Association Test: a diffusion-model analysis. , 2007, Journal of personality and social psychology.

[31]  Philip L. Smith,et al.  Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. , 2007, Journal of neurophysiology.

[32]  Klaus Oberauer,et al.  Individual differences in components of reaction time distributions and their relations to working memory and intelligence. , 2007, Journal of experimental psychology. General.

[33]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[34]  Kevin N. Gurney,et al.  The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions , 2007, Neural Computation.

[35]  Marius Usher,et al.  Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Eric-Jan Wagenmakers,et al.  An EZ-diffusion model for response time and accuracy , 2007, Psychonomic bulletin & review.

[37]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[38]  Wei Ji Ma,et al.  Spiking networks for Bayesian inference and choice , 2008, Current Opinion in Neurobiology.

[39]  R. Ratcliff,et al.  A Diffusion Model Account of Criterion Shifts in the Lexical Decision Task. , 2008, Journal of memory and language.

[40]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[41]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[42]  R. Ratcliff,et al.  Modeling confidence and response time in recognition memory. , 2009, Psychological review.

[43]  Klaus Oberauer,et al.  How to use the diffusion model: Parameter recovery of three methods: EZ, fast-dm, and DMAT , 2009 .

[44]  R. Ratcliff,et al.  Sleep deprivation affects multiple distinct cognitive processes , 2009, Psychonomic bulletin & review.

[45]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[46]  Ulman Lindenberger,et al.  On the relation of mean reaction time and intraindividual reaction time variability. , 2009, Psychology and aging.

[47]  Eric-Jan Wagenmakers,et al.  Methodological and empirical developments for the Ratcliff diffusion model of response times and accuracy , 2009 .

[48]  Jochen Ditterich,et al.  A Comparison between Mechanisms of Multi-Alternative Perceptual Decision Making: Ability to Explain Human Behavior, Predictions for Neurophysiology, and Relationship with Decision Theory , 2010, Front. Neurosci..

[49]  Roger Ratcliff,et al.  Individual differences, aging, and IQ in two-choice tasks , 2010, Cognitive Psychology.

[50]  Richard P. Heitz,et al.  Neurally constrained modeling of perceptual decision making. , 2010, Psychological review.

[51]  R. Ratcliff,et al.  The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. , 2010, Psychology and aging.

[52]  Rafal Bogacz,et al.  Bounded Ornstein–Uhlenbeck models for two-choice time controlled tasks , 2010 .

[53]  Xiao-Jing Wang,et al.  Synaptic computation underlying probabilistic inference , 2010, Nature Neuroscience.

[54]  R. Ratcliff,et al.  Using diffusion models to understand clinical disorders. , 2010, Journal of mathematical psychology.

[55]  Harold Pashler,et al.  Effects of practice on task architecture: Combined evidence from interference experiments and random-walk models of decision making , 2011, Cognition.

[56]  Leanne Boucher,et al.  Neural Basis of Adaptive Response Time Adjustment during Saccade Countermanding , 2011, The Journal of Neuroscience.

[57]  Eric-Jan Wagenmakers,et al.  A diffusion model decomposition of the effects of alcohol on perceptual decision making , 2011, Psychopharmacology.

[58]  Thomas V. Wiecki,et al.  Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold , 2011, Nature Neuroscience.

[59]  Pradeep Shenoy,et al.  Rational Decision-Making in Inhibitory Control , 2011, Front. Hum. Neurosci..

[60]  Eric-Jan Wagenmakers,et al.  Does the name-race implicit association test measure racial prejudice? , 2011, Experimental psychology.

[61]  Mark Steyvers,et al.  An optimal adjustment procedure to minimize experiment time in decisions with multiple alternatives , 2012, Psychonomic bulletin & review.