Optimal decision making in neural inhibition models.

In their influential Psychological Review article, Bogacz, Brown, Moehlis, Holmes, and Cohen (2006) discussed optimal decision making as accomplished by the drift diffusion model (DDM). The authors showed that neural inhibition models, such as the leaky competing accumulator model (LCA) and the feedforward inhibition model (FFI), can mimic the DDM and accomplish optimal decision making. Here we show that these conclusions depend on how the models handle negative activation values and (for the LCA) across-trial variability in response conservativeness. Negative neural activations are undesirable for both neurophysiological and mathematical reasons. However, when negative activations are truncated to 0, the equivalence to the DDM is lost. Simulations show that this concern has practical ramifications: the DDM generally outperforms truncated versions of the LCA and the FFI, and the parameter estimates from the neural models can no longer be mapped onto those of the DDM in a simple fashion. We show that for both models, truncation may be avoided by assuming a baseline activity for each accumulator. This solution allows the LCA to approximate the DDM and the FFI to be identical to the DDM.

[1]  J. Schall Neuronal activity related to visually guided saccades in the frontal eye fields of rhesus monkeys: comparison with supplementary eye fields. , 1991, Journal of neurophysiology.

[2]  Roger Ratcliff,et al.  Individual differences, aging, and IQ in two-choice tasks , 2010, Cognitive Psychology.

[3]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[4]  Marius Usher,et al.  Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  Leanne Boucher,et al.  Neural Basis of Adaptive Response Time Adjustment during Saccade Countermanding , 2011, The Journal of Neuroscience.

[6]  Klaus Oberauer,et al.  Individual differences in components of reaction time distributions and their relations to working memory and intelligence. , 2007, Journal of experimental psychology. General.

[7]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[8]  J. Schall,et al.  Role of frontal eye fields in countermanding saccades: visual, movement, and fixation activity. , 1998, Journal of neurophysiology.

[9]  Iain D. Gilchrist,et al.  Consistent Implementation of Decisions in the Brain , 2012, PloS one.

[10]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[11]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[12]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[13]  Harold Pashler,et al.  Effects of practice on task architecture: Combined evidence from interference experiments and random-walk models of decision making , 2011, Cognition.

[14]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[15]  R. Ratcliff,et al.  Modeling confidence and response time in recognition memory. , 2009, Psychological review.

[16]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[17]  Pradeep Shenoy,et al.  Rational Decision-Making in Inhibitory Control , 2011, Front. Hum. Neurosci..

[18]  Marius Usher,et al.  Testing Multi-Alternative Decision Models with Non-Stationary Evidence , 2011, Front. Neurosci..

[19]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[20]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[21]  S. Grossberg Neural Networks and Natural Intelligence , 1988 .

[22]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[23]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[24]  Klaus Oberauer,et al.  How to use the diffusion model: Parameter recovery of three methods: EZ, fast-dm, and DMAT , 2009 .

[25]  Jochen Ditterich,et al.  Stochastic models of decisions about motion direction: Behavior and physiology , 2006, Neural Networks.

[26]  G. Āllport Personality: A Psychological Interpretation , 1938 .

[27]  R. Ratcliff,et al.  A diffusion model analysis of the effects of aging in the lexical-decision task. , 2004, Psychology and aging.

[28]  Philip L. Smith,et al.  Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. , 2007, Journal of neurophysiology.

[29]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[30]  R. Ratcliff,et al.  The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. , 2010, Psychology and aging.

[31]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[32]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[33]  Eric-Jan Wagenmakers,et al.  Methodological and empirical developments for the Ratcliff diffusion model of response times and accuracy , 2009 .

[34]  Eric-Jan Wagenmakers,et al.  An EZ-diffusion model for response time and accuracy , 2007, Psychonomic bulletin & review.

[35]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[36]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[37]  Eric-Jan Wagenmakers,et al.  A diffusion model decomposition of the effects of alcohol on perceptual decision making , 2011, Psychopharmacology.

[38]  Eric-Jan Wagenmakers,et al.  Does the name-race implicit association test measure racial prejudice? , 2011, Experimental psychology.

[39]  Thomas V. Wiecki,et al.  Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold , 2011, Nature Neuroscience.

[40]  R. Ratcliff,et al.  Using diffusion models to understand clinical disorders. , 2010, Journal of mathematical psychology.

[41]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[42]  Rafal Bogacz,et al.  Bounded Ornstein–Uhlenbeck models for two-choice time controlled tasks , 2010 .

[43]  Kevin N. Gurney,et al.  The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions , 2007, Neural Computation.

[44]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[45]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.

[46]  Jochen Ditterich,et al.  A Comparison between Mechanisms of Multi-Alternative Perceptual Decision Making: Ability to Explain Human Behavior, Predictions for Neurophysiology, and Relationship with Decision Theory , 2010, Front. Neurosci..

[47]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[48]  Richard P. Heitz,et al.  Neurally constrained modeling of perceptual decision making. , 2010, Psychological review.

[49]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[50]  Wei Ji Ma,et al.  Spiking networks for Bayesian inference and choice , 2008, Current Opinion in Neurobiology.

[51]  R. Ratcliff,et al.  Sleep deprivation affects multiple distinct cognitive processes , 2009, Psychonomic bulletin & review.

[52]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[53]  Jeffrey N. Rouder,et al.  A diffusion model account of masking in two-choice letter identification. , 2000, Journal of experimental psychology. Human perception and performance.

[54]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[55]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[56]  R. Ratcliff,et al.  A Diffusion Model Account of Criterion Shifts in the Lexical Decision Task. , 2008, Journal of memory and language.

[57]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[58]  Xiao-Jing Wang,et al.  Synaptic computation underlying probabilistic inference , 2010, Nature Neuroscience.

[59]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[60]  Karl Christoph Klauer,et al.  Process components of the Implicit Association Test: a diffusion-model analysis. , 2007, Journal of personality and social psychology.

[61]  R. Ratcliff,et al.  Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability , 2002, Psychonomic bulletin & review.

[62]  J. Wolfowitz Remark on the Optimum Character of the Sequential Probability Ratio Test , 1966 .

[63]  J. Townsend,et al.  Multialternative Decision Field Theory: A Dynamic Connectionist Model of Decision Making , 2001 .

[64]  R. Wurtz,et al.  Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells. , 1995, Journal of neurophysiology.

[65]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[66]  Mark Steyvers,et al.  An optimal adjustment procedure to minimize experiment time in decisions with multiple alternatives , 2012, Psychonomic bulletin & review.

[67]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[68]  D. Sparks,et al.  Dissociation of visual and saccade-related responses in superior colliculus neurons. , 1980, Journal of neurophysiology.

[69]  Philip Holmes,et al.  Rapid decision threshold modulation by reward rate in a neural network , 2006, Neural Networks.

[70]  Ulman Lindenberger,et al.  On the relation of mean reaction time and intraindividual reaction time variability. , 2009, Psychology and aging.

[71]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[72]  Adele Diederich,et al.  Contrast effects or loss aversion? Comment on Usher and McClelland (2004). , 2005, Psychological review.

[73]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.