A divisive model of evidence accumulation explains uneven weighting of evidence over time

Divisive normalization has long been used to account for computations in various neural processes and behaviours. The model proposes that inputs into a neural system are divisively normalized by the total activity of the system. More recently, dynamical versions of divisive normalization have been shown to account for how neural activity evolves over time in value-based decision making. Despite its ubiquity, divisive normalization has not been studied in decisions that require evidence to be integrated over time. Such decisions are important when we do not have all the information available at once. A key feature of such decisions is how evidence is weighted over time, known as the integration ‘kernel’. Here we provide a formal expression for the integration kernel in divisive normalization, and show that divisive normalization can quantitatively account for the perceptual decision making behaviour of 133 human participants, performing as well as the state-of-the-art Drift Diffusion Model, the predominant model for perceptual evidence accumulation.

[1]  Robert C. Wilson,et al.  Regulation of evidence accumulation by pupil-linked arousal processes , 2018, Nature Human Behaviour.

[2]  M. Carandini,et al.  Summation and division by neurons in primate visual cortex. , 1994, Science.

[3]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[4]  Alexandre Pouget,et al.  Optimal policy for value-based decision-making , 2016, Nature Communications.

[5]  Philip Holmes,et al.  Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards? , 2009, PLoS Comput. Biol..

[6]  Samuel W Cheadle,et al.  Adaptive Gain Control during Human Perceptual Choice , 2014, Neuron.

[7]  Richard P. Heitz,et al.  Neurally constrained modeling of perceptual decision making. , 2010, Psychological review.

[8]  Christopher Summerfield,et al.  Neural Mechanisms of Human Perceptual Choice Under Focused and Divided Attention , 2015, The Journal of Neuroscience.

[9]  M. Dean,et al.  How can neuroscience inform economics? , 2015, Current Opinion in Behavioral Sciences.

[10]  P. Glimcher,et al.  Dynamic Divisive Normalization Predicts Time-Varying Value Coding in Decision-Related Circuits , 2014, The Journal of Neuroscience.

[11]  J. Movshon,et al.  Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[12]  M. K. van Vugt,et al.  EEG Oscillations Reveal Neural Correlates of Evidence Accumulation , 2012, Front. Neurosci..

[13]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[14]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[15]  J. Rieskamp,et al.  Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain , 2012, The Journal of Neuroscience.

[16]  Timothy D. Hanks,et al.  Perceptual Decision Making in Rodents, Monkeys, and Humans , 2017, Neuron.

[17]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[18]  Marius Usher,et al.  The Timescale of Perceptual Evidence Integration Can Be Adapted to the Environment , 2013, Current Biology.

[19]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[20]  Jan Zimmermann,et al.  Multiple timescales of normalized value coding underlie adaptive choice behavior , 2018, Nature Communications.

[21]  Philip Holmes,et al.  A Neural Network Model of the Eriksen Task: Reduction, Analysis, and Data Fitting , 2008, Neural Computation.

[22]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[23]  Alexandre Pouget,et al.  Optimal policy for multi-alternative decisions , 2019 .

[24]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[25]  Ahmed El Hady,et al.  Rats adopt the optimal timescale for evidence integration in a dynamic environment , 2018, Nature Communications.

[26]  Timothy D. Hanks,et al.  Causal contribution and dynamical encoding in the striatum during evidence accumulation , 2018, bioRxiv.

[27]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[28]  Christof Koch,et al.  The Drift Diffusion Model Can Account for the Accuracy and Reaction Time of Value-Based Choices Under High and Low Time Pressure , 2010, Judgment and Decision Making.

[29]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[30]  Colin Camerer,et al.  The Attentional Drift-Diffusion Model Extends to Simple Purchasing Decisions , 2012, Front. Psychology.

[31]  Jacob L Yates,et al.  The Role of the Lateral Intraparietal Area in (the Study of) Decision Making. , 2017, Annual review of neuroscience.

[32]  Ulrike Basten,et al.  How the brain integrates costs and bene fi ts during decision making , 2010 .

[33]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[34]  Jonathan W. Pillow,et al.  Dissociated functional significance of decision-related activity in the primate dorsal stream , 2016, Nature.

[35]  Shawn R. Olsen,et al.  Divisive Normalization in Olfactory Population Codes , 2010, Neuron.

[36]  Leif H. Finkel,et al.  A Neural Implementation of the Kalman Filter , 2009, NIPS.

[37]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[38]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[39]  Il Memming Park,et al.  Functional dissection of signal and noise in MT and LIP during decision-making , 2017, Nature Neuroscience.

[40]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[41]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[42]  F. Blankenburg,et al.  Causal Role of Dorsolateral Prefrontal Cortex in Human Perceptual Decision Making , 2011, Current Biology.

[43]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[44]  Bingni W. Brunton,et al.  Rats and Humans Can Optimally Accumulate Evidence for Decision-Making , 2013, Science.

[45]  R. Ratcliff A diffusion model account of response time and accuracy in a brightness discrimination task: Fitting real data and failing to fit fake but plausible data , 2002, Psychonomic bulletin & review.

[46]  J. Gold,et al.  Caudate Encodes Multiple Computations for Perceptual Decisions , 2010, The Journal of Neuroscience.

[47]  S. Morad,et al.  Ceramide-orchestrated signalling in cancer cells , 2012, Nature Reviews Cancer.

[48]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[49]  U. Noppeney,et al.  Perceptual Decisions Formed by Accumulation of Audiovisual Evidence in Prefrontal Cortex , 2010, The Journal of Neuroscience.

[50]  P. Glimcher,et al.  Reward Value-Based Gain Control: Divisive Normalization in Parietal Cortex , 2011, The Journal of Neuroscience.

[51]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.