Tuning the speed-accuracy trade-off to maximize reward rate in multisensory decision-making

For decisions made under time pressure, effective decision making based on uncertain or ambiguous evidence requires efficient accumulation of evidence over time, as well as appropriately balancing speed and accuracy, known as the speed/accuracy trade-off. For simple unimodal stimuli, previous studies have shown that human subjects set their speed/accuracy trade-off to maximize reward rate. We extend this analysis to situations in which information is provided by multiple sensory modalities. Analyzing previously collected data (Drugowitsch et al., 2014), we show that human subjects adjust their speed/accuracy trade-off to produce near-optimal reward rates. This trade-off can change rapidly across trials according to the sensory modalities involved, suggesting that it is represented by neural population codes rather than implemented by slow neuronal mechanisms such as gradual changes in synaptic weights. Furthermore, we show that deviations from the optimal speed/accuracy trade-off can be explained by assuming an incomplete gradient-based learning of these trade-offs. DOI: http://dx.doi.org/10.7554/eLife.06678.001

[1]  Jerome R. Busemeyer,et al.  Criterion Learning in a Deferred Decision-Making Task , 1989 .

[2]  R. Carpenter,et al.  The influence of urgency on decision time , 2000, Nature Neuroscience.

[3]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[4]  Emilio Salinas,et al.  Decoupling speed and accuracy in an urgent decision-making task reveals multiple contributions to their trade-off , 2014, Front. Neurosci..

[5]  M. Shadlen,et al.  A Neural Implementation of Wald’s Sequential Probability Ratio Test , 2015, Neuron.

[6]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[7]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[8]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[9]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[10]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[11]  Jonathan D. Cohen,et al.  Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions. , 2009, Journal of experimental psychology. Human perception and performance.

[12]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[13]  Andrew M. Saxe,et al.  Acquisition of decision making criteria: reward rate ultimately beats accuracy , 2011, Attention, perception & psychophysics.

[14]  Philip Holmes,et al.  Rapid decision threshold modulation by reward rate in a neural network , 2006, Neural Networks.

[15]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[16]  M Zacksenhouse,et al.  Robust versus optimal strategies for two-alternative forced choice tasks. , 2010, Journal of mathematical psychology.

[17]  Richard P. Heitz,et al.  Neural Mechanisms of Speed-Accuracy Tradeoff , 2012, Neuron.

[18]  Hauke R Heekeren,et al.  Changes in Neural Connectivity Underlie Decision Threshold Modulation for Reward Maximization , 2012, The Journal of Neuroscience.

[19]  Alexandre Pouget,et al.  Optimal multisensory decision-making in a reaction-time task , 2014, eLife.

[20]  Jonathan D. Cohen,et al.  The Quarterly Journal of Experimental Psychology Do Humans Produce the Speed–accuracy Trade-off That Maximizes Reward Rate? , 2022 .

[21]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[22]  Roozbeh Kiani,et al.  A neural mechanism of speed-accuracy tradeoff in macaque area LIP , 2014, eLife.

[23]  B A J Reddi,et al.  Accuracy, information, and response time in a saccadic decision task. , 2003, Journal of neurophysiology.

[24]  J. Schall Neural correlates of decision processes: neural and mental chronometry , 2003, Current Opinion in Neurobiology.