Optimal decision-making theories

Publisher Summary This chapter reviews theories proposing that the brain implements statistically optimal strategies for decision-making on the basis of noisy information. These strategies maximize the accuracy and speed of decisions, as well as the rate of receiving rewards for correct choices. The chapter reviews computational models of cortical decision circuits that can optimally perform choices between two alternatives. It has been proposed that the optimal strategy for choice between multiple alternatives is implemented in the cortico-basal-ganglia circuit. A model of cortico-basal-ganglia circuit that implements the optimal strategy for choice between multiple alternatives has been described. In the proposed model, the cortico-basal-ganglia circuit computes the posterior probabilities of alternatives being correct, given the sensory evidence. Furthermore, the chapter shows how the basal ganglia may modulate decision processes in the cortex, allowing cortical neurons to represent the probabilities of alternative choices being correct. For each set of theories, their predictions are compared with existing experimental data.

[1]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[2]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[3]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[4]  Kevin N. Gurney,et al.  The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions , 2007, Neural Computation.

[5]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[6]  Charles J. Wilson,et al.  Apamin-Sensitive Small Conductance Calcium-Activated Potassium Channels, through their Selective Coupling to Voltage-Gated Calcium Channels, Are Critical Determinants of the Precision, Pace, and Pattern of Action Potential Generation in Rat Subthalamic Nucleus Neurons In Vitro , 2003, The Journal of Neuroscience.

[7]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[8]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[9]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[10]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[11]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[12]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[13]  H. Kita,et al.  Intracellular study of rat globus pallidus neurons: membrane properties and responses to neostriatal, subthalamic and nigral stimulation , 1991, Brain Research.

[14]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spinal/tecto-diencephalic neurons , 1985, Brain Research.

[15]  Jochen Ditterich,et al.  Stochastic models of decisions about motion direction: Behavior and physiology , 2006, Neural Networks.

[16]  J. Rothwell,et al.  The impact of deep brain stimulation on executive function in Parkinson's disease. , 2000, Brain : a journal of neurology.

[17]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[18]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[19]  Michael J. Frank,et al.  Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making , 2006, Neural Networks.

[20]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[21]  Charles J. Wilson,et al.  A model of reverse spike frequency adaptation and repetitive firing of subthalamic nucleus neurons. , 2004, Journal of neurophysiology.

[22]  M. Stone.  Models for choice-reaction time , 1960 .

[23]  R. Ratcliff,et al.  A diffusion model analysis of the effects of aging on brightness discrimination , 2003, Perception & psychophysics.

[24]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[25]  M. Shadlen,et al.  Microstimulation of visual cortex affects the speed of perceptual decisions , 2003, Nature Neuroscience.

[26]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[27]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[28]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[29]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[30]  R. Bogacz.  Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[31]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[32]  J. Mink.  THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[33]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[34]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[35]  Dennis Norris,et al.  The Bayesian reader: explaining word recognition as an optimal Bayesian decision process. , 2006, Psychological review.

[36]  A. Parent,et al.  Anatomical aspects of information processing in primate basal ganglia , 1993, Trends in Neurosciences.

[37]  Jeffrey N. Rouder,et al.  A diffusion model account of masking in two-choice letter identification. , 2000, Journal of experimental psychology. Human perception and performance.

[38]  R. Llinás,et al.  Electrophysiology of globus pallidus neurons in vitro. , 1994, Journal of neurophysiology.

[39]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[40]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[41]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[42]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[43]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[44]  A. Parent,et al.  Organization of efferent projections of the subthalamic nucleus in the squirrel monkey as revealed by retrograde labeling methods , 1987, Brain Research.

[45]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[46]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[47]  M. D. Crutcher,et al.  Relations between parameters of step-tracking movements and single cell discharge in the globus pallidus and subthalamic nucleus of the behaving monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Michael J. Frank,et al.  Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism , 2007, Science.

[49]  Ziv M. Williams,et al.  Timing and direction selectivity of subthalamic and pallidal neurons in patients with Parkinson disease , 2005, Experimental Brain Research.

[50]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[51]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[52]  Venugopal V. Veeravalli,et al.  A sequential procedure for multihypothesis testing , 1994, IEEE Trans. Inf. Theory.

[53]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[54]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[55]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus , 1985, Brain Research.

[56]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[57]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[58]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[59]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[60]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[61]  S. Lehéricy,et al.  Foot, hand, face and eye representation in the human striatum. , 2003, Cerebral cortex.

[62]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[63]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[64]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions , 1990, Trends in Neurosciences.