Optimal decision network with distributed representation

On the basis of detailed analysis of reaction times and neurophysiological data from tasks involving choice, it has been proposed that the brain implements an optimal statistical test during simple perceptual decisions. It has been shown recently how this optimal test can be implemented in biologically plausible models of decision networks, but this analysis was restricted to very simplified localist models which include abstract units describing activity of whole cell assemblies rather than individual neurons. This paper derives the optimal parameters in a model of a decision network including individual neurons, in which the alternatives are represented by distributed patterns of neuronal activity. It is also shown how the optimal weights in the decision network can be learnt via iterative rules using information accessible for individual synapses. Simulations demonstrate that the network with the optimal synaptic weights achieves better performance and matches fundamental behavioural regularities observed in choice tasks (Hick's law and the relationship between the error rate and the time for decision) better than a network with synaptic weights set according to a standard Hebb rule.

[1]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[2]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[3]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[4]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[5]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[6]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[7]  Philip Holmes,et al.  Simple Neural Networks that Optimize Decisions , 2005, Int. J. Bifurc. Chaos.

[8]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[9]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[10]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[11]  Bruno B Averbeck,et al.  Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. , 2005, Journal of neurophysiology.

[12]  Kenneth A. Norman,et al.  How Inhibitory Oscillations Can Train Neural Networks and Punish Competitors , 2006, Neural Computation.

[13]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[14]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[15]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[16]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[17]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[18]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[19]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[20]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.

[21]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[22]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[23]  R. Desimone,et al.  Clustering of perirhinal neurons with similar properties following visual experience in adult monkeys , 2000, Nature Neuroscience.

[24]  Erkki Oja,et al.  Neural Networks, Principal Components, and Subspaces , 1989, Int. J. Neural Syst..

[25]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[26]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[27]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[28]  Martin J. McKeown,et al.  When Do Epileptic Seizures Really Begin? , 2001, Neuron.

[29]  W H Teichner,et al.  Laws of visual choice reaction time. , 1974, Psychological review.

[30]  Marc H. Schieber,et al.  Neural Coding of Finger and Wrist Movements , 2004, Journal of Computational Neuroscience.

[31]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[32]  Opper,et al.  Learning of correlated patterns in spin-glass networks by local learning rules. , 1987, Physical review letters.

[33]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[34]  M. D. Crutcher,et al.  Relations between parameters of step-tracking movements and single cell discharge in the globus pallidus and subthalamic nucleus of the behaving monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  M. W. Brown,et al.  Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe , 1998, Neuropharmacology.

[36]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[37]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[38]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[39]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[40]  M. Stone Models for choice-reaction time , 1960 .

[41]  J. Chapin Using multi-neuron population recordings for neural prosthetics , 2004, Nature Neuroscience.

[42]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[43]  Takashi R Sato,et al.  Search Efficiency but Not Response Interference Affects Visual Selection in Frontal Eye Field , 2001, Neuron.

[44]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[45]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[46]  C. Koch,et al.  Category-specific visual responses of single neurons in the human medial temporal lobe , 2000, Nature Neuroscience.

[47]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[48]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[49]  G. A. Barnard,et al.  Sequential Tests in Industrial Statistics , 1946 .

[50]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[51]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[52]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[53]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[54]  V. Arshavsky,et al.  Like Night and Day Rods and Cones Have Different Pigment Regeneration Pathways , 2002, Neuron.

[55]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[56]  B A Reddi Decision making: The two stages of neuronal judgement , 2001, Current Biology.

[57]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[58]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[59]  M. Schieber,et al.  How somatotopic is the motor cortex hand area? , 1993, Science.

[60]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[61]  M. Shadlen,et al.  Microstimulation of visual cortex affects the speed of perceptual decisions , 2003, Nature Neuroscience.