Matching Behavior and the Representation of Value in the Parietal Cortex

Psychologists and economists have long appreciated the contribution of reward history and expectation to decision-making. Yet we know little about how specific histories of choice and reward lead to an internal representation of the “value” of possible actions. We approached this problem through an integrated application of behavioral, computational, and physiological techniques. Monkeys were placed in a dynamic foraging environment in which they had to track the changing values of alternative choices through time. In this context, the monkeys' foraging behavior provided a window into their subjective valuation. We found that a simple model based on reward history can duplicate this behavior and that neurons in the parietal cortex represent the relative value of competing actions predicted by this model.

[1]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[2]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[3]  D. E. Matthews.  Evolution and the Theory of Games , 1977 .

[4]  J. Krebs,et al.  Behavioural Ecology: An Evolutionary Approach , 1978 .

[5]  G M Heyman,et al.  A Markov model description of changeover probabilities on concurrent variable-interval schedules. , 1979, Journal of the experimental analysis of behavior.

[6]  W M Baum,et al.  Optimization and the matching law as accounts of instrumental behavior. , 1981, Journal of the experimental analysis of behavior.

[7]  C. Harley.  Learning the evolutionarily stable strategy. , 1981, Journal of theoretical biology.

[8]  J. Staddon,et al.  Limits to action, the allocation of individual behavior , 1982 .

[9]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[10]  M. Davison,et al.  The matching law: A research review. , 1988 .

[11]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[12]  R. Herrnstein,et al.  Melioration: A Theory of Distributed Choice , 1991 .

[13]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[14]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[15]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[16]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[17]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[18]  M. Davison,et al.  Choice in a variable environment: every reinforcer counts. , 2000, Journal of the experimental analysis of behavior.

[19]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[20]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[21]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[22]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[23]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[24]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[25]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[26]  W. Schultz.  Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology , 2004, Current Opinion in Neurobiology.

[27]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.