Orbitofrontal cortical activity during repeated free choice.

Neurons in the orbitofrontal cortex (OFC) have been shown to encode subjective values, suggesting a role in preference-based decision-making, although the precise relation to choice behavior is unclear. In a repeated two-choice task, subjective values of each choice can account for aggregate choice behavior, which is the overall likelihood of choosing one option over the other. Individual choices, however, are impossible to predict with knowledge of relative subjective values alone. In this study we investigated the role of internal factors in choice behavior with a simple but novel free-choice task and simultaneous recording from individual neurons in nonhuman primate OFC. We found that, first, the observed sequences of choice behavior included periods of exceptionally long runs of each of two available options and periods of frequent switching. Neither a satiety-based mechanism nor a random selection process could explain the observed choice behavior. Second, OFC neurons encode important features of the choice behavior. These features include activity selective for exceptionally long runs of a given choice (stay selectivity) as well as activity selective for switches between choices (switch selectivity). These results suggest that OFC neural activity, in addition to encoding subjective values on a long timescale that is sensitive to satiety, also encodes a signal that fluctuates on a shorter timescale and thereby reflects some of the statistically improbable aspects of free-choice behavior.

[1]  Miguel A L Nicolelis,et al.  Orbitofrontal ensemble activity monitors licking and distinguishes among natural rewards. , 2006, Journal of neurophysiology.

[2]  M. Farah,et al.  Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. , 2004, Cerebral cortex.

[3]  E. Rolls,et al.  Novel visual stimuli activate a population of neurons in the primate orbitofrontal cortex , 2005, Neurobiology of Learning and Memory.

[4]  T. Robbins,et al.  Cognitive Inflexibility After Prefrontal Serotonin Depletion , 2004, Science.

[5]  O. Hikosaka,et al.  Role for Subthalamic Nucleus Neurons in Switching from Automatic to Controlled Eye Movement , 2008, The Journal of Neuroscience.

[6]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[7]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[8]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[9]  Elizabeth A. Mannix,et al.  Should I Stay or Should I Go? , 2003 .

[10]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[11]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[12]  James Buchan,et al.  Should I stay or should I go? , 2005, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[13]  Albert-László Barabási,et al.  The origin of bursts and heavy tails in human dynamics , 2005, Nature.

[14]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[15]  G. V. Van Hoesen,et al.  Prefrontal cortex in humans and apes: a comparative study of area 10. , 2001, American journal of physical anthropology.

[16]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[17]  Jonathan D. Cohen,et al.  Adaptive gain and the role of the locus coeruleus–norepinephrine system in optimal performance , 2005, The Journal of comparative neurology.

[18]  Owen Holland,et al.  An investigation of two mediation strategies suitable for behavioural control in animals and animats , 1991 .

[19]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[20]  Mikhail Katkov,et al.  Interactions between decision criteria estimated using external noise methods , 2010 .

[21]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[22]  M. Walton,et al.  Interactions between decision making and performance monitoring within prefrontal cortex , 2004, Nature Neuroscience.

[23]  Antonio Rangel,et al.  Neural computations associated with goal-directed choice , 2010, Current Opinion in Neurobiology.

[24]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[25]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[26]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[27]  D. McFarland.  Problems of animal behaviour , 1989 .

[28]  Mark A. Kramer,et al.  Drawing inferences from Fano factor calculations , 2010, Journal of Neuroscience Methods.

[29]  J. O'Doherty,et al.  Temporal isolation of neural processes underlying face preference decisions , 2007, Proceedings of the National Academy of Sciences.

[30]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[31]  H. Seung,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 581–617 NUMBER 3(NOVEMBER) LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS , 2022 .

[32]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[33]  Mark D. Humphries,et al.  A robot model of the basal ganglia: Behavior and intrinsic processing , 2006, Neural Networks.

[34]  E. Rolls,et al.  Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. , 1996, Journal of neurophysiology.

[35]  O. Hikosaka,et al.  Switching from automatic to controlled action by monkey medial frontal cortex , 2007, Nature Neuroscience.