Outcome Modulation Across Tasks in the Primate Dorsolateral Prefrontal Cortex

Animals need to learn and to adapt to new and changing environments so that appropriate actions that lead to desirable outcomes are acquired within each context. The prefrontal cortex (PF) is known to underlie such function that directly implies that the outcome of each response must be represented in the brain for behavioral policies update. However, whether such PF signal is context dependent or it is a general representation beyond the specificity of a context is still unclear. Here, we analyzed the activity of neurons in the dorsolateral PF (PFdl) recorded while two monkeys performed two perceptual magnitude discrimination tasks. Both tasks were well known by the monkeys and unexpected changes did not occur but the difficulty of the task varied from trial to trial and thus the monkeys made mistakes in a proportion of trials. We show a context-independent coding of the response outcome with neurons maintaining similar selectivity in both task contexts. Using a classification method of the neural activity, we also show that the trial outcome could be well predicted from the activity of the same neurons in the two contexts. Altogether, our results provide evidence of high degree of outcome generality in PFdl.

[1]  W. Schultz,et al.  Responses to reward in monkey dorsal and ventral striatum , 2004, Experimental Brain Research.

[2]  S. Wise,et al.  Encoding problem‐solving strategies in prefrontal cortex: activity during strategic errors , 2008, The European journal of neuroscience.

[3]  Shintaro Funahashi,et al.  Reward-period Activity in Primate Dorsolateral Prefrontal and Orbitofrontal Neurons Is Affected by Reward Schedules , 2006 .

[4]  Etienne Koechlin,et al.  An evolutionary computational theory of prefrontal executive function in decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[6]  D. Stuss,et al.  Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: effects of lesion location and test structure on separable cognitive processes , 2000, Neuropsychologia.

[7]  Sara E. Morrison,et al.  Different Time Courses for Learning-Related Changes in Amygdala and Orbitofrontal Cortex , 2011, Neuron.

[8]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[9]  Aldo Genovesio,et al.  Feature- and Order-Based Timing Representations in the Frontal Cortex , 2009, Neuron.

[10]  E. Miller,et al.  Neural Substrates of Dopamine D2 Receptor Modulated Executive Functions in the Monkey Prefrontal Cortex. , 2015, Cerebral cortex.

[11]  C. Gerfen,et al.  The frontal cortex-basal ganglia system in primates. , 1996, Critical reviews in neurobiology.

[12]  Keiji Tanaka,et al.  Prefrontal Cell Activities Related to Monkeys' Success and Failure in Adapting to Rule Changes in a Wisconsin Card Sorting Test Analog , 2006, The Journal of Neuroscience.

[13]  S. Wise,et al.  Comparison of Strategy Signals in the Dorsolateral and Orbital Prefrontal Cortex , 2011, The Journal of Neuroscience.

[14]  L. Snyder,et al.  Neural correlates of executive control functions in the monkey , 2009, Trends in Cognitive Sciences.

[15]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[16]  Camillo Padoa-Schioppa,et al.  Neuronal Remapping and Circuit Persistence in Economic Decisions , 2016, Nature Neuroscience.

[17]  S. Kennerley,et al.  Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables , 2009, The European journal of neuroscience.

[18]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[19]  S. Tsujimoto,et al.  Event- and time-dependent decline of outcome information in the primate prefrontal cortex , 2016, Scientific Reports.

[20]  Andrew R. Mitz,et al.  Prefrontal Cortex Activity Related to Abstract Response Strategies , 2005, Neuron.

[21]  Mikhail A. Lebedev,et al.  How to read neuron-dropping curves? , 2014, Front. Syst. Neurosci..

[22]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[23]  Aldo Genovesio,et al.  Encoding Goals but Not Abstract Magnitude in the Primate Prefrontal Cortex , 2012, Neuron.

[24]  J. E. Obrzut,et al.  The impact of frontal and non-frontal brain tumor lesions on Wisconsin Card Sorting Test performance , 2004, Brain and Cognition.

[25]  S. Wise,et al.  Rule-dependent neuronal activity in the prefrontal cortex , 1999, Experimental Brain Research.

[26]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[27]  Paul Apicella,et al.  Leading tonically active neurons of the striatum from reward detection to context recognition , 2007, Trends in Neurosciences.

[28]  A. Mikami,et al.  Activity of single neurons in the monkey amygdala during performance of a visual discrimination task. , 1992, Journal of neurophysiology.

[29]  Guglielmo Foffani,et al.  PSTH-based classification of sensory stimuli using ensembles of single neurons , 2004, Journal of Neuroscience Methods.

[30]  B. Richmond,et al.  Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. , 1996, Journal of neurophysiology.

[31]  S. Wise,et al.  Autonomous Encoding of Irrelevant Goals and Outcomes by Prefrontal Cortex Neurons , 2014, The Journal of Neuroscience.

[32]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[33]  Yali Amit,et al.  Single-unit stability using chronically implanted multielectrode arrays. , 2009, Journal of neurophysiology.

[34]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[35]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[36]  J Schlag,et al.  Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. , 2000, Journal of neurophysiology.

[37]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[38]  Aldo Genovesio,et al.  Transient neuronal correlations underlying goal selection and maintenance in prefrontal cortex. , 2008, Cerebral cortex.

[39]  Aldo Genovesio,et al.  Independent coding of absolute duration and distance magnitudes in the prefrontal cortex. , 2017, Journal of neurophysiology.

[40]  Masataka Watanabe,et al.  The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units , 1989, Neuroscience Letters.

[41]  P. Apicella,et al.  Reward Unpredictability inside and outside of a Task Context as a Determinant of the Responses of Tonically Active Neurons in the Monkey Striatum , 2001, The Journal of Neuroscience.

[42]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[43]  Philip G. F. Browning,et al.  Dissociable Components of Rule-Guided Behavior Depend on Distinct Medial and Prefrontal Regions , 2009, Science.

[44]  S. Wise,et al.  Context-Dependent Duration Signals in the Primate Prefrontal Cortex. , 2016, Cerebral cortex.

[45]  Gustavo Deco,et al.  Neural Variability in Premotor Cortex Is Modulated by Trial History and Predicts Behavioral Performance , 2013, Neuron.

[46]  H. Damasio,et al.  Wisconsin Card Sorting Test performance as a measure of frontal lobe damage. , 1991, Journal of clinical and experimental neuropsychology.

[47]  Jerald D. Kralik,et al.  Representation of Attended Versus Remembered Locations in Prefrontal Cortex , 2004, PLoS biology.

[48]  Yoon Woo Byun,et al.  Cortical neurons multiplex reward-related signals along with sensory and motor information , 2017, Proceedings of the National Academy of Sciences.

[49]  Aldo Genovesio,et al.  Prefrontal Cortex Activity during the Discrimination of Relative Distance , 2011, The Journal of Neuroscience.

[50]  M. Puig,et al.  Prefrontal dopamine in associative learning and memory , 2014, Neuroscience.

[51]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[52]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[53]  H. Seo,et al.  Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. , 2007, Cerebral cortex.

[54]  Masahiko Inase,et al.  Striatal neurons encoded temporal information in duration discrimination task , 2008, Experimental Brain Research.

[55]  P. Apicella,et al.  Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context , 2009, The European journal of neuroscience.

[56]  P. Apicella,et al.  Influence of the predicted time of stimuli eliciting movements on responses of tonically active neurons in the monkey striatum , 2000, The European journal of neuroscience.

[57]  E. Vaadia,et al.  Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons , 2004, Neuron.

[58]  E. Miller,et al.  The Role of Prefrontal Dopamine D1 Receptors in the Neural Mechanisms of Associative Learning , 2012, Neuron.

[59]  S P Wise,et al.  The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta). , 2001, Behavioral neuroscience.

[60]  K. Sakai Task set and prefrontal cortex. , 2008, Annual review of neuroscience.

[61]  S. Tsujimoto,et al.  Context-dependent representation of response-outcome in monkey prefrontal neurons. , 2005, Cerebral cortex.

[62]  S. Wise,et al.  Neuronal Activity during a Cued Strategy Task: Comparison of Dorsolateral, Orbital, and Polar Prefrontal Cortex , 2012, The Journal of Neuroscience.

[63]  S. Thorpe,et al.  The orbitofrontal cortex: Neuronal activity in the behaving monkey , 2004, Experimental Brain Research.