Categorical encoding of decision variables in orbitofrontal cortex

A fundamental and recurrent question in systems neuroscience is that of assessing what variables are encoded by a given population of neurons. Such assessments are often challenging because neurons in one brain area may encode multiple variables, and because neuronal representations might be categorical (different neurons encoding different variables) or mixed (individual neurons encoding a combination of variables). These issues are particularly pertinent to the representation of decision variables in the orbitofrontal cortex (OFC) – an area implicated in economic choices. Here we present a new algorithm to assess whether a neuronal representation is categorical or mixed, and to identify the encoded variables if the representation is indeed categorical. The algorithm is based on two clustering procedures, one variable-independent and the other variable-based. The two partitions are then compared through adjusted mutual information. The present algorithm overcomes limitations of previous approaches and is widely applicable. We tested the algorithm on synthetic data and then used it to examine neuronal data recorded in the primate OFC during economic decisions. Confirming previous assessments, we found the neuronal representation in OFC to be categorical in nature. We also found that neurons in this area encode the value of individual offers, the binary choice outcome and the chosen value. In other words, during economic choice, neurons in the primate OFC encode decision variables in a categorical way. Author Summary Mental functions such as sensory perception or decision making ultimately rely on the activity of neuronal populations in different brain regions. Much research in neuroscience is devoted to understanding how different groups of neurons support specific brain functions by representing behaviorally relevant variables. In this respect, one important question is whether individual neurons represent single variables, or linear combination of variables. Here we developed a new algorithm to assess this general issue. We then used the algorithm to examine neurons in the orbitofrontal cortex (OFC) recorded while non-human primates performed economic decisions. We found that different neurons represent different variables (categorical encoding). Specifically, neurons in the OFC encoded the value of individual offers, the binary choice outcome, and the chosen value. The present results support the hypothesis that economic decisions are formed within the OFC.

[1]  E. Salinas Context-dependent selection of visuomotor maps , 2004, BMC Neuroscience.

[2]  James Bailey,et al.  Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance , 2010, J. Mach. Learn. Res..

[3]  Katherine E. Conen,et al.  Orbitofrontal Cortex: A Neural Circuit for Economic Decisions , 2017, Neuron.

[4]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[5]  Tommy C. Blanchard,et al.  Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity , 2015, Neuron.

[6]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[7]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[8]  C. Padoa-Schioppa Neuronal Origins of Choice Variability in Economic Decisions , 2013, Neuron.

[9]  C. Padoa-Schioppa Neurobiology of economic choice: a good-based model. , 2011, Annual review of neuroscience.

[10]  Inderjit S. Dhillon,et al.  Iterative clustering of high dimensional text data augmented by local search , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[11]  Stefano Fusi,et al.  Why neurons mix: high dimensionality for higher cognition , 2016, Current Opinion in Neurobiology.

[12]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[13]  P. Glimcher,et al.  Dynamic Divisive Normalization Predicts Time-Varying Value Coding in Decision-Related Circuits , 2014, The Journal of Neuroscience.

[14]  Lior Rokach,et al.  Clustering Methods , 2005, The Data Mining and Knowledge Discovery Handbook.

[15]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[16]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.

[17]  Jianbo Shi,et al.  Multiclass spectral clustering , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  C. Salzman,et al.  Abstract Context Representations in Primate Amygdala and Prefrontal Cortex , 2015, Neuron.

[19]  Adam Kepecs,et al.  Categorical representations of decision-variables in orbitofrontal cortex , 2017, bioRxiv.

[20]  H. Francis Song,et al.  Reward-based training of recurrent neural networks for cognitive and value-based tasks , 2016, bioRxiv.

[21]  L. Hubert,et al.  Comparing partitions , 1985 .

[22]  W. Schultz,et al.  Coding of Reward Risk by Orbitofrontal Neurons Is Mostly Distinct from Coding of Reward Value , 2010, Neuron.

[23]  C. Padoa-Schioppa,et al.  Integration of Multiple Determinants in the Neuronal Computation of Economic Values , 2014, The Journal of Neuroscience.

[24]  Daeyeol Lee,et al.  Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice , 2011, Neuron.

[25]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[26]  Julia Hirschberg,et al.  V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure , 2007, EMNLP.

[27]  Peter Ford Dominey,et al.  Reservoir Computing Properties of Neural Dynamics in Prefrontal Cortex , 2016, PLoS Comput. Biol..

[28]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[29]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[30]  J. Wallis Cross-species studies of orbitofrontal cortex and value-based decision-making , 2011, Nature Neuroscience.

[31]  Shih-Cheng Yen,et al.  Mixed selectivity morphs population codes in prefrontal cortex , 2017, Nature Neuroscience.

[32]  Benjamin Y. Hayden,et al.  Robust mixture modeling reveals category-free selectivity in reward region neuronal ensembles , 2016 .

[33]  Tian Zhang,et al.  BIRCH: an efficient data clustering method for very large databases , 1996, SIGMOD '96.

[34]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[35]  D. Sculley,et al.  Web-scale k-means clustering , 2010, WWW '10.

[36]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[37]  B. Efron,et al.  The Jackknife Estimate of Variance , 1981 .

[38]  Alec Solway,et al.  Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. , 2012, Psychological review.

[39]  Camillo Padoa-Schioppa,et al.  Neuronal Remapping and Circuit Persistence in Economic Decisions , 2016, Nature Neuroscience.

[40]  C. Padoa-Schioppa,et al.  A neuro-computational model of economic decisions. , 2015, Journal of neurophysiology.

[41]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[42]  C. Padoa-Schioppa,et al.  Contributions of Orbitofrontal and Lateral Prefrontal Cortices to Economic Choice and the Good-to-Action Transformation , 2014, Neuron.

[43]  P. Cisek Making decisions through a distributed consensus , 2012, Current Opinion in Neurobiology.

[44]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[45]  Shi Zhong,et al.  Efficient online spherical k-means clustering , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[46]  James Bailey,et al.  Information theoretic measures for clusterings comparison: is a correction for chance necessary? , 2009, ICML '09.

[47]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[48]  Máté Lengyel,et al.  Goal-Directed Decision Making with Spiking Neurons , 2016, The Journal of Neuroscience.