Neuronal adaptation and optimal coding in economic decisions

During economic decisions, neurons in orbitofrontal cortex (OFC) encode the values of offered and chosen goods. Importantly, their responses adapt to the range of values available in any given context. A fundamental and open question is whether range adaptation is behaviorally advantageous. Here we develop a theoretical framework to assess optimal coding for economic decisions and we examine the activity of offer value cells in non-human primates. We show that firing rates are quasi-linear functions of the offered values. Furthermore, we demonstrate that if response functions are linear, range adaptation maximizes the expected payoff. This is true even if adaptation is corrected to avoid choice biases. Finally, we show that neuronal responses are quasi-linear even when optimal tuning functions would be highly non-linear. Thus value coding in OFC is functionally rigid (linear responses) but parametrically plastic (range adaptation with optimal gain). While generally suboptimal, linear response functions may facilitate transitive choices.

[1]  A. Tversky,et al.  Context-dependent preferences , 1993 .

[2]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[3]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  D. Ariely,et al.  “Coherent Arbitrariness”: Stable Demand Curves Without Stable Preferences , 2003 .

[5]  B. Ronacher,et al.  A Neural Mechanism for Time-Window Separation Resolves Ambiguity of Adaptive Coding , 2015, PLoS biology.

[6]  D. McAlpine,et al.  Gain control mechanisms in the auditory pathway , 2009, Current Opinion in Neurobiology.

[7]  C. Padoa-Schioppa Neurobiology of economic choice: a good-based model. , 2011, Annual review of neuroscience.

[8]  M. Webster Adaptation and visual coding. , 2011, Journal of vision.

[9]  J. Kable,et al.  Ventromedial Frontal Lobe Damage Disrupts Value Maximization in Humans , 2011, The Journal of Neuroscience.

[10]  S. Glantz,et al.  Primer of Applied Regression & Analysis of Variance , 1990 .

[11]  P. Glimcher,et al.  Dynamic Divisive Normalization Predicts Time-Varying Value Coding in Decision-Related Circuits , 2014, The Journal of Neuroscience.

[12]  P. Glaister Least squares revisited , 2001 .

[13]  Nicolas Brunel,et al.  Mutual Information, Fisher Information, and Population Coding , 1998, Neural Computation.

[14]  W. Schultz,et al.  Adaptation of Reward Sensitivity in Orbitofrontal Neurons , 2010, The Journal of Neuroscience.

[15]  Johannes M. Mayrhofer,et al.  Tactile frequency discrimination is enhanced by circumventing neocortical adaptation , 2014, Nature Neuroscience.

[16]  C. Padoa-Schioppa Neuronal Origins of Choice Variability in Economic Decisions , 2013, Neuron.

[17]  Virginia A. Clark,et al.  Applied Statistics: Analysis of Variance and Regression. , 1975 .

[18]  Raid Amin,et al.  Applied Statistics: Analysis of Variance and Regression , 2004, Technometrics.

[19]  Wolfram Schultz,et al.  Scaling prediction errors to reward variability benefits error-driven learning in humans , 2015, Journal of neurophysiology.

[20]  Paul Glaister,et al.  85.13 Least squares revisited , 2001, The Mathematical Gazette.

[21]  J. Oller,et al.  Consensus and controversy , 1984 .

[22]  G. Rhodes,et al.  Sex-specific norms code face identity. , 2011, Journal of vision.

[23]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[24]  P. Dayan,et al.  Space and time in visual context , 2007, Nature Reviews Neuroscience.

[25]  Emad N. Eskandar,et al.  A flexible software tool for temporally-precise behavioral control in Matlab , 2008, Journal of Neuroscience Methods.

[26]  E. Murray,et al.  Dissociable Effects of Subtotal Lesions within the Macaque Orbital Prefrontal Cortex on Reward-Guided Behavior , 2011, The Journal of Neuroscience.

[27]  J. Wallis Cross-species studies of orbitofrontal cortex and value-based decision-making , 2011, Nature Neuroscience.

[28]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[29]  P. Lennie,et al.  Rapid adaptation in visual cortex to the structure of images. , 1999, Science.

[30]  R. Grace Violations of transitivity: Implications for a theory of contextual choice. , 1993, Journal of the experimental analysis of behavior.

[31]  Xiao-Jing Wang,et al.  Reward-based training of recurrent neural networks for cognitive and value-based tasks , 2016, bioRxiv.

[32]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[33]  C. Padoa-Schioppa,et al.  Contributions of Orbitofrontal and Lateral Prefrontal Cortices to Economic Choice and the Good-to-Action Transformation , 2014, Neuron.

[34]  W. Schultz,et al.  Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency , 2016, Neuron.

[35]  P. Cisek Making decisions through a distributed consensus , 2012, Current Opinion in Neurobiology.

[36]  Bing Liu,et al.  Efficient sensory cortical coding optimizes pursuit eye movements , 2016, Nature Communications.

[37]  C. Padoa-Schioppa Range-Adapting Representation of Economic Value in the Orbitofrontal Cortex , 2009, The Journal of Neuroscience.

[38]  Zhewei Zhang,et al.  A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning , 2017, bioRxiv.

[39]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[40]  G. Schoenbaum,et al.  Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning , 1999, The Journal of Neuroscience.

[41]  Emad N. Eskandar,et al.  Achieving behavioral control with millisecond resolution in a high-level programming environment , 2008, Journal of Neuroscience Methods.

[42]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[43]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[44]  C. Padoa-Schioppa,et al.  Neuronal Encoding of Subjective Value in Dorsal and Ventral Anterior Cingulate Cortex , 2012, The Journal of Neuroscience.

[45]  J. Kable,et al.  BOLD Subjective Value Signals Exhibit Robust Range Adaptation , 2014, The Journal of Neuroscience.

[46]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[47]  Camillo Padoa-Schioppa,et al.  Neuronal Remapping and Circuit Persistence in Economic Decisions , 2016, Nature Neuroscience.

[48]  C. Padoa-Schioppa,et al.  A neuro-computational model of economic decisions. , 2015, Journal of neurophysiology.

[49]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[50]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[51]  Michael J. Berry,et al.  Adaptation of retinal processing to image contrast and spatial scale , 1997, Nature.

[52]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[53]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[54]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[55]  Máté Lengyel,et al.  Goal-Directed Decision Making with Spiking Neurons , 2016, The Journal of Neuroscience.

[56]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[57]  Katherine E. Conen,et al.  Neuronal variability in orbitofrontal cortex during economic decisions. , 2015, Journal of neurophysiology.

[58]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[59]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[60]  A. Fairhall,et al.  Shifts in Coding Properties and Maintenance of Information Transmission during Adaptation in Barrel Cortex , 2007, PLoS biology.

[61]  Wolfram Schultz,et al.  Reward Magnitude Coding in Primate Amygdala Neurons , 2010, Journal of neurophysiology.

[62]  J. Schreiber Foundations Of Statistics , 2016 .

[63]  M. Rushworth,et al.  Valuation and decision-making in frontal cortex: one or many serial or parallel systems? , 2012, Current Opinion in Neurobiology.

[64]  S. Laughlin The role of sensory adaptation in the retina. , 1989, The Journal of experimental biology.

[65]  C. Padoa-Schioppa,et al.  Rational Attention and Adaptive Coding: A Puzzle and a Solution. , 2014, The American economic review.