Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task

Disappointment entails the recognition that one did not get the value expected. In contrast, regret entails recognition that an alternative (counterfactual) action would have produced a more valued outcome. In humans, the orbitofrontal cortex is active during expressions of regret, and humans with damage to the orbitofrontal cortex do not express regret. In rats and nonhuman primates, both the orbitofrontal cortex and the ventral striatum have been implicated in reward computations. We recorded neural ensembles from orbitofrontal cortex and ventral striatum in rats encountering wait or skip choices for delayed delivery of different flavors using an economic framework. Economically, encountering a high-cost choice after skipping a low-cost choice should induce regret. In these situations, rats looked backwards toward the lost option, cells within orbitofrontal cortex and ventral striatum represented the missed action, rats were more likely to wait for the long delay, and rats rushed through eating the food after that delay.

[1]  E. Aronson,et al.  The effect of effort on the attractiveness of rewarded and unrewarded stimuli. , 1961, Journal of abnormal and social psychology.

[2]  R. B. Heisch How, what and why. , 1963, East African medical journal.

[3]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[4]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[5]  David E. Bell,et al.  Disappointment in Decision Making Under Uncertainty , 1985, Oper. Res..

[6]  Robert Sugden,et al.  Disappointment and Dynamic Consistency in Choice under Uncertainty , 1986 .

[7]  J. Landman,et al.  Regret: A Theoretical and Conceptual Analysis , 1987 .

[8]  J. Landman,et al.  What might have been: Counterfactual thought concerning personal decisions , 1992 .

[9]  J. Landman,et al.  Regret: The Persistence of the Possible , 1993 .

[10]  A. Lavoie,et al.  Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats , 1994, Brain Research.

[11]  J. Price,et al.  Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys , 1995, The Journal of comparative neurology.

[12]  T. Gilovich,et al.  The experience of regret: what, when, and why. , 1995, Psychological review.

[13]  J. Price,et al.  Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys , 1995, The Journal of comparative neurology.

[14]  H Eichenbaum,et al.  Information coding in the rodent prefrontal cortex. I. Single-neuron activity in orbitofrontal cortex compared with that in pyriform cortex. , 1995, Journal of neurophysiology.

[15]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[16]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[17]  H. Arkes,et al.  The sunk cost and Concorde effects: Are humans less rational than lower animals? , 1999 .

[18]  Michael H. Goldbaum,et al.  Measurement and classification of retinal vascular tortuosity , 1999, Int. J. Medical Informatics.

[19]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[20]  Vincent Hayward,et al.  Discrete-time adaptive windowing for velocity estimation , 2000, IEEE Trans. Control. Syst. Technol..

[21]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[22]  Geoffrey Schoenbaum,et al.  Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations , 2002, Neuroreport.

[23]  M. Farah,et al.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. , 2003, Brain : a journal of neurology.

[24]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[25]  G. Schoenbaum,et al.  Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning , 2003, Neuron.

[26]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[27]  Giorgio Coricelli,et al.  Response to Comment on "The Involvement of the Orbitofrontal Cortex in the Experience of Regret" , 2005, Science.

[28]  J. O'Doherty,et al.  Regret and its avoidance: a neuroimaging study of choice behavior , 2005, Nature Neuroscience.

[29]  M. Roitman,et al.  Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output , 2005, Neuron.

[30]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[31]  Daeyeol Lee Neural basis of quasi-rational decision making , 2006, Current Opinion in Neurobiology.

[32]  Terence Connolly,et al.  Regret in economic and psychological theories of choice , 2006 .

[33]  R. Dolan,et al.  Brain, emotion and decision making: the paradigmatic example of regret , 2007, Trends in Cognitive Sciences.

[34]  Daphna Joel,et al.  The orbital cortex in rats topographically projects to central parts of the caudate–putamen complex , 2008, Neuroscience Letters.

[35]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[36]  M. Roesch,et al.  The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes , 2009, Neuron.

[37]  M. Roesch,et al.  Ventral Striatal Neurons Encode the Value of the Chosen Action in Rats Deciding between Differently Delayed or Sized Rewards , 2009, The Journal of Neuroscience.

[38]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[39]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[40]  Timothy Edward John Behrens,et al.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[41]  Jung Hoon Sul,et al.  Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making , 2010, Neuron.

[42]  J. O'Doherty,et al.  Human Medial Orbitofrontal Cortex Is Recruited during Experience of Imagined and Real Rewards Prescan Training , 2022 .

[43]  Timothy Edward John Behrens,et al.  Separable Learning Systems in the Macaque Brain and the Role of Orbitofrontal Cortex in Contingent Learning , 2010, Neuron.

[44]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[45]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[46]  Y. Niv,et al.  Ventral Striatum and Orbitofrontal Cortex Are Both Required for Model-Based, But Not Model-Free, Reinforcement Learning , 2011, The Journal of Neuroscience.

[47]  Daeyeol Lee,et al.  Distributed Coding of Actual and Hypothetical Outcomes in the Orbital and Dorsolateral Prefrontal Cortex , 2011, Neuron.

[48]  G. Schoenbaum,et al.  Model‐based learning and the contribution of the orbitofrontal cortex to the model‐free world , 2012, The European journal of neuroscience.

[49]  A. Redish,et al.  The Road Not Taken: Neural Correlates of Decision Making in Orbitofrontal Cortex , 2012, Front. Neurosci..

[50]  Joshua L. Jones,et al.  Orbitofrontal Cortex Supports Behavior and Learning Using Inferred But Not Cached Values , 2012, Science.

[51]  Philippe Mailly,et al.  The Rat Prefrontostriatal System Analyzed in 3D: Evidence for Multiple Interacting Functional Units , 2013, The Journal of Neuroscience.

[52]  Geoffrey Schoenbaum,et al.  Neural Estimates of Imagined Outcomes in the Orbitofrontal Cortex Drive Behavior and Learning , 2013, Neuron.

[53]  R. Saunders,et al.  Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating , 2013, Nature Neuroscience.

[54]  Robert C. Wilson,et al.  Orbitofrontal Cortex as a Cognitive Map of Task Space , 2014, Neuron.