Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards

[1]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[2]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[3]  Wyckoff Lb.  The role of observing responses in discrimination learning. Part I. , 1952 .

[4]  L. Wyckoff.  The role of observing responses in discrimination learning. , 1952, Psychological review.

[5]  C. C. Perkins.  The stimulus conditions which follow learned responses. , 1955, Psychological review.

[6]  W. F. Prokasy,et al.  The acquisition of observing responses in the absence of differential external reinforcement. , 1956, Journal of comparative and physiological psychology.

[7]  R. T. Kelleher.  Stimulus-producing responses in chimpanzees. , 1958, Journal of the experimental analysis of behavior.

[8]  L. Wyckoff.  Toward a quantitative theory of secondary reinforcement. , 1959, Psychological review.

[9]  W. F. Prokasy,et al.  Role of Food Deprivation in the Acquisition of the Observing Response , 1962 .

[10]  C. C. Perkins,et al.  Conditions affecting acquisition of observing responses in the absence of differential reward. , 1965, Journal of comparative and physiological psychology.

[11]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[12]  J. Steiner.  Observing Responses and Uncertainty Reduction , 1967, The Quarterly journal of experimental psychology.

[13]  J. Lanzetta,et al.  Infrequent reward facilitates observing responses in rats , 1967 .

[14]  J. Steiner.  Observing Responses and Uncertainty Reduction. II The Effect of Varying the Probability of Reinforcement , 1970 .

[15]  D. A. Lieberman.  Secondary reinforcement and information as determinants of observing behavior in monkeys (Macaca mulatta) , 1972 .

[16]  W. K. Honig,et al.  Handbook of Operant Behavior , 2022 .

[17]  Evan L. Porteus,et al.  Temporal Resolution of Uncertainty and Dynamic Choice Theory , 1978 .

[18]  J. Harsh,et al.  Choosing between predictable and unpredictable shock conditions: Data and theory. , 1979 .

[19]  M. Fanselow.  Naloxone attenuates rat’s preference for signaled shock , 1979 .

[20]  Observing behavior in monkeys (Macaca arctoides): Support for the information hypothesis ☆ , 1980 .

[21]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[22]  Lance M. Optican,et al.  Unix-based multiple-process system, for real-time data acquisition and control , 1982 .

[23]  J. Dinsmoor.  Observing and conditioned reinforcement , 1983, Behavioral and Brain Sciences.

[24]  S. M. Miller,et al.  Monitoring and blunting: validation of a questionnaire to assess styles of information seeking under threat. , 1987, Journal of personality and social psychology.

[25]  Suzanne M. Miller.  Monitoring and blunting: Validation of a questionnaire to assess styles of information seeking under threat. , 1987 .

[26]  Masatoshi Tanaka,et al.  Stressor predictability and rat brain noradrenaline metabolism , 1989, Pharmacology Biochemistry and Behavior.

[27]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions. , 1990, Journal of neurophysiology.

[28]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[29]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[30]  Joanna L. Y. Ho,et al.  Hope: An empirical study of attitude toward the timing of uncertainty resolution , 1994 .

[31]  Martin Weber,et al.  The Resolution of Uncertainty: An Experimental Study , 1996 .

[32]  J. March.  Learning to be risk averse. , 1996 .

[33]  D. A. Lieberman,et al.  The Role of S− in Human Observing Behavior: Bad News Is Sometimes Better Than No News ☆ , 1997 .

[34]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[35]  N. Aplin,et al.  PSYCHOLOGICAL EXPECTED UTILITY THEORY AND ANTICIPATORY FEELINGS * A , 1997 .

[36]  George Wu,et al.  Anxiety and Decision Making with Delayed Resolution of Uncertainty , 1999 .

[37]  T. Zentall,et al.  Observing Behavior in Pigeons: The Effect of Reinforcement Probability and Response Cost Using a Symmetrical Choice Procedure , 1999 .

[38]  W. Schultz.  Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[39]  J. Horvitz.  Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events , 2000, Neuroscience.

[40]  D. Kahneman,et al.  Living with uncertainty: Attractiveness and resolution timing. , 2000 .

[41]  Andrew Caplin,et al.  Psychological Expected Utility Theory and Anticipatory Feelings , 2001 .

[42]  Isaac Meilijson,et al.  Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors , 2002, Adapt. Behav..

[43]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[44]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[45]  J. Woods,et al.  Observing responses maintained by stimuli associated with cocaine or remifentanil reinforcement in rhesus monkeys , 2002, Psychopharmacology.

[46]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[47]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[48]  W. Schultz,et al.  Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm , 2003, The Journal of Neuroscience.

[49]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[50]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[51]  R. Wise.  Dopamine, learning and motivation , 2004, Nature Reviews Neuroscience.

[52]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[53]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[54]  Nuttapong Chentanez,et al.  Intrinsically Motivated Learning of Hierarchical Collections of Skills , 2004 .

[55]  O. Hikosaka,et al.  Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement. , 2004, Journal of neurophysiology.

[56]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[57]  A. Redish,et al.  Addiction as a Computational Process Gone Awry , 2004, Science.

[58]  M. Platt,et al.  Risk-sensitive neurons in macaque posterior cingulate cortex , 2005, Nature Neuroscience.

[59]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[60]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[61]  P. Redgrave,et al.  The short-latency dopamine signal: a role in discovering novel actions? , 2006, Nature Reviews Neuroscience.

[62]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[63]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[64]  Kiyohiko Nakamura.  Neural representation of information measure in the primate premotor cortex. , 2006, Journal of neurophysiology.

[65]  A. Lüthi,et al.  Processing of Temporal Unpredictability in Human and Animal Amygdala , 2007, The Journal of Neuroscience.

[66]  Benjamin Y. Hayden,et al.  Temporal Discounting Predicts Risk Sensitivity in Rhesus Macaques , 2007, Current Biology.

[67]  Kfir Eliaz,et al.  Experimental Testing of Intrinsic Preferences for NonInstrumental Information , 2007 .

[68]  O. Hikosaka,et al.  Lateral habenula as a source of negative reward signals in dopamine neurons , 2007, Nature.

[69]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[70]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[71]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[72]  W. Newsome,et al.  The temporal precision of reward prediction in dopamine neurons , 2008, Nature Neuroscience.

[73]  Daeyeol Lee,et al.  Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice , 2008, Neuron.

[74]  Daeyeol Lee,et al.  Neural Dissociation of Delay and Uncertainty in Intertemporal Choice , 2008, The Journal of Neuroscience.

[75]  E. Vaadia,et al.  Midbrain Dopaminergic Neurons and Striatal Cholinergic Interneurons Encode the Difference between Reward and Aversive Events at Different Epochs of Probabilistic Classical Conditioning Trials , 2008, The Journal of Neuroscience.

[76]  W. Schultz,et al.  Influence of Reward Delays on Responses of Dopamine Neurons , 2008, The Journal of Neuroscience.

[77]  M. Platt,et al.  Risky business: the neuroeconomics of decision making under uncertainty , 2008, Nature Neuroscience.

[78]  Daeyeol Lee,et al.  Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers , 2009, The Journal of Neuroscience.

[79]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.