A Bayesian formulation of behavioral control

[1]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[2]  P. Dayan,et al.  Serotonin in affective control. , 2009, Annual review of neuroscience.

[3]  Dimitri P. Bertsekas,et al.  Neuro-Dynamic Programming , 2009, Encyclopedia of Optimization.

[4]  Peter Dayan,et al.  Psychiatry: Insights into depression through normative decision-making models , 2008, NIPS.

[5]  P. Dayan,et al.  A temporal difference account of avoidance learning , 2008, Network.

[6]  Peter Dayan,et al.  Serotonin, Inhibition, and Negative Mood , 2007, PLoS Comput. Biol..

[7]  M. Andrés.  Learning and behavior: A contemporary synthesis , 2008 .

[8]  A. Lozano,et al.  Deep Brain Stimulation for Treatment-Resistant , 2008 .

[9]  P. Delespaul,et al.  Genetic risk of depression and stress-induced negative affect in daily life , 2007, British Journal of Psychiatry.

[10]  Q. Huys.  Reinforcers and control : towards a computational aetiology of depression , 2007 .

[11]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[12]  M. Bouton.  Learning and Behavior: A Contemporary Synthesis , 2006 .

[13]  Peter Dayan,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[14]  S. Kapur,et al.  Dopamine, prediction error and associative learning: A model-based account , 2006, Network.

[15]  D. Morilak,et al.  What should animal models of depression model? , 2005, Neuroscience & Biobehavioral Reviews.

[16]  R. Hen,et al.  Recent advances in animal models of chronic antidepressant effects: The novelty-induced hypophagia test , 2005, Neuroscience & Biobehavioral Reviews.

[17]  S. Maier,et al.  Stressor controllability and learned helplessness: The roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor , 2005, Neuroscience & Biobehavioral Reviews.

[18]  H. Anisman,et al.  Stress, depression, and anhedonia: Caveats concerning animal models , 2005, Neuroscience & Biobehavioral Reviews.

[19]  Peter Dayan,et al.  How fast to work: Response vigor, motivation and tonic dopamine , 2005, NIPS.

[20]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[21]  J. Gross,et al.  Emotion context insensitivity in major depressive disorder. , 2005, Journal of abnormal psychology.

[22]  Shantanu P. Jadhav,et al.  Stress duration modulates the spatiotemporal patterns of spine formation in the basolateral amygdala. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[23]  P. Dayan,et al.  Dopamine, learning, and impulsivity: a biological account of attention-deficit/hyperactivity disorder. , 2005, Journal of child and adolescent psychopharmacology.

[24]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[25]  A. Lozano,et al.  Deep Brain Stimulation for Treatment-Resistant Depression , 2005, Neuron.

[26]  S. Maier,et al.  Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus , 2005, Nature Neuroscience.

[27]  D. Kornbrot,et al.  Depressive realism and outcome density bias in contingency judgments: the effect of the context and intertrial interval. , 2005, Journal of experimental psychology. General.

[28]  Suzanna Becker,et al.  A Computational Model of the Functional Role of the Ventral-Striatal D2 Receptor in the Expression of Previously Acquired Behaviors , 2005, Neural Computation.

[29]  Terrence J. Sejnowski,et al.  Exploration Bonuses and Dual Control , 1996, Machine Learning.

[30]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[31]  D. Bartsch,et al.  Stress-Induced Anhedonia in Mice is Associated with Deficits in Forced Swimming and Exploration , 2004, Neuropsychopharmacology.

[32]  S. Kapur,et al.  A Model of Antipsychotic Action in Conditioned Avoidance: A Computational Approach , 2004, Neuropsychopharmacology.

[33]  P. Willner.  Antidepressants and serotonergic neurotransmission: An integrative review , 2004, Psychopharmacology.

[34]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[35]  C. Sandi,et al.  Prior exposure to a single stress session facilitates subsequent contextual fear conditioning in rats Evidence for a role of corticosterone , 2003, Hormones and Behavior.

[36]  Kenneth S Kendler,et al.  Life event dimensions of loss, humiliation, entrapment, and danger in the prediction of onsets of major depression and generalized anxiety. , 2003, Archives of general psychiatry.

[37]  J. A. Boer,et al.  Handbook of depression and anxiety , 2003 .

[38]  Animal models of subtypes of depression , 2003 .

[39]  A. Caspi,et al.  Influence of Life Stress on Depression: Moderation by a Polymorphism in the 5-HTT Gene , 2003, Science.

[40]  Andrew J. Oswald,et al.  Does Money Buy Happiness? A Longitudinal Study Using Data on Windfalls , 2002 .

[41]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .

[42]  H. Pashler.  STEVENS' HANDBOOK OF EXPERIMENTAL PSYCHOLOGY , 2002 .

[43]  Kenneth S Kendler,et al.  Toward a comprehensive developmental model for major depression in men. , 2006, The American journal of psychiatry.

[44]  J. Gross,et al.  Sadness and amusement reactivity differentially predict concurrent and prospective functioning in major depressive disorder. , 2002, Emotion.

[45]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[46]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[47]  P. Willner,et al.  The validity of animal models of predisposition to depression. , 2002, Behavioural pharmacology.

[48]  R. Job.  The effects of uncontrollable, unpredictable aversive and appetitive events: similar effects warrant similar, but not identical, explanations? , 2002, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[49]  N. Gatward.  Evolutionary Psychiatry: A New Beginning (2nd edn) Anthony Stevens and John Price Routledge (2000), pp. 310, ISBN 0-415-21979-5 (paperback) , 2001 .

[50]  Malcolm J. A. Strens,et al.  A Bayesian Framework for Reinforcement Learning , 2000, ICML.

[51]  J. Horvitz.  Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events , 2000, Neuroscience.

[52]  R. Nesse.  Is depression an adaptation? , 2000, Archives of general psychiatry.

[53]  David Andre,et al.  Model based Bayesian Exploration , 1999, UAI.

[54]  L. Abramson,et al.  Depressogenic cognitive styles: predictive validity, information processing and personality characteristics, and developmental origins. , 1999, Behaviour research and therapy.

[55]  S. Scheggi,et al.  A Chronic Stress that Impairs Reactivity in Rats Also Decreases Dopaminergic Transmission in the Nucleus Accumbens: A Microdialysis Study , 1999, Journal of neurochemistry.

[56]  Yoram Singer,et al.  Efficient Bayesian Parameter Estimation in Large Discrete Domains , 1998, NIPS.

[57]  L. Abramson,et al.  Suicidality and cognitive vulnerability to depression among college students: a prospective study. , 1998, Journal of adolescence.

[58]  Stuart J. Russell,et al.  Bayesian Q-Learning , 1998, AAAI/IAAI.

[59]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[60]  P. Willner.  Validity, reliability and utility of the chronic mild stress model of depression: a 10-year review and evaluation , 1997, Psychopharmacology.

[61]  Nestor A. Schmajuk,et al.  Escape, Avoidance, and Imitation: A Neural Network Approach , 1997, Adapt. Behav..

[62]  Christina Sobin,et al.  Melancholia: A disorder of movement and mood , 1997 .

[63]  S. Cabib,et al.  Stress, depression and the mesolimbic dopamine system , 1996, Psychopharmacology.

[64]  R. O’Reilly,et al.  A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[65]  J. Price,et al.  Evolutionary Psychiatry: A new beginning , 1996 .

[66]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  H. Freeman.  Psychological treatment for depression. , 1996, The British journal of psychiatry : the journal of mental science.

[68]  Michael C. Neale,et al.  Stressful life events, genetic liability, and onset of an episode of major depression in women. , 1995, The American journal of psychiatry.

[69]  P. Willner.  Animal models of depression: validity and applications. , 1995, Advances in biochemical psychopharmacology.

[70]  M. Seligman,et al.  Learned Helplessness: A Theory for the Age of Personal Control , 1993 .

[71]  James S. Morgan,et al.  A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning , 1993, Adapt. Behav..

[72]  P. Willner,et al.  Suppression of sucrose drinking by chronic mild unpredictable stress: A methodological analysis , 1992, Neuroscience & Biobehavioral Reviews.

[73]  H. Anisman,et al.  Stressor-induced anhedonia in the mesocorticolimbic system , 1991, Neuroscience & Biobehavioral Reviews.

[74]  Richard S. Sutton,et al.  Dyna, an integrated architecture for learning, planning, and reacting , 1990, SGAR.

[75]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[76]  Donald Holzer.  Depression: A Psychobiological Synthesis , 1989 .

[77]  G. Metalsky,et al.  Hopelessness depression: A theory-based subtype of depression. , 1989 .

[78]  A. Beck.  Cognitive models of depression. , 1987 .

[79]  P. Willner.  Validation criteria for animal models of human mental disorders: Learned helplessness as a paradigm case , 1986, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[80]  S. Mineka,et al.  Controllability and predictability in acquired motivation. , 1985, Annual review of psychology.

[81]  L. Alloy,et al.  Assessment of covariation by humans and animals: the joint influence of prior expectations and current situational information. , 1984, Psychological review.

[82]  P. Willner.  Dopamine and depression: A review of recent evidence. III. The effects of antidepressant treatments , 1983, Brain Research Reviews.

[83]  P. Willner.  Dopamine and depression: A review of recent evidence. I. Empirical studies , 1983, Brain Research Reviews.

[84]  H. Anisman,et al.  Region-specific reductions of intracranial self-stimulation after uncontrollable stress: Possible effects on reward processes , 1983, Behavioural Brain Research.

[85]  F. Masterson,et al.  Species-specific defense reactions and avoidance learning , 1982, The Pavlovian Journal of Biological Science.

[86]  L. Abramson,et al.  Learned helplessness, depression, and the illusion of control. , 1982, Journal of personality and social psychology.

[87]  B. Moore.  Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[88]  Holger Ursin,et al.  Coping and Health , 1980 .

[89]  J. Overmier,et al.  Environmental Contingencies as Sources of Stress in Animals , 1980 .

[90]  L. Abramson,et al.  Judgment of contingency in depressed and nondepressed students: sadder but wiser? , 1979, Journal of experimental psychology. General.

[91]  R. Depue,et al.  The Psychobiology of the depressive disorders : implications for the effects of stress , 1979 .

[92]  P. Brickman,et al.  Lottery winners and accident victims: is happiness relative? , 1978, Journal of personality and social psychology.

[93]  Steven F. Maier,et al.  Exposure to inescapable shock produces both activity and associative deficits in the rat , 1978 .

[94]  C. G. Costello,et al.  A critical review of Seligman's laboratory experiments on learned helplessness and depression in humans. , 1978, Journal of abnormal psychology.

[95]  J. Coyne,et al.  A critical evaluation of the learned helplessness model of depression. , 1978, Journal of abnormal psychology.

[96]  M. Seligman,et al.  Learned helplessness in humans: critique and reformulation. , 1978, Journal of abnormal psychology.

[97]  J. Pearce,et al.  Inhibitory interactions between appetitive and aversive stimuli. , 1977 .

[98]  P. H. Blaney.  Contemporary theories of depression: critique and comparison. , 1977, Journal of abnormal psychology.

[99]  F. Goodkin.  Rats learn the relationship between responding and environmental events: An expansion of the learned helplessness hypothesis , 1976 .

[100]  M. Seligman,et al.  Learned helplessness: Theory and evidence. , 1976 .

[101]  H. Lefcourt.  Locus of control: Current trends in theory and research , 1976 .

[102]  M. Seligman,et al.  Depression and learned helplessness in man. , 1975, Journal of abnormal psychology.

[103]  J. Gibbon,et al.  Contingency spaces and measures in classical and instrumental conditioning. , 1974, Journal of the experimental analysis of behavior.

[104]  Samuel R. Friedman,et al.  Depression: Clinical, Experimental, and Theoretical Aspects , 1968 .

[105]  M. Seligman,et al.  Failure to escape traumatic shock. , 1967, Journal of experimental psychology.

[106]  J. Overmier,et al.  Effects of inescapable shock upon subsequent escape and avoidance responding. , 1967, Journal of comparative and physiological psychology.

[107]  O. Mowrer.  On the dual nature of learning—a re-interpretation of "conditioning" and "problem-solving." , 1947 .