Twenty-Five Lessons from Computational Neuromodulation

[1]  P. Dayan.  How to set the switches on this thing , 2012, Current Opinion in Neurobiology.

[2]  B. Sabatini,et al.  Dopaminergic Modulation of Synaptic Transmission in Cortex and Striatum , 2012, Neuron.

[3]  R. Dolan,et al.  Dopamine Enhances Model-Based over Model-Free Choice Behavior , 2012, Neuron.

[4]  T. Robbins,et al.  Serotonin Modulates the Effects of Pavlovian Aversive Predictions on Response Vigor , 2012, Neuropsychopharmacology.

[5]  Karl J. Friston,et al.  Computational psychiatry (vol 16, pg 72, 2012) , 2012 .

[6]  P. Dayan,et al.  Action controls dopaminergic enhancement of reward representations , 2012, Proceedings of the National Academy of Sciences.

[7]  Anatol C. Kreitzer,et al.  Distinct roles for direct and indirect pathway striatal neurons in reinforcement , 2012, Nature Neuroscience.

[8]  P. Dayan.  Instrumental vigour in punishment and reward , 2012, The European journal of neuroscience.

[9]  Carsten K. W. De Dreu,et al.  Oxytocin modulates cooperation within and competition between groups: An integrative review and research agenda , 2012, Hormones and Behavior.

[10]  E. Koechlin,et al.  Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making , 2012, PLoS biology.

[11]  Peter Dayan,et al.  Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees , 2012, PLoS Comput. Biol..

[12]  P. Dayan,et al.  Mapping value based planning and extensively trained choice in the human brain , 2012, Nature Neuroscience.

[13]  J. Homberg.  Serotonin and decision making processes , 2012, Neuroscience & Biobehavioral Reviews.

[14]  S. Cabib,et al.  The mesoaccumbens dopamine in coping with stress , 2012, Neuroscience & Biobehavioral Reviews.

[15]  K. Doya,et al.  The Role of Serotonin in the Regulation of Patience and Impulsivity , 2012, Molecular Neurobiology.

[16]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[17]  C. D. De Dreu.  Oxytocin modulates cooperation within and competition between groups : An integrative review and research agenda ☆ , 2013 .

[18]  T. Robbins,et al.  Reliance on habits at the expense of goal-directed control following dopamine precursor depletion , 2011, Psychopharmacology.

[19]  Peter Dayan,et al.  Vigor in the Face of Fluctuating Rates of Reward: An Experimental Examination , 2011, Journal of Cognitive Neuroscience.

[20]  A. T. Gulledge,et al.  Serotonin and Prefrontal Cortex Function: Neurons, Networks, and Circuits , 2011, Molecular Neurobiology.

[21]  Emrah Duzel,et al.  A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP , 2011, Trends in Neurosciences.

[22]  R. Harris-Warrick.  Neuromodulation and flexibility in Central Pattern Generator networks , 2011, Current Opinion in Neurobiology.

[23]  Terry Lohrenz,et al.  Sub-Second Dopamine Detection in Human Striatum , 2011, PloS one.

[24]  Michael Moutoussis,et al.  Are computational models of any use to psychiatry? , 2011, Neural Networks.

[25]  P. Katz,et al.  Neural mechanisms underlying the evolvability of behaviour , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  T. Robbins,et al.  Prefrontal and Monoaminergic Contributions to Stop-Signal Task Performance in Rats , 2011, The Journal of Neuroscience.

[27]  Angela C. Roberts,et al.  The Importance of Serotonin for Orbitofrontal Function , 2011, Biological Psychiatry.

[28]  A. Arnsten.  Catecholamine Influences on Dorsolateral Prefrontal Cortical Networks , 2011, Biological Psychiatry.

[29]  S. Lammel,et al.  Projection-Specific Modulation of Dopamine Neuron Synapses by Aversive and Rewarding Stimuli , 2011, Neuron.

[30]  R. Cools.  Dopaminergic control of the striatum for high-level cognition , 2011, Current Opinion in Neurobiology.

[31]  H. T. Blair,et al.  Placing prediction into the fear circuit , 2011, Trends in Neurosciences.

[32]  T. Robbins,et al.  Dopamine, But Not Serotonin, Regulates Reversal Learning in the Marmoset Caudate Nucleus , 2011, The Journal of Neuroscience.

[33]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[34]  M. Frank,et al.  From reinforcement learning models to psychiatric and neurological disorders , 2011, Nature Neuroscience.

[35]  K. Doya,et al.  Activation of Dorsal Raphe Serotonin Neurons Underlies Waiting for Delayed Rewards , 2011, The Journal of Neuroscience.

[36]  B. Balleine,et al.  Extracellular Dopamine Levels in Striatal Subregions Track Shifts in Motivation and Response Cost during Instrumental Conditioning , 2011, The Journal of Neuroscience.

[37]  N. Daw,et al.  Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions , 2011, Neuropsychopharmacology.

[38]  Gottfried Ja,et al.  Sensation, Incentive Learning, and the Motivational Control of Goal-Directed Action -- Neurobiology of Sensation and Reward , 2011 .

[39]  B. Balleine.  Sensation, Incentive Learning, and the Motivational Control of Goal-Directed Action , 2011 .

[40]  M. Hasselmo,et al.  Modes and Models of Forebrain Cholinergic Neuromodulation of Cognition , 2011, Neuropsychopharmacology.

[41]  M. Ungless,et al.  Phasic responses in dorsal raphe serotonin neurons to noxious stimuli , 2010, Neuroscience.

[42]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[43]  P. Glimcher.  Foundations of Neuroeconomic Analysis , 2010 .

[44]  Makoto Ito,et al.  Evidence for Model-Based Action Planning in a Sequential Finger Movement Task , 2010, Journal of motor behavior.

[45]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[46]  G. Stuber,et al.  Dopaminergic Terminals in the Nucleus Accumbens But Not the Dorsal Striatum Corelease Glutamate , 2010, The Journal of Neuroscience.

[47]  Mark S. Gilzenrat,et al.  Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function , 2010, Cognitive, affective & behavioral neuroscience.

[48]  Puiu F. Balan,et al.  Attention as a decision in information space , 2010, Trends in Cognitive Sciences.

[49]  Angie A. Kehagia,et al.  Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation , 2010, Current Opinion in Neurobiology.

[50]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[51]  David E. Moorman,et al.  Lateral Hypothalamic Orexin/hypocretin Neurons: a Role in Reward-seeking and Addiction , 2009 .

[52]  T. Maia.  Two-factor theory, the actor-critic model, and conditioned avoidance , 2010, Learning & behavior.

[53]  M. Walton,et al.  Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine , 2009, Nature Neuroscience.

[54]  Joshua L. Plotkin,et al.  The role of dopamine in modulating the structure and function of striatal circuits. , 2010, Progress in brain research.

[55]  P. Dayan,et al.  Opponency Revisited: Competition and Cooperation Between Dopamine and Serotonin , 2010, Neuropsychopharmacology.

[56]  Maarten A. S. Boksem,et al.  Serotonin: Modulator of a drive to withdraw , 2009, Brain and Cognition.

[57]  P. Dayan,et al.  A Bayesian formulation of behavioral control , 2009, Cognition.

[58]  Michael J. Goard,et al.  Basal Forebrain Activation Enhances Cortical Coding of Natural Scenes , 2009, Nature Neuroscience.

[59]  Martin Sarter,et al.  nAChR agonist-induced cognition enhancement: integration of cognitive and neuronal mechanisms. , 2009, Biochemical pharmacology.

[60]  T. Robbins,et al.  Reconciling the Role of Serotonin in Behavioral Inhibition and Aversion: Acute Tryptophan Depletion Abolishes Punishment-Induced Inhibition in Humans , 2009, The Journal of Neuroscience.

[61]  M. Frank,et al.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. , 2009, Nature neuroscience.

[62]  P. Cowen,et al.  Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action , 2009, British Journal of Psychiatry.

[63]  T. Robbins,et al.  The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. , 2009, Annual review of neuroscience.

[64]  B. Sabatini,et al.  Cholinergic modulation of multivesicular release regulates striatal synaptic potency and integration , 2009, Nature Neuroscience.

[65]  J. Salamone,et al.  Dopamine, Behavioral Economics, and Effort , 2009, Front. Behav. Neurosci..

[66]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[67]  Michael X. Cohen,et al.  Neurocomputational models of basal ganglia function in learning, memory and choice , 2009, Behavioural Brain Research.

[68]  M. Ungless,et al.  Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli , 2009, Proceedings of the National Academy of Sciences.

[69]  M. Kahana,et al.  Human Substantia Nigra Neurons Encode Unexpected Financial Rewards , 2009, Science.

[70]  Jonathan D. Cohen,et al.  Learning to Use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement , 2008, NIPS.

[71]  Wei Ji Ma,et al.  Linking neurons to behavior in multisensory perception: A computational review , 2008, Brain Research.

[72]  Louise S. Delicato,et al.  Acetylcholine contributes through muscarinic receptors to attentional modulation in V1 , 2008, Nature.

[73]  C. Berridge.  Noradrenergic modulation of arousal , 2008, Brain Research Reviews.

[74]  F. Rutters,et al.  The hypothalamic-pituitary-adrenal-axis in the regulation of energy balance , 2008, Physiology & Behavior.

[75]  R. Palmiter.  Dopamine Signaling in the Dorsal Striatum Is Essential for Motivated Behaviors , 2008, Annals of the New York Academy of Sciences.

[76]  Saori C. Tanaka,et al.  Low-Serotonin Levels Increase Delayed Reward Discounting in Humans , 2008, The Journal of Neuroscience.

[77]  G. Fink,et al.  Effects of the cholinergic agonist nicotine on reorienting of visual spatial attention and top-down attentional control , 2008, Neuroscience.

[78]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[79]  S. Lammel,et al.  Unique Properties of Mesoprefrontal Neurons within a Dual Mesocorticolimbic Dopamine System , 2008, Neuron.

[80]  Oliver T Wolf,et al.  Author ' s personal copy The influence of stress hormones on emotional memory : Relevance for psychopathology , 2007 .

[81]  P. Dayan,et al.  Human Pavlovian–Instrumental Transfer , 2008, The Journal of Neuroscience.

[82]  P. Dayan,et al.  A temporal difference account of avoidance learning , 2008, Network.

[83]  Peter Dayan,et al.  Serotonin, Inhibition, and Negative Mood , 2007, PLoS Comput. Biol..

[84]  J. Crotts.  Why Choose this Book? How we make decisions , 2008 .

[85]  Sophie Denève,et al.  Bayesian Spiking Neurons II: Learning , 2008, Neural Computation.

[86]  Saori C. Tanaka,et al.  Serotonin Differentially Regulates Short- and Long-Term Prediction of Rewards in the Ventral and Dorsal Striatum , 2007, PloS one.

[87]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[88]  JaneR . Taylor,et al.  Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. , 2007, Cerebral cortex.

[89]  Konrad P. Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007 .

[90]  Konrad Paul Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007, Science.

[91]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[92]  M. Sarter,et al.  Article Prefrontal Acetylcholine Release Controls Cue Detection on Multiple Timescales , 2022 .

[93]  M. Sarter,et al.  Modulators in concert for cognition: Modulator interactions in the prefrontal cortex , 2007, Progress in Neurobiology.

[94]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[95]  J. Krakauer,et al.  Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation , 2007, The Journal of Neuroscience.

[96]  Faculty Opinions recommendation of Determining the neural substrates of goal-directed learning in the human brain. , 2007 .

[97]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[98]  D. Surmeier,et al.  D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons , 2007, Trends in Neurosciences.

[99]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[100]  A. Dickinson,et al.  Planning for the future by western scrub-jays , 2007, Nature.

[101]  E. Pehek,et al.  Pharmacologic mechanisms of serotonergic regulation of dopamine neurotransmission. , 2007, Pharmacology & therapeutics.

[102]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[103]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[104]  M. Hasselmo.  The role of acetylcholine in learning and memory , 2006, Current Opinion in Neurobiology.

[105]  Kyle S. Smith,et al.  Hedonic Hot Spots in the Brain , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[106]  R. Montague.  Why Choose This Book?: How We Make Decisions , 2006 .

[107]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[108]  D. Attwell,et al.  Bidirectional control of CNS capillary diameter by pericytes , 2006, Nature.

[109]  Peter Dayan,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[110]  Rudolf N. Cardinal,et al.  Neural systems implicated in delayed and probabilistic reinforcement , 2006, Neural Networks.

[111]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[112]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[113]  Xiao-Jing Wang,et al.  Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks , 2006, Nature Neuroscience.

[114]  Michael J. Frank,et al.  A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. , 2006, Behavioral neuroscience.

[115]  Kae Nakamura,et al.  Role of Dopamine in the Primate Caudate Nucleus in Reward Modulation of Saccades , 2006, The Journal of Neuroscience.

[116]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[117]  S. Floresco,et al.  Mesocortical dopamine modulation of executive functions: beyond working memory , 2006, Psychopharmacology.

[118]  K. Fuxe,et al.  Volume transmission and wiring transmission from cellular to molecular networks: history and perspectives , 2006, Acta physiologica.

[119]  Thomas E. Hazy,et al.  Banishing the homunculus: Making working memory work , 2006, Neuroscience.

[120]  W. Hauber,et al.  Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performance. , 2006, Learning & memory.

[121]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[122]  S. Kapur,et al.  Dopamine, prediction error and associative learning: A model-based account , 2006, Network.

[123]  Angela J. Yu,et al.  Phasic norepinephrine: A neural interrupt signal for unexpected events , 2006, Network.

[124]  S. Maier,et al.  Stressor controllability and learned helplessness: The roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor , 2005, Neuroscience & Biobehavioral Reviews.

[125]  B. Balleine.  Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits , 2005, Physiology & Behavior.

[126]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[127]  S. Sara,et al.  Network reset: a simplified overarching theory of locus coeruleus noradrenaline function , 2005, Trends in Neurosciences.

[128]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[129]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[130]  A. Grace,et al.  Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior , 2005, Nature Neuroscience.

[131]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[132]  Christopher C Lapish,et al.  Mesocortical Dopamine Neurons Operate in Distinct Temporal Domains Using Multimodal Signaling , 2005, The Journal of Neuroscience.

[133]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[134]  M. Sarter,et al.  Behavioral vigilance in rats: task validation and effects of age, amphetamine, and benzodiazepine receptor ligands , 1995, Psychopharmacology.

[135]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[136]  Philip Holmes,et al.  Simple Neural Networks that Optimize Decisions , 2005, Int. J. Bifurc. Chaos.

[137]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[138]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[139]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[140]  Peter Dayan,et al.  Inference, Attention, and Decision in a Bayesian Neural Architecture , 2004, NIPS.

[141]  Jonathan D. Cohen,et al.  Phasic Activation of Monkey Locus Ceruleus Neurons by Simple Decisions in a Forced-Choice Task , 2004, The Journal of Neuroscience.

[142]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[143]  S. Sara,et al.  Reward expectation, orientation of attention and locus coeruleus‐medial frontal cortex interplay during learning , 2004, The European journal of neuroscience.

[144]  E. Bullmore,et al.  Human pharmacological MRI. , 2004, Trends in pharmacological sciences.

[145]  G. Aston-Jones,et al.  Activation of monkey locus coeruleus neurons varies with difficulty and performance in a target detection task. , 2004, Journal of neurophysiology.

[146]  T. Robbins,et al.  The neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning , 2004, Brain and Cognition.

[147]  G. Loewenstein,et al.  Animal Spirits: Affective and Deliberative Processes in Economic Behavior , 2004 .

[148]  P. Corr,et al.  A two-dimensional neuropsychology of defense: fear/anxiety and defensive distance , 2004, Neuroscience & Biobehavioral Reviews.

[149]  K. Berridge.  Motivation concepts in behavioral neuroscience , 2004, Physiology & Behavior.

[150]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[151]  J. Bolam,et al.  Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli , 2004, Science.

[152]  R. Dolan,et al.  Effects of Cholinergic Enhancement on Visual Stimulation, Spatial Attention, and Spatial Working Memory , 2004, Neuron.

[153]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[154]  J. Siegel.  Hypocretin (orexin): role in normal behavior and neuropathology. , 2004, Annual review of psychology.

[155]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[156]  S. Maier,et al.  Stressor controllability modulates stress‐induced serotonin but not dopamine efflux in the nucleus accumbens shell , 2003, Synapse.

[157]  Samuel M. McClure,et al.  A computational substrate for incentive salience , 2003, Trends in Neurosciences.

[158]  G. Piras,et al.  Dissociation between mesocortical dopamine release and fear‐related behaviours in two psychogenetically selected lines of rats that differ in coping strategies to aversive conditions , 2003, The European journal of neuroscience.

[159]  S. Maier,et al.  Stressor Controllability Modulates Stress-Induced Dopamine and Serotonin Efflux and Morphine-Induced Serotonin Efflux in the Medial Prefrontal Cortex , 2003, Neuropsychopharmacology.

[160]  P. Blier.  The pharmacology of putative early-onset antidepressant strategies , 2003, European Neuropsychopharmacology.

[161]  Kenji Doya,et al.  Meta-learning in Reinforcement Learning , 2003, Neural Networks.

[162]  B. Hyland,et al.  Firing modes of midbrain dopamine cells in the freely moving rat , 2002, Neuroscience.

[163]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[164]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .

[165]  Kenji Doya,et al.  Introduction for 2002 Special Issue: Computational Models of Neuromodulation , 2002, Neural Networks.

[166]  Eve Marder,et al.  Cellular, synaptic and network effects of neuromodulation , 2002, Neural Networks.

[167]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[168]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[169]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[170]  Daniel Hoyer,et al.  Molecular, pharmacological and functional diversity of 5-HT receptors , 2002, Pharmacology Biochemistry and Behavior.

[171]  Michael E. Hasselmo,et al.  A Proposed Function for Hippocampal Theta Rhythm: Separate Phases of Encoding and Retrieval Enhance Reversal of Prior Learning , 2002, Neural Computation.

[172]  Jonathan D. Cohen,et al.  Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. , 2002, Cerebral cortex.

[173]  G. Buzsáki.  Theta Oscillations in the Hippocampus , 2002, Neuron.

[174]  L. Záborszky.  The modular organization of brain systems. Basal forebrain: the last frontier. , 2002, Progress in brain research.

[175]  R. Bandler,et al.  Parallel circuits mediating distinct emotional coping reactions to different types of stress , 2001, Neuroscience & Biobehavioral Reviews.

[176]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[177]  Wei Li,et al.  A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment , 2001, Adapt. Behav..

[178]  P. Fletcher,et al.  Studies to investigate the role of 5-HT(2C) receptors on cocaine- and food-maintained behavior. , 2000, The Journal of pharmacology and experimental therapeutics.

[179]  S. Kakade,et al.  Learning and selective attention , 2000, Nature Neuroscience.

[180]  T Nagatsu,et al.  Synaptic integration mediated by striatal cholinergic interneurons in basal ganglia function. , 2000, Science.

[181]  V. Brown,et al.  Cholinergic neurotransmission influences covert orientation of visuospatial attention in the rat , 2000, Psychopharmacology.

[182]  S. Mobini,et al.  Effect of central 5-hydroxytryptamine depletion on inter-temporal choice: a quantitative analysis , 2000, Psychopharmacology.

[183]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[184]  T. Sejnowski,et al.  Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. , 2000, Journal of neurophysiology.

[185]  J. Horvitz.  Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events , 2000, Neuroscience.

[186]  J. Mirenowicz,et al.  Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. , 2000, Behavioral neuroscience.

[187]  K. Doya.  Metalearning, neuromodulation, and emotion , 2000 .

[188]  P. Fletcher,et al.  Selective destruction of brain serotonin neurons by 5,7-dihydroxytryptamine increases responding for a conditioned reward , 1999, Psychopharmacology.

[189]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[190]  T. Tsumoto,et al.  Acetylcholine suppresses the spread of excitation in the visual cortex revealed by optical recording: possible differential effect depending on the source of input , 1999, The European journal of neuroscience.

[191]  Leslie Pack Kaelbling,et al.  Learning Policies with External Memory , 1999, ICML.

[192]  P. Redgrave,et al.  Is the short-latency dopamine response too short to signal reward error? , 1999, Trends in Neurosciences.

[193]  P. Garris,et al.  Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation , 1999, Nature.

[194]  P. Holland,et al.  Amygdala circuitry in attentional and representational processes , 1999, Trends in Cognitive Sciences.

[195]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[196]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[197]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[198]  Y. Smith,et al.  Microcircuitry of the direct and indirect pathways of the basal ganglia. , 1998, Neuroscience.

[199]  M. Farah,et al.  Effects of bromocriptine on human subjects depend on working memory capacity , 1997, Neuroreport.

[200]  B. Connors,et al.  Differential Regulation of Neocortical Synapses by Neuromodulators and Activity , 1997, Neuron.

[201]  R. Marrocco,et al.  Alteration of brain noradrenergic activity in rhesus monkeys affects the alerting component of covert orienting , 1997, Psychopharmacology.

[202]  G. Aston-Jones,et al.  Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task , 1997, Neuroscience.

[203]  A. Alonso,et al.  Muscarinic modulation of the oscillatory and repetitive firing properties of entorhinal cortex layer II neurons. , 1997, Journal of neurophysiology.

[204]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[205]  S. Southwick,et al.  Noradrenergic mechanisms in stress and anxiety: I. preclinical studies , 1996, Synapse.

[206]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[207]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[208]  S. Southwick,et al.  Noradrenergic mechanisms in stress and anxiety: II. Clinical studies. , 1996, Synapse.

[209]  P. Goldman-Rakic,et al.  Modulation of memory fields by dopamine Dl receptors in prefrontal cortex , 1995, Nature.

[210]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[211]  P. Fletcher.  Effects of combined or separate 5,7-dihydroxytryptamine lesions of the dorsal and median raphe nuclei on responding maintained by a DRL 20s schedule of food reinforcement , 1995, Brain Research.

[212]  A. Graybiel,et al.  Temporal and spatial characteristics of tonically active neurons of the primate's striatum. , 1995, Journal of neurophysiology.

[213]  Joel L. Davis,et al.  In : Models of Information Processing in the Basal Ganglia , 2008 .

[214]  A. Barto.  Adaptive Critics and the Basal Ganglia , 1995 .

[215]  G. Aston-Jones,et al.  Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[216]  A. Graybiel,et al.  Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[217]  S. Cabib,et al.  Opposite responses of mesolimbic dopamine system to controllable and uncontrollable aversive experiences , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[218]  A. Damasio.  Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[219]  M. Hasselmo,et al.  Acetylcholine and memory , 1993, Trends in Neurosciences.

[220]  D Servan-Schreiber,et al.  A theory of dopamine function and its role in cognitive deficits in schizophrenia. , 1993, Schizophrenia bulletin.

[221]  A. Grace.  Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia , 1991, Neuroscience.

[222]  S. Cabib,et al.  Acute stress induces time-dependent responses in dopamine mesolimbic system , 1991, Brain Research.

[223]  G. Aston-Jones,et al.  Discharge of noradrenergic locus coeruleus neurons in behaving rats and monkeys suggests a role in vigilance. , 1991, Progress in brain research.

[224]  C. Gerfen,et al.  D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. , 1990, Science.

[225]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[226]  S. Sara,et al.  Activation of the noradrenergic system facilitates an attentional shift in the rat , 1990, Behavioural Brain Research.

[227]  J W McClurkin,et al.  Release of cortical catecholamines by visual stimulation requires activity in thalamocortical afferents of monkey and cat , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[228]  W. Hershberger.  An approach through the looking-glass , 1986 .

[229]  J. Gray,et al.  The neuropsychology of anxiety. , 1985, Issues in mental health nursing.

[230]  R. Beninger.  The role of dopamine in locomotor activity and learning , 1983, Brain Research Reviews.

[231]  F. Masterson,et al.  Species-specific defense reactions and avoidance learning , 1982, The Pavlovian Journal of Biological Science.

[232]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[233]  J. Glowinski,et al.  Increased utilization of dopamine in the nucleus accumbens but not in the cerebral cortex after dorsal raphe lesion in the rat , 1979, Neuroscience Letters.

[234]  William C. Ogden,et al.  Attended and unattended processing modes: The role of set for spatial location , 2014 .

[235]  Irwin J. Kopin,et al.  The Biochemical Basis of Neuropharmacology , 1971, The Yale Journal of Biology and Medicine.

[236]  D. R. Williams,et al.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. , 1969, Journal of the experimental analysis of behavior.

[237]  J. Konorski.  Integrative activity of the brain : an interdisciplinary approach , 1967 .

[238]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[239]  O. Mowrer.  On the dual nature of learning—a re-interpretation of "conditioning" and "problem-solving." , 1947 .

[240]  W. Estes.  Discriminative conditioning. I. A discriminative property of conditioned anticipation. , 1943 .

[241]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .