A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task

[1]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[2]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[3]  W. Schultz,et al.  Learning of sequential movements by neural network model with dopamine-like reinforcement signal , 1998, Experimental Brain Research.

[4]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[5]  S L Moody,et al.  A Model That Accounts for Activity in Primate Frontal Cortex during a Delayed Matching-to-Sample Task , 1998, The Journal of Neuroscience.

[6]  J. Salamone,et al.  Behavioral functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis , 1997, Neuroscience & Biobehavioral Reviews.

[7]  P. Calabresi,et al.  Abnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors , 1997, The Journal of Neuroscience.

[8]  Q. Rogers,et al.  Small changes in essential amino acid concentrations alter diet selection in amino acid-deficient rats. , 1997, The Journal of nutrition.

[9]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[10]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[11]  J. Muir,et al.  The cerebral cortex of the rat and visual attentional function: dissociable effects of mediofrontal, cingulate, anterior dorsolateral, and parietal cortex lesions on a five-choice serial reaction time task. , 1996, Cerebral cortex.

[12]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[14]  J. Wickens,et al.  Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro , 1996, Neuroscience.

[15]  O. Hikosaka.  Models of information processing in the basal Ganglia edited by James C. Houk, Joel L. Davis and David G. Beiser, The MIT Press, 1995. $60.00 (400 pp) ISBN 0 262 08234 9 , 1995, Trends in Neurosciences.

[16]  Peter Dayan,et al.  Bee foraging in uncertain environments using predictive hebbian learning , 1995, Nature.

[17]  E Guigon,et al.  Neural correlates of learning in the prefrontal cortex of the monkey: a predictive model. , 1995, Cerebral cortex.

[18]  A. Canavan,et al.  Associative learning in degenerative neostriatal disorders: Contrasts in explicit and implicit remembering between Parkinson's and huntington's diseases , 1995, Movement disorders : official journal of the Movement Disorder Society.

[19]  K. Bötzel,et al.  Frontal and parietal premovement slow brain potentials in Parkinson's disease and aging , 1995, Movement disorders : official journal of the Movement Disorder Society.

[20]  W. Schultz,et al.  Context-dependent activity in primate striatum reflecting past and future behavioral events. , 1995 .

[21]  J. Wickens,et al.  Cellular models of reinforcement. , 1995 .

[22]  A. Barto.  Adaptive Critics and the Basal Ganglia , 1995 .

[23]  Charles J. Wilson,et al.  Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum. , 1994, Journal of neurophysiology.

[24]  A M Graybiel,et al.  The basal ganglia and adaptive motor control. , 1994, Science.

[25]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[26]  Roderic A. Grupen,et al.  Learning admittance mappings for force-guided assembly , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[27]  Gerald Tesauro,et al.  TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play , 1994, Neural Computation.

[28]  Karl J. Friston,et al.  Value-dependent selection in the brain: Simulation in a synthetic neural model , 1994, Neuroscience.

[29]  S. Young,et al.  5-hydroxydopamine-labeled dopaminergic axns: Three-dimensional reconstructions of axons, synapses and postsynaptic targets in rat neostriatum , 1994, Neuroscience.

[30]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[31]  K. Berridge,et al.  The neural basis of drug craving: An incentive-sensitization theory of addiction , 1993, Brain Research Reviews.

[32]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Andrew H. Fagg,et al.  Reinforcement Learning for Robotic Reaching and Grasping , 1993 .

[34]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  Terrence J. Sejnowski,et al.  Using Aperiodic Reinforcement for Directed Self-Organization During Development , 1992, NIPS.

[36]  P. Calabresi,et al.  Long‐term Potentiation in the Striatum is Unmasked by Removing the Voltage‐dependent Magnesium Block of NMDA Receptor Channels , 1992, The European journal of neuroscience.

[37]  Anthony G. Phillips,et al.  Dopamine functions in appetitive and defensive behaviours , 1992, Progress in Neurobiology.

[38]  W. Schultz,et al.  Neuronal activity in monkey striatum related to the expectation of predictable environmental events. , 1992, Journal of neurophysiology.

[39]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[40]  永福 智志.  The Organization of Learning , 2005, Journal of Cognitive Neuroscience.

[41]  J. Connor,et al.  Dendritic spines as individual neuronal compartments for synaptic Ca2+ responses , 1991, Nature.

[42]  B. Hoebel,et al.  A conditioned stimulus decreases extracellular dopamine in the nucleus accumbens after the development of a learned taste aversion , 1991, Brain Research.

[43]  M. Moscovitch,et al.  Memory for temporal order and conditional associative-learning in patients with Parkinson's disease , 1990, Neuropsychologia.

[44]  C. Wilson,et al.  Projection subtypes of rat neostriatal matrix cells revealed by intracellular injection of biocytin , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  A. D. Smith,et al.  The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones , 1990, Trends in Neurosciences.

[46]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions. , 1990, Journal of neurophysiology.

[47]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. , 1990, Journal of neurophysiology.

[48]  N. Birbaumer,et al.  Slow cortical potentials in Parkinsonian patients during the course of an associative learning task , 1990 .

[49]  Richard S. Sutton,et al.  Time-Derivative Models of Pavlovian Reinforcement , 1990 .

[50]  C. Gallistel.  The organization of learning , 1990 .

[51]  Richard S. Sutton,et al.  Learning and Sequential Decision Making , 1989 .

[52]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[53]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[54]  A. Barto,et al.  Learning and Sequential Decision Making , 1989 .

[55]  A. Klopf.  A neuronal model of classical conditioning , 1988 .

[56]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement. , 1987, Applied optics.

[57]  W. Schultz,et al.  Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. , 1987, Journal of neurophysiology.

[58]  W. Schultz.  Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey. , 1986, Journal of neurophysiology.

[59]  Barry L. Jacobs,et al.  Single unit response of noradrenergic, serotonergic and dopaminergic neurons in freely moving cats to simple sensory stimuli , 1986, Brain Research.

[60]  B. Jacobs,et al.  Substantia nigra dopaminergic unit activity in behaving cats: Effect of arousal on spontaneous discharge and sensory evoked activity , 1985, Brain Research.

[61]  T. F. Freund,et al.  Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identified striatonigral neurons, with particular reference to dendritic spines , 1984, Neuroscience.

[62]  J. Bouyer,et al.  Chemical and structural analysis of the relation between cortical inputs and tyrosine hydroxylase-containing terminals in rat neostriatum , 1984, Brain Research.

[63]  Richard S. Sutton,et al.  Temporal credit assignment in reinforcement learning , 1984 .

[64]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[65]  A. Lees,et al.  Cognitive deficits in the early stages of Parkinson's disease. , 1983, Brain : a journal of neurology.

[66]  B. Jacobs,et al.  Behavioral correlates of dopaminergic unit activity in freely moving cats , 1983, Brain Research.

[67]  S. Wise,et al.  The premotor cortex of the monkey , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  S. T. Kitai,et al.  Morphological and physiological properties of neostriatal neurons: An intracellular horseradish peroxidase study in the rat , 1982, Neuroscience.

[69]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[70]  A. Dickinson.  Contemporary Animal Learning Theory , 1981 .

[71]  S. T. Mason,et al.  Pimozide-induced suppression of responding: Evidence against a block of food reward , 1980, Pharmacology Biochemistry and Behavior.

[72]  J. Tanji,et al.  Supplementary motor area: neuronal response to motor instructions. , 1980, Journal of neurophysiology.

[73]  R. Wise,et al.  Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. , 1978, Science.

[74]  J. Fuster,et al.  Delayed-matching and delayed-response deficit from cooling dorsolateral prefrontal cortex in monkeys. , 1976, Journal of comparative and physiological psychology.

[75]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[76]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[77]  H. Niki,et al.  Prefrontal cortical unit activity and delayed alternation performance in monkeys. , 1971, Journal of neurophysiology.

[78]  S. Revusky.  Chapter 4 – THE ROLE OF INTERFERENCE IN ASSOCIATION OVER A DELAY1 , 1971 .

[79]  A. Harper,et al.  Selection of a solution containing histidine by rats fed a histidine-imbalanced diet. , 1970, Journal of comparative and physiological psychology.

[80]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[81]  B. Skinner,et al.  Principles of Behavior , 1944 .

[82]  C. Jacobsen,et al.  Studies of cerebral function in primates. IV. The effects of frontal lobe lesions on the delayed alternation habit in monkeys. , 1937 .