Reinforcement learning by Hebbian synapses with adaptive thresholds

[1]  W. Pitts,et al.  How we know universals; the perception of auditory and visual forms. , 1947, The Bulletin of mathematical biophysics.

[2]  D. Robinson.  Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[3]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[4]  H. Markowitsch,et al.  Reward related neurons in cat association cortex , 1976, Brain Research.

[5]  J. Price,et al.  Projections from the amygdaloid complex to the cerebral cortex and thalamus in the rat and cat , 1977, The Journal of comparative neurology.

[6]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.

[7]  E. Rolls,et al.  The latency of activation of neurones in the lateral hypothalamus and substantia innominata during feeding in the monkey , 1979, Brain Research.

[8]  Masataka Watanabe,et al.  Prefrontal and cingulate unit activity during timing behavior in the monkey , 1979, Brain Research.

[9]  E. Rolls,et al.  Visual responses of neurons in the dorsolateral amygdala of the alert monkey , 1979, Experimental Neurology.

[10]  A. Crane,et al.  Regional distribution of monoamines in the cerebral cortex and subcortical structures of the rhesus monkey: concentrations and in vivo synthesis rates , 1979, Brain Research.

[11]  I. Divac,et al.  Biochemical evidence for glutamate as neurotransmitter in corticostriatal and corticothalamic fibres in rat brain , 1981, Neuroscience.

[12]  Joaquin M. Fuster,et al.  Single cell activity in ventral prefrontal cortex of behaving monkeys , 1981, Brain Research.

[13]  R. Nicoll,et al.  Feed‐forward dendritic inhibition in rat hippocampal pyramidal cells studied in vitro , 1982, The Journal of physiology.

[14]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  D. Amaral,et al.  Evidence for an amygdaloid projection to premotor cortex but not to motor cortex in the monkey , 1983, Brain Research.

[17]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[18]  P. Streit.  Glutamate and Aspartate as Transmitter Candidates for Systems of the Cerebral Cortex , 1984 .

[19]  M. Sarter,et al.  Involvement of the amygdala in learning and memory: a critical review, with emphasis on anatomical relations. , 1985, Behavioral neuroscience.

[20]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[21]  H. Grill,et al.  Gustatory cortex in the rat. I. Physiological properties and cytoarchitecture , 1986, Brain Research.

[22]  J. V. Gisbergen,et al.  Collicular ensemble coding of saccades based on vector summation , 1987, Neuroscience.

[23]  L. Cooper,et al.  A physiological basis for a theory of synapse modification. , 1987, Science.

[24]  A. Kriegstein,et al.  Synaptic responses of cortical pyramidal neurons to light stimulation in the isolated turtle visual system , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[26]  Y. Frégnac,et al.  A cellular analogue of visual cortical plasticity , 1988, Nature.

[27]  H Nishijo,et al.  Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  D. Finch,et al.  Feedforward inhibition of the rat entorhinal cortex and subicular complex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  B. Berger,et al.  Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex: A radioautographic study , 1988, The Journal of comparative neurology.

[30]  G. Mogenson,et al.  Neuromodulatory action of dopamine in the nucleus accumbens: An in vivo intracellular study , 1988, Neuroscience.

[31]  S G Lisberger,et al.  The neural basis for learning of simple motor skills. , 1988, Science.

[32]  P. Goldman-Rakic,et al.  Posterior parietal cortex in rhesus monkey: II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe , 1989, The Journal of comparative neurology.

[33]  H. Berg.  Cold Spring Harbor Symposia on Quantitative Biology.: Vol. LII. Evolution of Catalytic Functions. Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, 1987, ISBN 0-87969-054-2, xix + 955 pp., US $150.00. , 1989 .

[34]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[35]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[36]  David H. Ackley,et al.  Generalization and Scaling in Reinforcement Learning , 1989, NIPS.

[37]  A. Keller,et al.  Long-term potentiation in the motor cortex. , 1989, Science.

[38]  J. Lisman,et al.  A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[39]  E. W. Kairiss,et al.  Hebbian synapses: biophysical mechanisms and algorithms. , 1990, Annual review of neuroscience.

[40]  R. Nicoll,et al.  Analysis of excitatory synaptic action in pyramidal cells using whole‐cell recording from rat hippocampal slices. , 1990, The Journal of physiology.

[41]  Michael Davis,et al.  Blocking of acquisition but not expression of conditioned fear-potentiated startle by NMDA antagonists in the amygdala , 1990, Nature.

[42]  Paul B. Johnson,et al.  Making arm movements within different parts of space: dynamic aspects in the primate motor cortex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  A P Georgopoulos,et al.  Neural coding of the direction of reaching and a comparison with saccadic eye movements. , 1990, Cold Spring Harbor symposia on quantitative biology.

[44]  B. Sakmann,et al.  A family of AMPA-selective glutamate receptors. , 1990, Science.

[45]  H. Groenewegen,et al.  The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization. , 1990, Progress in brain research.

[46]  Michael I. Jordan,et al.  A more biologically plausible learning rule for neural networks. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[47]  J. Changeux,et al.  The Wisconsin Card Sorting Test: theoretical analysis and modeling in a neuronal network. , 1991, Cerebral cortex.

[48]  S T Kitai,et al.  Version unknown SOURCE ( OR PART OF THE FOLLOWING SOURCE ) : Type article Title Hippocampal inputs to identified neurons in an in vitro slice preparation of the rat nucleus accumbens : evidence for feed-forward inhibition , 2003 .

[49]  R. Nicoll,et al.  Mechanisms underlying potentiation of synaptic transmission in rat anterior cingulate cortex in vitro. , 1991, The Journal of physiology.

[50]  D. Cechetto,et al.  Autonomic responses and efferent pathways from the insular cortex in the rat , 1991, The Journal of comparative neurology.

[51]  A Konnerth,et al.  Patch clamp analysis of excitatory synaptic currents in granule cells of rat hippocampus. , 1991, The Journal of physiology.

[52]  P. Goldman-Rakic,et al.  Neuronal activity related to saccadic eye movements in the monkey's dorsolateral prefrontal cortex. , 1991, Journal of neurophysiology.

[53]  S Grillner,et al.  Primary afferents evoke excitatory amino acid receptor-mediated EPSPs that are modulated by presynaptic GABAB receptors in lamprey. , 1991, Journal of neurophysiology.

[54]  Glutamate-immunoreactive neurons of the central amygdaloid nucleus projecting to the subretrofacial nucleus of SHR and WKY rats: A double-labeling study , 1991, Neuroscience Letters.

[55]  David Gaffan,et al.  Amygdala and the memory of reward. , 1992 .

[56]  Terrence J. Sejnowski,et al.  Using Aperiodic Reinforcement for Directed Self-Organization During Development , 1992, NIPS.

[57]  G. V. Van Hoesen,et al.  Cingulate input to the primary and supplementary motor cortices in the rhesus monkey: Evidence for somatotopy in areas 24c and 23c , 1992, The Journal of comparative neurology.

[58]  B. Vogt,et al.  Nociceptive neurons in area 24 of rabbit cingulate cortex. , 1992, Journal of neurophysiology.

[59]  C. Geula,et al.  Cytoarchitecture and neural afferents of orbitofrontal cortex in the brain of the monkey , 1992, The Journal of comparative neurology.

[60]  M. Bear,et al.  Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[61]  John P. Aggleton,et al.  The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction. , 1992 .

[62]  W. Abraham,et al.  Priming of associative long-term depression in the dentate gyrus by θ frequency synaptic activity , 1992, Neuron.

[63]  R. Malenka,et al.  The influence of prior synaptic activity on the induction of long-term potentiation. , 1992, Science.

[64]  F. Crépel,et al.  Postsynaptic calcium is necessary for the induction of LTP and LTD of monosynaptic EPSPs in prefrontal neurons: An in vitro study in the rat , 1992, Synapse.

[65]  R. Malenka,et al.  Mechanisms underlying induction of homosynaptic long-term depression in area CA1 of the hippocampus , 1992, Neuron.

[66]  Joseph E LeDoux,et al.  Information cascade from primary auditory cortex to the amygdala: corticocortical and corticoamygdaloid projections of temporal cortex in the rat. , 1993, Cerebral cortex.

[67]  Y. Kitamura,et al.  Stimulatory Effects of Protein Kinase C and Calmodulin Kinase II on N‐Methyl‐d‐Aspartate Receptor/Channels in the Postsynaptic Density of Rat Brain , 1993, Journal of neurochemistry.

[68]  Terrence J. Sejnowski,et al.  Foraging in an Uncertain Environment Using Predictive Hebbian Learning , 1993, NIPS.

[69]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[70]  F. H. Lopes da Silva,et al.  Synaptic Plasticity in an In Vitro Slice Preparation of the Rat Nucleus Accumbens , 1993, The European journal of neuroscience.

[71]  R. Malenka,et al.  An essential role for protein phosphatases in hippocampal long-term depression. , 1993, Science.

[72]  M. Bear,et al.  Common forms of synaptic plasticity in the hippocampus and neocortex in vitro. , 1993, Science.

[73]  G. Collingridge,et al.  Induction of LTP in the hippocampus needs synaptic activation of glutamate metabotropic receptors , 1993, Nature.

[74]  Apostolos P. Georgopoulos,et al.  New concepts in generation of movement , 1994, Neuron.

[75]  B. Orser,et al.  Regulation of NMDA receptors in cultured hippocampal neurons by protein phosphatases 1 and 2A , 1994, Nature.

[76]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[77]  Karl J. Friston,et al.  Value-dependent selection in the brain: Simulation in a synthetic neural model , 1994, Neuroscience.

[78]  Yu Tian Wang,et al.  Regulation of NMDA receptors by tyrosine kinases and phosphatases , 1994, Nature.

[79]  C. Pennartz,et al.  The nucleus accumbens as a complex of functionally distinct neuronal ensembles: An integration of behavioural, electrophysiological and anatomical data , 1994, Progress in Neurobiology.

[80]  E. Kandel,et al.  Role of guanylyl cyclase and cGMP-dependent protein kinase in long-term potentiation , 1994, Nature.

[81]  H. Groenewegen,et al.  The specificity of the ‘nonspecific’ midline and intralaminar thalamic nuclei , 1994, Trends in Neurosciences.

[82]  Michael Davis,et al.  Neurotransmission in the rat amygdala related to fear and anxiety , 1994, Trends in Neurosciences.

[83]  I. Módy,et al.  Regulation of NMDA channel function by endogenous Ca2+-dependent phosphatase , 1994, Nature.

[84]  Joseph E LeDoux,et al.  Differential localization of NMDA and AMPA receptor subunits in the lateral and basal nuclei of the amygdala: A light and electron microscopic study , 1995, The Journal of comparative neurology.

[85]  Joseph E. LeDoux,et al.  LTP is accompanied by commensurate enhancement of auditory-evoked responses in a fear conditioning circuit , 1995, Neuron.

[86]  J. Donoghue,et al.  Different forms of synaptic plasticity in somatosensory and motor areas of the neocortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[87]  R. Kesner,et al.  Memory for Magnitude of Reinforcement: Dissociation between the Amygdala and Hippocampus , 1995, Neurobiology of Learning and Memory.

[88]  R. Andersen.  Encoding of intention and spatial location in the posterior parietal cortex. , 1995, Cerebral cortex.

[89]  C. Pennartz.  The ascending neuromodulatory systems in learning by reinforcement: comparing computational conjectures with experimental findings , 1995, Brain Research Reviews.

[90]  Robert C. Malenka,et al.  Independent mechanisms for long-term depression of AMPA and NMDA responses , 1995, Neuron.

[91]  Robert S. Zucker,et al.  Postsynaptic Levels of [Ca2+]i Needed to Trigger LTD and LTP , 1996, Neuron.

[92]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[93]  R. Nicoll,et al.  Ca2+ Signaling Requirements for Long-Term Depression in the Hippocampus , 1996, Neuron.

[94]  A. McDonald,et al.  Glutamate and aspartate immunoreactive neurons of the rat basolateral amygdala: Colocalization of excitatory amino acids and projections to the limbic circuit , 1996, The Journal of comparative neurology.

[95]  M. Bear,et al.  Experience-dependent modification of synaptic plasticity in visual cortex , 1996, Nature.

[96]  Masataka Watanabe.  Reward expectancy in primate prefrental neurons , 1996, Nature.