The Hippocampus and Cerebellum in Adaptively Timed Learning, Recognition, and Movement

The concepts of declarative memory and procedural memory have been used to distinguish two basic types of learning. A neural network model suggests how such memory processes work together as recognition learning, reinforcement learning, and sensorimotor learning take place during adaptive behaviors. To coordinate these processes, the hippocampal formation and cerebellum each contains circuits that learn to adaptively time their outputs. Within the model, hippocampal timing helps to maintain attention on motivationally salient goal objects during variable task-related delays, and cerebellar timing controls the release of conditioned responses. This property is part of the model's description of how cognitive-emotional interactions focus attention on motivationally valued cues, and how this process breaks down due to hippocampal ablation. The model suggests that the hippocampal mechanisms that help to rapidly draw attention to salient cues could prematurely release motor commands were not the release of these commands adaptively timed by the cerebellum. The model hippocampal system modulates cortical recognition learning without actually encoding the representational information that the cortex encodes. These properties avoid the difficulties faced by several models that propose a direct hippocampal role in recognition learning. Learning within the model hippocampal system controls adaptive timing and spatial orientation. Model properties hereby clarify how hippocampal ablations cause amnesic symptoms and difficulties with tasks which combine task delays, novelty detection, and attention toward goal objects amid distractions. When these model recognition, reinforcement, sensorimotor, and timing processes work together, they suggest how the brain can accomplish conditioning of multiple sensory events to delayed rewards, as during serial compound conditioning.

[1]  G. A. Miller The magic number seven, plus minus two , 1956 .

[2]  G. Ryle,et al.  The concept of mind. , 2004, The International journal of psycho-analysis.

[3]  L. Kamin Predictability, surprise, attention, and conditioning , 1967 .

[4]  M. Posner,et al.  On the genesis of abstract ideas. , 1968, Journal of experimental psychology.

[5]  S Grossberg,et al.  Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[6]  S. Grossberg,et al.  Some physiological and biochemical consequences of psychological postulates. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[7]  M. C. Smith,et al.  CS-US interval and US intensity in classical conditioning of the rabbit's nictitating membrane response. , 1968, Journal of comparative and physiological psychology.

[8]  N. C. Waugh,et al.  The Pathology of Memory , 1969 .

[9]  S. Grossberg On learning and energy-entropy dependence in recurrent and nonrecurrent signed networks , 1969 .

[10]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[11]  Stephen Grossberg,et al.  On the serial learning of lists , 1969 .

[12]  S. Grossberg On the production and release of chemical transmitters and related topics in cellular control. , 1969, Journal of theoretical biology.

[13]  Stephen Grossberg,et al.  On Learning of Spatiotemporal Patterns by Networks with Ordered Sensory and Motor Components 1. Excitatory Components of the Cerebellum , 1969 .

[14]  M. Posner,et al.  Retention of Abstract Ideas. , 1970 .

[15]  R. Young Visual cells. , 1970, Scientific American.

[16]  S. Grossberg,et al.  Schizophrenia: possible dependence of associational span, bowing, and primacy vs. recency on spiking threshold. , 1970, Behavioral science.

[17]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  R. Atkinson,et al.  The control of short-term memory. , 1971, Scientific American.

[19]  S. Grossberg,et al.  Spiking threshold and overarousal effects in serial learning , 1971 .

[20]  J. Albus A Theory of Cerebellar Function , 1971 .

[21]  E. Warrington,et al.  The effect of prior learning on subsequent retention in amnesic patients. , 1974, Neuropsychologia.

[22]  D. Gaffan,et al.  Recognition impaired and association intact in the memory of monkeys after transection of the fornix. , 1974, Journal of comparative and physiological psychology.

[23]  S. Grossberg A neural model of attention, reinforcement and discrimination learning. , 1975, International review of neurobiology.

[24]  P. Solomon Role of the hippocampus in blocking and conditioned inhibition of the rabbit's nictitating membrane response. , 1977, Journal of comparative and physiological psychology.

[25]  W. T. Thach,et al.  Purkinje cell activity during motor learning , 1977, Brain Research.

[26]  T. L. Bennett,et al.  Hippocampectomy and the attenuation of blocking. , 1978, Behavioral biology.

[27]  M. Mishkin Memory in monkeys severely impaired by combined but not by separate removal of amygdala and hippocampus , 1978, Nature.

[28]  G. Lynch,et al.  Activity of dentate granule cells during learning: Differentiation of perforant path input , 1979, Brain Research.

[29]  W. Singer,et al.  Changes in the circuitry of the kitten visual cortex are gated by postsynaptic activity , 1979, Nature.

[30]  E J Kehoe,et al.  Associative transfer and stimulus selection in classical conditioning of the rabbit's nictitating membrane response to serial compound CSs. , 1979, Journal of experimental psychology. Animal behavior processes.

[31]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[32]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[33]  M. Eckardt The Hippocampus as a Cognitive Map , 1980 .

[34]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[35]  S. Grossberg How does a brain build a cognitive code , 1980 .

[36]  T J Ebner,et al.  Correlation between activity of Purkinje cells and its modification by natural peripheral stimuli. , 1981, Journal of neurophysiology.

[37]  S. Deadwyler,et al.  Entorhinal and septal inputs differentially control sensory-evoked responses in the rat dentate gyrus. , 1981, Science.

[38]  S. Grossberg Processing of expected and unexpected events during conditioning and attention: a psychophysiological theory. , 1982, Psychological review.

[39]  M. Mishkin A memory system in the monkey. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[40]  Stephen Grossberg,et al.  Studies of mind and brain , 1982 .

[41]  S. Grossberg Processing of Expected and Unexpected Events During Conditioning and Attention: A Psychophysiological Theory , 1982 .

[42]  Stephen Grossberg,et al.  Classical and Instrumental Learning by Neural Networks , 1982 .

[43]  L. Cermak Human memory and amnesia , 1982 .

[44]  D. Kelly The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-Hippocampel System. By Jeffrey A. Gray Oxford University Press. 1982. Pp 548. £27.50 , 1982, British Journal of Psychiatry.

[45]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[46]  N. Schmajuk,et al.  Absence of overshadowing in rats with hippocampal lesions , 1983 .

[47]  E. Azmitia The neuropsychology of anxiety: an enquiry into the functions of the Septo-Hippocampal system, Gray J.A.. Oxford University Press, New York (1981), pp. 523.,£27.50 , 1983 .

[48]  J. Staddon Adaptive behavior and learning , 1983 .

[49]  R. Desimone,et al.  Shape recognition and inferior temporal neurons. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[50]  W. Singer Neuronal Activity as a Shaping Factor in the Self-Organization of Neuron Assemblies , 1983 .

[51]  G Mandler,et al.  The information that amnesic patients do not forget. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[52]  S. Grossberg Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. , 1984, Biological psychiatry.

[53]  E. James Kehoe,et al.  Temporal dynamics of the rabbit's nictitating membrane response in serial compound conditioned stimuli. , 1984 .

[54]  伊藤 正男 The cerebellum and neural control , 1984 .

[55]  William B. Levy,et al.  Synaptic modification, neuron selectivity, and nervous system organization , 1985 .

[56]  D. Gaffan,et al.  Hippocampus: memory, habit and voluntary movement. , 1985, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[57]  T Hamanaka,et al.  [Neuropsychology of memory]. , 1985, No to shinkei = Brain and nerve.

[58]  S Grossberg,et al.  Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. , 1986, Human neurobiology.

[59]  Stephen Grossberg,et al.  Neural dynamics of adaptive sensory-motor control , 1986 .

[60]  Karl H. Pribram,et al.  The Hippocampal System and Recombinant Processing , 1986 .

[61]  Stephen Grossberg,et al.  Neural dynamics of adaptive sensory-motor control : ballistic eye movements , 1986 .

[62]  S Grossberg,et al.  Neural dynamics of word recognition and recall: attentional priming, learning, and resonance. , 1986, Psychological review.

[63]  S. Grossberg,et al.  Neural dynamics of attention switching and temporal-order information in short-term memory , 1988, Memory & cognition.

[64]  Richard F. Thompson,et al.  Role of the Hippocampus in Classical Conditioning of Aversive and Appetitive Behaviors , 1986 .

[65]  S. Grossberg The Adaptive Self-Organization of Serial Order in Behavior: Speech, Language, And Motor Control , 1987 .

[66]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement. , 1987, Applied optics.

[67]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: Conditioned reinforcement, inhibition, and opponent processing , 1987, Psychobiology.

[68]  E J Kehoe,et al.  Differential conditioning of the rabbit's nictitating membrane response to serial compound stimuli. , 1987, Journal of experimental psychology. Animal behavior processes.

[69]  S Grossberg,et al.  Masking fields: a massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. , 1987, Applied optics.

[70]  M. Schlossberg Neural Dynamics of Adaptive Sensory-Motor Control: Ballistic Eye Movements (Advances in Psychology, Vol. 30). , 1987 .

[71]  Stephen Grossberg,et al.  Neural dynamics of word recognition and recall: attentional priming, learning, and resonance. , 1986, Psychology Review.

[72]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[73]  S. Grossberg,et al.  Neural dynamics of decision making under risk: affective balance and cognitive-emotional interactions. , 1988, Psychological review.

[74]  M. Mishkin,et al.  The anatomy of memory. , 1987, Scientific American.

[75]  Stephen Grossberg,et al.  Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. , 1986, Human neurobiology.

[76]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[77]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[78]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[79]  S. Grossberg Neural Networks and Natural Intelligence , 1988 .

[80]  S. Lisberger The neural basis for motor learning in the vestibulo-ocular reflex in monkeys , 1988, Trends in Neurosciences.

[81]  Richard F. Thompson The neural basis of basic associative learning of discrete behavioral responses , 1988, Trends in Neurosciences.

[82]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[83]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[84]  G. Lynch,et al.  The neurobiology of learning and memory , 1989, Cognition.

[85]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[86]  P. Milner A cell assembly theory of hippocampal amnesia , 1989, Neuropsychologia.

[87]  Bruce L. McNaughton,et al.  Spatial representation in the rat: Conceptual, behavioral, and neurophysiological perspectives , 1990 .

[88]  L. Squire,et al.  The primate hippocampal formation: evidence for a time-limited role in memory storage. , 1990, Science.

[89]  J. O’Keefe,et al.  A computational theory of the hippocampal cognitive map. , 1990, Progress in brain research.

[90]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[91]  Robert O. Gjerdingen,et al.  Categorization of Musical Patterns by Self-Organizing Neuronlike Networks , 1990 .

[92]  Daniel Bullock,et al.  A neural network model of serial order recall from short-term memory , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[93]  M. Harries,et al.  Visual Processing of Faces in Temporal Cortex: Physiological Evidence for a Modular Organization and Possible Anatomical Correlates , 1991, Journal of Cognitive Neuroscience.

[94]  R. Desimone,et al.  A neural mechanism for working and recognition memory in inferior temporal cortex. , 1991, Science.

[95]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[96]  Allen M. Waxman,et al.  Visual learning, adaptive expectations, and behavioral conditioning of the mobile robot MAVIN , 1991, Neural Networks.

[97]  L. Squire,et al.  The medial temporal lobe memory system , 1991, Science.

[98]  Stephen Grossberg,et al.  Synchronized oscillations during cooperative feature linking in a cortical model of visual perception , 1991, Neural Networks.

[99]  S. Grossberg,et al.  Working Memory Networks for Learning Temporal Order, with Application to 3-D Visual Object Recognition , 1991 .

[100]  R. Desimone Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[101]  Allen M. Waxman,et al.  Adaptive 3-D Object Recognition from Multiple Views , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[102]  E. Kandel,et al.  Are adult learning mechanisms also used for development? , 1992, Science.

[103]  H. Eichenbaum,et al.  Neuronal activity in the hippocampus during delayed non‐match to sample performance in rats: Evidence for hippocampal processing in recognition memory , 1992, Hippocampus.

[104]  Allen M. Waxman,et al.  Learning and Recognizing 3D Objects from Multiple Views in a Neural System , 1992 .

[105]  D. Gaffan,et al.  Amnesia for Complex Naturalistic Scenes and for Objects Following Fornix Transection in the Rhesus Monkey , 1992, The European journal of neuroscience.

[106]  S. Grossberg,et al.  A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. , 1992, Brain research. Cognitive brain research.

[107]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[108]  Stephen Grossberg,et al.  Working Memory Networks for Learning Temporal Order with Application to Three-Dimensional Visual Object Recognition , 1992, Neural Computation.

[109]  S. Grossberg,et al.  A self-organizing neural network for supervised learning, recognition, and prediction , 1992, IEEE Communications Magazine.

[110]  W. Singer,et al.  Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation , 1993, Trends in Neurosciences.

[111]  M. Mauk,et al.  Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[112]  J. Aggleton The contribution of the amygdala to normal and abnormal emotional states , 1993, Trends in Neurosciences.

[113]  Luis Rabelo,et al.  Prediction of Secondary Structures of Proteins , 1993 .

[114]  Stephen Grossberg,et al.  Fusion Artmap: A Neural Network Architecture for Multi-Channel Data Fusion and Classification , 1993 .

[115]  S. Grossberg,et al.  Normal and amnesic learning, recognition and memory by a neural model of cortico-hippocampal interactions , 1993, Trends in Neurosciences.

[116]  L. Squire,et al.  The learning of categories: parallel brain systems for item memory and category knowledge. , 1993, Science.

[117]  A Amsel,et al.  Hippocampal function in the rat: Cognitive mapping or vicarious trial and error? , 1993, Hippocampus.

[118]  M. M. Moya,et al.  One-class classifier networks for target recognition applications , 1993 .

[119]  George L. Gerstein,et al.  Feature-linked synchronization of thalamic relay cell firing induced by feedback from the visual cortex , 1994, Nature.

[120]  Michael Anderson,et al.  NIRS: Large scale ART-1 neural architectures for engineering design retrieval , 1994, Neural Networks.

[121]  D. Gaffan,et al.  Interaction of Temporal Lobe and Frontal Lobe in Memory , 1994 .

[122]  Philip K. Hopke,et al.  An adaptive resonance theory based artificial neural network (ART-2a) for rapid identification of airborne particle shapes from their scanning electron microscopy images , 1994 .

[123]  James L. Crowley,et al.  Learning locomotion reflexes: A self-supervised neural system for a mobile robot , 1994, Robotics Auton. Syst..

[124]  William K. Estes,et al.  Classification and cognition , 1994 .

[125]  A. Thierry,et al.  Motor and Cognitive Functions of the Prefrontal Cortex , 1994, Research and Perspectives in Neurosciences.

[126]  Stephen Grossberg,et al.  A Neural Network Model of Auditory Scene Anaysis and Source Segregation , 1994 .

[127]  N. Logothetis,et al.  View-dependent object recognition by monkeys , 1994, Current Biology.

[128]  Robert T. Knight,et al.  Attention Regulation and Human Prefrontal Cortex , 1994 .

[129]  H. Eichenbaum,et al.  Two functional components of the hippocampal memory system , 1994, Behavioral and Brain Sciences.

[130]  P. Goldman-Rakic,et al.  The Issue of Memory in the Study of Prefrontal Function , 1994 .

[131]  Stephen Grossberg,et al.  A neural model of timed response learning in the cerebellum , 1994, Neural Networks.

[132]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[133]  Stephen Grossberg,et al.  A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems , 1995, IEEE Trans. Neural Networks.

[134]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[135]  Yousif Raja Asfour Fusion artmap: neural networks for multi-sensor fusion and classification , 1995 .

[136]  Stephen Grossberg,et al.  Fast-learning VIEWNET architectures for recognizing three-dimensional objects from multiple two-dimensional views , 1995, Neural Networks.

[137]  Alan N. Gove,et al.  Brightness perception, illusory contours, and corticogeniculate feedback , 1995, Visual Neuroscience.

[138]  Stephen Grossberg,et al.  Fast Learning VIEWNET Architectures for Recognizing 3-D Objects from Multiple 2-D Views , 1995 .

[139]  Gail A. Carpenter,et al.  ART-EMAP: A neural network architecture for object recognition by evidence accumulation , 1995, IEEE Trans. Neural Networks.

[140]  久野 宗,et al.  The synapse : function, plasticity, and neurotrophism , 1995 .

[141]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[142]  Yukinori Suzuki Self-organizing QRS-wave recognition in ECG using neural networks , 1995, IEEE Trans. Neural Networks.

[143]  S. Grossberg,et al.  Neural dynamics of variable-rate speech categorization. , 1997, Journal of experimental psychology. Human perception and performance.

[144]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[145]  Marzuki Khalid,et al.  BY FUZZY ARTMAP NEURAL NETWORK , 1997 .

[146]  E. Tulving,et al.  Memory beyond the hippocampus , 1997, Current Opinion in Neurobiology.

[147]  S. Grossberg,et al.  Self-Organization of Binocular Disparity Tuning by Reciprocal Corticogeniculate Interactions , 1998, Journal of Cognitive Neuroscience.