Conjunctive representations in learning and memory: principles of cortical and hippocampal function.

The authors present a theoretical framework for understanding the roles of the hippocampus and neocortex in learning and memory. This framework incorporates a theme found in many theories of hippocampal function: that the hippocampus is responsible for developing conjunctive representations binding together stimulus elements into a unitary representation that can later be recalled from partial input cues. This idea is contradicted by the fact that hippocampally lesioned rats can learn nonlinear discrimination problems that require conjunctive representations. The authors' framework accommodates this finding by establishing a principled division of labor, where the cortex is responsible for slow learning that integrates over multiple experiences to extract generalities whereas the hippocampus performs rapid learning of the arbitrary contents of individual experiences. This framework suggests that tasks involving rapid, incidental conjunctive learning are better tests of hippocampal function. The authors implement this framework in a computational neural network model and show that it can account for a wide range of data in animal learning.

[1]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  F. Mott ARCHIVES OF NEUROLOGY AND PSYCHIATRY , 1923 .

[3]  J. Haldane The interaction of nature and nurture. , 1946, Annals of eugenics.

[4]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[5]  W. Penfield,et al.  Memory deficit produced by bilateral lesions in the hippocampal zone. , 1958, A.M.A. archives of neurology and psychiatry.

[6]  B. Milner Amnesia following operation on the temporal lobes , 1996 .

[7]  R. Douglas,et al.  The hippocampus and behavior. , 1967, Psychological bulletin.

[8]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[9]  M. Seligman On the generality of the laws of learning , 1970 .

[10]  D. Marr A theory for cerebral neocortex , 1970, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[13]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[14]  M. Seligman,et al.  Biological boundaries of learning. , 1972 .

[15]  E. Tulving,et al.  Organization of memory. , 1973 .

[16]  J. Young,et al.  Essays on the nervous system : a festschrift for Professor J. Z. Young , 1974 .

[17]  D. Gaffan,et al.  Recognition impaired and association intact in the memory of monkeys after transection of the fornix. , 1974, Journal of comparative and physiological psychology.

[18]  R. Hirsh The hippocampus and contextual retrieval of information from memory: a theory. , 1974, Behavioral biology.

[19]  A. Baddeley,et al.  Context-dependent memory in two natural environments: on land and underwater. , 1975 .

[20]  H. Hécaen,et al.  Essays on the nervous system Edited by R. Bellairs and E.G. Gray, Clarendon Press, Oxford, 1974. 511 pp. £11.50 , 1975, Neuropsychologia.

[21]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[22]  W A Wickelgren,et al.  Chunking and consolidation: a theoretical synthesis of semantic networks, configuring in conditioning, S--R versus congenitive learning, normal forgetting, the amnesic syndrome, and the hippocampal arousal system. , 1979, Psychological review.

[23]  Richard Hirsh,et al.  The hippocampus, conditional operations, and cognition , 1980 .

[24]  M. Eckardt The Hippocampus as a Cognitive Map , 1980 .

[25]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[26]  F. Masterson,et al.  Species-specific defense reactions and avoidance learning , 1982, The Pavlovian Journal of Biological Science.

[27]  G. V. Hoesen,et al.  The parahippocampal gyrus: New observations regarding its cortical connections in the monkey , 1982, Trends in Neurosciences.

[28]  G Mandler,et al.  The information that amnesic patients do not forget. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[29]  David Zipser,et al.  Feature discovery by competitive learning , 1986 .

[30]  W. Cowan,et al.  On the number of neurons in the dentate gyrus of the rat , 1985, Brain Research.

[31]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[32]  Daniel L. Schacter,et al.  Computer learning by memory-impaired patients: Acquisition and retention of complex knowledge , 1986, Neuropsychologia.

[33]  T. Teyler,et al.  The hippocampal memory indexing theory. , 1986, Behavioral neuroscience.

[34]  James L. McClelland,et al.  Psychological and biological models , 1986 .

[35]  James L. McClelland,et al.  A distributed model of human learning and memory , 1986 .

[36]  D L Schacter,et al.  Preserved learning in amnesic patients: perspectives from research on direct priming. , 1986, Journal of clinical and experimental neuropsychology.

[37]  M. Mishkin,et al.  Visual recognition in monkeys following rhinal cortical ablations combined with either amygdalectomy or hippocampectomy , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  M. Fanselow Associative vs topographical accounts of the immediate shock-freezing deficit in rats: Implications for the response selection rules governing species-specific defensive reactions ☆ , 1986 .

[39]  D. Rumelhart Learning Internal Representations by Error Propagation, Parallel Distributed Processing , 1986 .

[40]  D. Rumelhart Parallel Distributed Processing Volume 1: Foundations , 1987 .

[41]  D. Schacter,et al.  The Evolution of Multiple Memory Systems , 1987 .

[42]  W. Cowan,et al.  On the numbers of neurons on fields CA1 and CA3 of the hippocampus of Sprague-Dawley and Wistar rats , 1987, Brain Research.

[43]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[44]  T. Bliss,et al.  NMDA receptors - their role in long-term potentiation , 1987, Trends in Neurosciences.

[45]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[46]  M. Sur,et al.  Experimentally induced visual projections into auditory thalamus and cortex. , 1988, Science.

[47]  C. Barnes Spatial learning and memory processes: the search for their neurobiological mechanisms in the rat , 1988, Trends in Neurosciences.

[48]  L. Squire,et al.  Human amnesia and animal models of amnesia: performance of amnesic patients on tests designed for the monkey. , 1988, Behavioral neuroscience.

[49]  James L. McClelland,et al.  Explorations in parallel distributed processing: a handbook of models, programs, and exercises , 1988 .

[50]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[51]  L Seress,et al.  Interspecies comparison of the hippocampal formation shows increased emphasis on the regio superior in the Ammon's horn of the human brain. , 1988, Journal fur Hirnforschung.

[52]  R. Sutherland,et al.  Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia , 1989, Psychobiology.

[53]  R. J. McDonald,et al.  Damage to the hippocampal formation in rats selectively impairs the ability to learn cue relationships. , 1989, Behavioral and neural biology.

[54]  Geoffrey E. Hinton Deterministic Boltzmann Learning Performs Steepest Descent in Weight-Space , 1989, Neural Computation.

[55]  D. Amaral,et al.  Memory and the Hippocampus , 1989 .

[56]  M. Packard,et al.  Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  E. Rolls Functions of neuronal networks in the hippocampus and neocortex in memory , 1989 .

[58]  R. Lubow Latent Inhibition and Conditioned Attention Theory , 1989 .

[59]  D. Amaral,et al.  The three-dimensional organization of the hippocampal formation: A review of anatomical data , 1989, Neuroscience.

[60]  Gordon H. Bower,et al.  Computational models of learning in simple neural systems , 1989 .

[61]  D. Amaral,et al.  Lesions of perirhinal and parahippocampal cortex that spare the amygdala and hippocampal formation produce severe memory impairment , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  Steven J. Nowlan,et al.  Maximum Likelihood Competitive Learning , 1989, NIPS.

[63]  Halbert White,et al.  Learning in Artificial Neural Networks: A Statistical Perspective , 1989, Neural Computation.

[64]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[65]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[66]  W. Levy A computational approach to hippocampal function , 1989 .

[67]  K. Mori,et al.  A columnar arrangement of dendritic processes of entorhinal cortex neurons revealed by a monoclonal antibody , 1989, Brain Research.

[68]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[69]  R. Sutherland,et al.  The hippocampal formation is necessary for rats to learn and remember configural discriminations , 1989, Behavioural Brain Research.

[70]  John H. Byrne,et al.  Neural Models of Plasticity: Experimental and Theoretical Approaches , 1989 .

[71]  M. Fanselow Factors governing one-trial contextual conditioning , 1990 .

[72]  L. Squire,et al.  The Neuropsychology of Memory , 1990 .

[73]  B. McNaughton,et al.  Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. , 1990, Progress in brain research.

[74]  R. C. Honey,et al.  Context-specific conditioning in the conditioned-emotional-response procedure. , 1990, Journal of experimental psychology. Animal behavior processes.

[75]  B. McNaughton,et al.  Hebb-Marr networks and the neurobiological representation of action in space. , 1990 .

[76]  R. C. Honey,et al.  Context specificity in pigeon autoshaping , 1990 .

[77]  E. Rolls Principles underlying the representation and storage of information in neuronal networks in the primate hippocampus and cerebral cortex , 1990 .

[78]  I Q Whishaw,et al.  Acquisition and retention by hippocampal rats of simple, conditional, and configural tasks using tactile and olfactory cues: implications for hippocampal function. , 1991, Behavioral neuroscience.

[79]  R. C. Honey,et al.  Conditioning and contextual retrieval in hippocampal rats. , 1991 .

[80]  Javier R. Movellan,et al.  Contrastive Hebbian Learning in the Continuous Hopfield Model , 1991 .

[81]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[82]  L. Squire,et al.  The medial temporal lobe memory system , 1991, Science.

[83]  H. Eichenbaum The Hippocampal System and Declarative Memory in Animals , 1992, Journal of Cognitive Neuroscience.

[84]  Lynn Nadel,et al.  Multiple Memory Systems: What and Why , 1992, Journal of Cognitive Neuroscience.

[85]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[86]  A. Mayes,et al.  Amnesics Have a Disproportionately Severe Memopry Deficit for Interactive Context , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[87]  Michael Davis,et al.  The role of the amygdala in conditioned fear. , 1992 .

[88]  L. Squire Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[89]  M. Fanselow,et al.  Modality-specific retrograde amnesia of fear. , 1992, Science.

[90]  John P. Aggleton,et al.  The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction. , 1992 .

[91]  Joseph E LeDoux,et al.  Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning. , 1992, Behavioral neuroscience.

[92]  N. Schmajuk,et al.  Stimulus configuration, classical conditioning, and hippocampal function. , 1992, Psychological review.

[93]  L. Squire Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory , 1992, Journal of Cognitive Neuroscience.

[94]  E Save,et al.  Object exploration and reactions to spatial and nonspatial changes in hooded rats following damage to parietal cortex or hippocampal formation. , 1992, Behavioral neuroscience.

[95]  P. Holland,et al.  Preserved configural learning and spatial learning impairment in rats with hippocampal damage , 1992, Hippocampus.

[96]  Joseph E LeDoux Brain mechanisms of emotion and emotional learning , 1992, Current Biology.

[97]  J. W. Rudy,et al.  Some properties of configural learning: an investigation of the transverse-patterning problem. , 1992, Journal of experimental psychology. Animal behavior processes.

[98]  R. F. Westbrook,et al.  Effects of Exposure to a To-Be-Shocked Environment upon the Rat's Freezing Response: Evidence for Facilitation, Latent Inhibition, and Perceptual Learning , 1993, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[99]  M. McKERNAN,et al.  Hippocampal lesions do not impair negative patterning: a challenge to configural association theory. , 1993, Behavioral neuroscience.

[100]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[101]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[102]  R. C. Honey,et al.  Selective hippocampal lesions abolish the contextual specificity of latent inhibition and conditioning. , 1993, Behavioral neuroscience.

[103]  M. Bouton Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. , 1993, Psychological bulletin.

[104]  Robert J. Sutherland,et al.  The memory-coherence problem, configural associations, and the hippocampal system. , 1994 .

[105]  James L. McClelland,et al.  Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off , 1994, Hippocampus.

[106]  Joseph E LeDoux,et al.  Lesions of the dorsal hippocampal formation interfere with background but not foreground contextual fear conditioning. , 1994, Learning & memory.

[107]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[108]  T. Sejnowski,et al.  The predictive brain: temporal coincidence and temporal order in synaptic learning mechanisms. , 1994, Learning & memory.

[109]  M. Gluck,et al.  Probabilistic classification learning in amnesia. , 1994, Learning & memory.

[110]  David S. Olton,et al.  Hippocampal function and interference , 1994 .

[111]  A. Yonelinas Receiver-operating characteristics in recognition memory: evidence for a dual-process model. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[112]  E. Rolls,et al.  Computational analysis of the role of the hippocampus in memory , 1994, Hippocampus.

[113]  E. Tulving,et al.  Memory Systems 1994 , 1994 .

[114]  M. Hasselmo Neuromodulation and cortical function: modeling the physiological basis of behavior , 1995, Behavioural Brain Research.

[115]  A comparison of “configural” discrimination problems: Implications for understanding the role of the hippocampal formation in learning and memory , 1995, Psychobiology.

[116]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[117]  R. Sutherland,et al.  Configural association theory and the hippocampal formation: An appraisal and reconfiguration , 1995, Hippocampus.

[118]  J W Rudy,et al.  A comparison of kainic acid plus colchicine and ibotenic acid-induced hippocampal formation damage on four configural tasks in rats. , 1995, Behavioral neuroscience.

[119]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[120]  R. Kesner,et al.  Relational object association learning in rats with hippocampal lesions , 1995, Behavioural Brain Research.

[121]  J W Rudy,et al.  Rats with damage to the hippocampal-formation are impaired on the transverse-patterning problem but not on elemental discriminations. , 1995, Behavioral neuroscience.

[122]  Hermann Ackermann,et al.  Cerebellar contributions to cognition , 1995, Behavioural Brain Research.

[123]  L. Squire,et al.  Learning about categories in the absence of memory. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[124]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[125]  E. Rolls A theory of hippocampal function in memory , 1996, Hippocampus.

[126]  Wendy A Suzuki,et al.  The anatomy, physiology and functions of the perirhinal cortex , 1996, Current Opinion in Neurobiology.

[127]  D S Touretzky,et al.  Theory of rodent navigation based on interacting representations of space , 1996, Hippocampus.

[128]  J. O’Keefe,et al.  Neuronal computations underlying the firing of place cells and their role in navigation , 1996, Hippocampus.

[129]  L. Swanson,et al.  Structural Evidence for Functional Domains in the Rat Hippocampus , 1996, Science.

[130]  J. Aggleton,et al.  Amnesia and recognition memory: A re-analysis of psychometric data , 1996, Neuropsychologia.

[131]  H. Eichenbaum,et al.  Conservation of hippocampal memory function in rats and humans , 1996, Nature.

[132]  Jonathan D. Cohen,et al.  A preliminary theory of the interactions between prefrontal cortex and hippocampus that contribute to planning and prospective memory. , 1996 .

[133]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[134]  J. Bower,et al.  Cerebellum Implicated in Sensory Acquisition and Discrimination Rather Than Motor Control , 1996, Science.

[135]  James L. McClelland,et al.  Considerations arising from a complementary learning systems perspective on hippocampus and neocortex , 1996, Hippocampus.

[136]  Risto Miikkulainen,et al.  Convergence-Zone Episodic Memory: Analysis and Simulations , 1997, Neural Networks.

[137]  M. Mishkin,et al.  Differential effects of early hippocampal pathology on episodic and semantic memory. , 1997, Science.

[138]  M. Fanselow,et al.  Neurotoxic lesions of the dorsal hippocampus and Pavlovian fear conditioning in rats , 1997, Behavioural Brain Research.

[139]  R. J. McDonald,et al.  Systematic comparison of the effects of hippocampal and fornix‐fimbria lesions on acquisition of three configural discriminations , 1997, Hippocampus.

[140]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[141]  E. Bullmore,et al.  Society for Neuroscience Abstracts , 1997 .

[142]  James L. McClelland,et al.  Rethinking infant knowledge: toward an adaptive process account of successes and failures in object permanence tasks. , 1997, Psychological review.

[143]  Andrew P. Yonelinas,et al.  The relation between conscious and unconscious (automatic) influences: A declaration of independence. , 1997 .

[144]  S. Becker,et al.  Long-term semantic priming: a computational account and empirical evidence. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[145]  James L. McClelland,et al.  A Hippocampal Model of Recognition Memory , 1997, NIPS.

[146]  Differential effects of ibotenic acid lesions of the hippocampus and blockade of N-methyl-D-aspartate receptor-dependent long-term potentiation on contextual processing in rats. , 1997, Behavioral neuroscience.

[147]  H. Eichenbaum,et al.  The hippocampus and memory for orderly stimulus relations. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[148]  M. Hasselmo,et al.  Free recall and recognition in a network model of the hippocampus: simulating effects of scopolamine on human memory function , 1997, Behavioural Brain Research.

[149]  M. Gluck,et al.  Psychobiological models of hippocampal function in learning and memory. , 1997, Annual review of psychology.

[150]  E. Tulving,et al.  Episodic and declarative memory: Role of the hippocampus , 1998, Hippocampus.

[151]  R. O’Reilly Six principles for biologically based computational models of cortical cognition , 1998, Trends in Cognitive Sciences.

[152]  D G Gadian,et al.  Amnesia and the organization of the hippocampal system , 1998, Hippocampus.

[153]  T. Bussey,et al.  Fornix Lesions Can Facilitate Acquisition of the Transverse Patterning Task: A Challenge for “Configural” Theories of Hippocampal Function , 1998, The Journal of Neuroscience.

[154]  R. C. Honey,et al.  Hippocampal Lesions Disrupt an Associative Mismatch Process , 1998, The Journal of Neuroscience.

[155]  Y. Munakata Infant perseveration and implications for object permanence theories: A PDP model of the AB task , 1998 .

[156]  H Eichenbaum,et al.  The hippocampus and transverse patterning guided by olfactory cues. , 1998, Behavioral neuroscience.

[157]  M. Chun,et al.  Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage , 1999, Nature Neuroscience.

[158]  David Wood,et al.  Luddites must not block progress in genetics , 1999, Nature.

[159]  R. O’Reilly,et al.  Contextual fear conditioning, conjunctive representations, pattern completion, and the hippocampus. , 1999, Behavioral neuroscience.

[160]  M. W. Brown,et al.  Episodic memory, amnesia, and the hippocampal–anterior thalamic axis , 1999, Behavioral and Brain Sciences.

[161]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[162]  L R Squire,et al.  Impaired transverse patterning in human amnesia is a special case of impaired memory for two-choice discrimination tasks. , 1999, Behavioral neuroscience.

[163]  H. Eichenbaum,et al.  The global record of memory in hippocampal neuronal activity , 1999, Nature.

[164]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[165]  R. Sutherland,et al.  Retrograde amnesia after hippocampal damage: Recent vs. remote memories in two tasks , 2001, Hippocampus.

[166]  Randall C. O'Reilly,et al.  Generalization in Interactive Networks: The Benefits of Inhibitory Competition and Hebbian Learning , 2001, Neural Computation.

[167]  L. T. Robertson Memory and the brain. , 2002, Journal of dental education.