An integrated neural model of semantic memory, lexical retrieval and category formation, based on a distributed feature representation

This work presents a connectionist model of the semantic-lexical system. Model assumes that the lexical and semantic aspects of language are memorized in two distinct stores, and are then linked together on the basis of previous experience, using physiological learning mechanisms. Particular characteristics of the model are: (1) the semantic aspects of an object are described by a collection of features, whose number may vary between objects. (2) Individual features are topologically organized to implement a similarity principle. (3) Gamma-band synchronization is used to segment different objects simultaneously. (4) The model is able to simulate the formation of categories, assuming that objects belong to the same category if they share some features. (5) Homosynaptic potentiation and homosynaptic depression are used within the semantic network, to create an asymmetric pattern of synapses; this allows a different role to be assigned to shared and distinctive features during object reconstruction. (6) Features which frequently occurred together, and the corresponding word-forms, become linked via reciprocal excitatory synapses. (7) Features in the semantic network tend to inhibit words not associated with them during the previous learning phase. Simulations show that, after learning, presentation of a cue can evoke the overall object and the corresponding word in the lexical area. Word presentation, in turn, activates the corresponding features in the sensory-motor areas, recreating the same conditions occurred during learning, according to a grounded cognition viewpoint. Several words and their conceptual description can coexist in the lexical-semantic system exploiting gamma-band time division. Schematic exempla are shown, to illustrate the possibility to distinguish between words representing a category, and words representing individual members and to evaluate the role of gamma-band synchronization in priming. Finally, the model is used to simulate patients with focalized lesions, assuming a damage of synaptic strength in specific feature areas. Results are critically discussed in view of future model extensions and application to real objects. The model represents an original effort to incorporate many basic ideas, found in recent conceptual theories, within a single quantitative scaffold.

[1]  G. Humphreys,et al.  Hierarchies, similarity, and interactivity in object recognition: “Category-specific” neuropsychological deficits , 2001, Behavioral and Brain Sciences.

[2]  A. H. Kawamoto.  Nonlinear dynamics in the resolution of lexical ambiguity: A parallel distributed processing account. , 1993 .

[3]  Mauro Ursino,et al.  Recognition of Abstract Objects Via Neural Oscillators: Interaction Among Topological Organization, Associative Memory and Gamma Band Synchronization , 2009, IEEE Transactions on Neural Networks.

[4]  Sergio E. Chaigneau,et al.  THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS , 2003, Cognitive neuropsychology.

[5]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[6]  G. Dell,et al.  Lexical access in aphasic and nonaphasic speakers. , 1997, Psychological review.

[7]  Anna Y. Kuznetsova,et al.  A model for modulation of neuronal synchronization by D4 dopamine receptor-mediated phospholipid methylation , 2008, Journal of Computational Neuroscience.

[8]  K. McRae,et al.  Automatic semantic similarity priming. , 1998 .

[9]  D. Neary,et al.  Knowledge of famous faces and names in semantic dementia. , 2004, Brain : a journal of neurology.

[10]  J. W. Rudy,et al.  The hippocampal indexing theory and episodic memory: Updating the index , 2007, Hippocampus.

[11]  Ryszard S. Michalski,et al.  Categories and Concepts: Theoretical Views and Inductive Data Analysis , 1993 .

[12]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[13]  Mauro Ursino,et al.  The generation of rhythms within a cortical region: Analysis of a neural mass model , 2010, NeuroImage.

[14]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991, Journal of experimental psychology. General.

[15]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[16]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[17]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[18]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[19]  Ken McRae,et al.  Semantic Memory: Some Insights from Feature-Based Connectionist Attractor Networks , 2004 .

[20]  J. Rodd,et al.  Distinctiveness and correlation in conceptual structure: behavioral and computational studies. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Richard D. Hichwa,et al.  A neural basis for lexical retrieval , 1996, Nature.

[22]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[23]  Mauro Ursino,et al.  A neural network model of semantic memory linking feature-based object representation and words , 2009, Biosyst..

[24]  A. Caramazza,et al.  Domain-Specific Knowledge Systems in the Brain: The Animate-Inanimate Distinction , 1998, Journal of Cognitive Neuroscience.

[25]  Kara L. Agster,et al.  Functional neuroanatomy of the parahippocampal region: The lateral and medial entorhinal areas , 2007, Hippocampus.

[26]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[27]  O. Bertrand,et al.  Oscillatory gamma activity in humans: a possible role for object representation. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  W. K. Simmons,et al.  Pictures of appetizing foods activate gustatory cortices for taste and reward. , 2005, Cerebral cortex.

[29]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[30]  Peter J. Siekmeier,et al.  Enhanced semantic priming in schizophrenia: a computer model based on excessive pruning of local connections in association cortex. , 2002, The British journal of psychiatry : the journal of mental science.

[31]  T. Teyler,et al.  The hippocampal memory indexing theory. , 1986, Behavioral neuroscience.

[32]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[33]  G. Bower,et al.  THE PSYCHOLOGY OF LEARNING AND M·OTIVATION , 2001 .

[34]  George S. Cree,et al.  Distinctive features hold a privileged status in the computation of word meaning: Implications for theories of semantic memory. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[35]  Gail Tillman,et al.  Neural substrates of semantic memory , 2007, Journal of the International Neuropsychological Society.

[36]  Wolf Singer,et al.  Distributed processing and temporal codes in neuronal networks , 2009, Cognitive Neurodynamics.

[37]  John Hart,et al.  Interactions between thalamic and cortical rhythms during semantic memory recall in human , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[38]  John R. Anderson.  A Spreading Activation Theory of Memory , 1988 .

[39]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .

[40]  Matthew A Goldrick,et al.  A restricted interaction account (RIA) of spoken word production: The best of both worlds , 2002 .

[41]  M. Steriade.  Corticothalamic resonance, states of vigilance and mentation , 2000, Neuroscience.

[42]  Michael A. Kraut,et al.  Neural Substrates of Semantics , 2002 .

[43]  Kara L. Agster,et al.  Functional neuroanatomy of the parahippocampal region in the rat: The perirhinal and postrhinal cortices , 2007, Hippocampus.

[44]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[45]  Friedemann Pulvermüller,et al.  Reading cinnamon activates olfactory brain regions , 2006, NeuroImage.

[46]  John Kounios,et al.  Semantic richness and the activation of concepts in semantic memory: Evidence from event-related potentials , 2009, Brain Research.

[47]  P Sterzer,et al.  Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing. , 2004, Cerebral cortex.

[48]  T. Rogers,et al.  Neural basis of category-specific semantic deficits for living things: evidence from semantic dementia, HSVE and a neural network model. , 2006, Brain : a journal of neurology.

[49]  Shravan Vasishth,et al.  Towards dynamical system models of language-related brain potentials , 2008, Cognitive Neurodynamics.

[50]  M. Potter,et al.  Lexical and conceptual representation in beginning and proficient bilinguals , 1984 .

[51]  V. Calhoun,et al.  Neural hybrid model of semantic object memory: Implications from event-related timing using fMRI , 2003, Journal of the International Neuropsychological Society.

[52]  A D Redish,et al.  Prediction, sequences and the hippocampus , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[53]  G. Altmann,et al.  The Oxford Handbook of Psycholinguistics , 2007 .

[54]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[55]  Christian Frings,et al.  Reversing the N400: event-related potentials of a negative semantic priming effect , 2008, Neuroreport.

[56]  L. Barsalou.  Context-independent and context-dependent information in concepts , 1982, Memory & cognition.

[57]  Alex Martin,et al.  Semantic memory and the brain: structure and processes , 2001, Current Opinion in Neurobiology.

[58]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[59]  D. Plaut,et al.  Individual and developmental differences in semantic priming: empirical and computational support for a single-mechanism account of lexical processing. , 2000, Psychological review.

[60]  W. Singer,et al.  Short- and Long-Term Effects of Cholinergic Modulation on Gamma Oscillations and Response Synchronization in the Visual Cortex , 2004, The Journal of Neuroscience.

[61]  G. Buzsáki.  Rhythms of the brain , 2006 .

[62]  Edward E. Smith,et al.  Categories and concepts , 1984 .

[63]  G. Gainotti.  Anatomical functional and cognitive determinants of semantic memory disorders , 2006, Neuroscience & Biobehavioral Reviews.

[64]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[65]  A. Borghi,et al.  Embodied cognition and beyond: Acting and sensing the body , 2010, Neuropsychologia.

[66]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[67]  Mark S. Seidenberg,et al.  Double Dissociation of Semantic Categories in Alzheimer's Disease , 1997, Brain and Language.

[68]  G. Buzsáki,et al.  Sharp wave-associated high-frequency oscillation (200 Hz) in the intact hippocampus: network and intracellular mechanisms , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[69]  A. Damasio.  Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[70]  R. Miikkulainen.  Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon , 1997, Brain and Language.

[71]  W. Singer.  Synchronization of cortical activity and its putative role in information processing and learning. , 1993, Annual review of physiology.

[72]  Lawrence W. Barsalou,et al.  Components of conceptual representation. From feature lists to recursive frames , 1993 .

[73]  Guido Gainotti,et al.  What the Locus of Brain Lesion Tells us About the Nature of the Cognitive Defect Underlying Category-Specific Disorders: A Review , 2000, Cortex.

[74]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[75]  Michael A. Kraut,et al.  Neural mechanisms of semantic memory , 2004, Current neurology and neuroscience reports.

[76]  J. Kroll,et al.  Category Interference in Translation and Picture Naming: Evidence for Asymmetric Connections Between Bilingual Memory Representations , 1994 .

[77]  R. Pearce,et al.  Muscarinic blockade weakens interaction of gamma with theta rhythms in mouse hippocampus , 2007, The European journal of neuroscience.

[78]  Peter McLeod,et al.  Attractor dynamics in word recognition: converging evidence from errors by normal subjects, dyslexic patients and a connectionist model , 2000, Cognition.

[79]  T. Shallice,et al.  Category specific semantic impairments , 1984 .

[80]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[81]  J J Hopfield,et al.  What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[82]  Matthew H. Davis,et al.  The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. , 2005, Cerebral cortex.

[83]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[84]  D. Deacon,et al.  Event-related potential indices of semantic priming using masked and unmasked words: evidence that the N400 does not reflect a post-lexical process. , 2000, Brain research. Cognitive brain research.

[85]  E. Tulving,et al.  Organization of memory. , 1973 .

[86]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[87]  M. Coltheart,et al.  Cumulative semantic inhibition in picture naming: experimental and computational studies , 2006, Cognition.

[88]  R. Gibbs,et al.  Embodied experience and linguistic meaning , 2003, Brain and Language.

[89]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[90]  G. Marcus,et al.  The topographic brain: from neural connectivity to cognition , 2007, Trends in Neurosciences.

[91]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[92]  Richard J. Brown.  Neuropsychology Mental Structure , 1989 .

[93]  Matthew A. Wilson,et al.  Characterizing the Dynamic Frequency Structure of Fast Oscillations in the Rodent Hippocampus , 2009, Front. Integr. Neurosci..