A feature-based neurocomputational model of semantic memory

According with a featural organization of semantic memory, this work is aimed at investigating, through an attractor network, the role of different kinds of features in the representation of concepts, both in normal and neurodegenerative conditions. We implemented new synaptic learning rules in order to take into account the role of partially shared features and of distinctive features with different saliency. The model includes semantic and lexical layers, coding, respectively for object features and word-forms. Connections among nodes are strongly asymmetrical. To account for the feature saliency, asymmetrical synapses were created using Hebbian rules of potentiation and depotentiation, setting different pre-synaptic and post-synaptic thresholds. A variable post-synaptic threshold, which automatically changed to reflect the feature frequency in different concepts (i.e., how many concepts share a feature), was used to account for partially shared features. The trained network solved naming tasks and word recognition tasks very well, exploiting the different role of salient versus marginal features in concept identification. In the case of damage, superordinate concepts were preserved better than the subordinate ones. Interestingly, the degradation of salient features, but not of marginal ones, prevented object identification. The model suggests that Hebbian rules, with adjustable post-synaptic thresholds, can provide a reliable semantic representation of objects exploiting the statistics of input features.

[1]  George S. Cree,et al.  Distinctive features hold a privileged status in the computation of word meaning: Implications for theories of semantic memory. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Eleonora Catricalà,et al.  A new comprehensive set of concept feature norms , 2015 .

[3]  E. Warrington Quarterly Journal of Experimental Psychology the Selective Impairment of Semantic Memory the Selective Impairment of Semantic Memory , 2022 .

[4]  Daniel Bub,et al.  Semantic memory loss in Alzheimer-type dementia. , 1990 .

[5]  Christopher M. O'Connor,et al.  Conceptual Hierarchies in a Flat Attractor Network: Dynamics of Learning and Computations , 2009, Cogn. Sci..

[6]  Mauro Ursino,et al.  A Computational Model of the Lexical-Semantic System Based on a Grounded Cognition Approach , 2010, Front. Psychology.

[7]  D. Mirman,et al.  The effect of frequency of shared features on judgments of semantic similarity , 2009, Psychonomic bulletin & review.

[8]  M. Masson A distributed memory model of semantic priming. , 1995 .

[9]  G. Miller,et al.  Language and Perception , 1976 .

[10]  Sharlene D. Newman,et al.  Neural bases of syntax–semantics interface processing , 2015, Cognitive Neurodynamics.

[11]  S. Thompson-Schill,et al.  Putting concepts into context , 2016, Psychonomic bulletin & review.

[12]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[13]  Mark S. Seidenberg,et al.  Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics. , 2016, Cerebral cortex.

[14]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[15]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Opper,et al.  Learning of correlated patterns in spin-glass networks by local learning rules. , 1987, Physical review letters.

[17]  Carlo Caltagirone,et al.  (Category-specific) semantic deficit in Alzheimer's patients: The role of semantic distance , 2006, Neuropsychologia.

[18]  Mark H. Ashcraft,et al.  Property norms for typical and atypical items from 17 categories: A description and discussion , 1978 .

[19]  Alessandro Treves,et al.  Uninformative memories will prevail: The storage of correlated representations and its consequences , 2007, HFSP journal.

[20]  Xiaoqing Li,et al.  Attention is shaped by semantic level of event-structure during speech comprehension: an electroencephalogram study , 2017, Cognitive Neurodynamics.

[21]  M. Beeman,et al.  A Property Level Analysis of Lexical Semantic Representation in Alzheimer′s Disease , 1995, Brain and Language.

[22]  S. Cappa,et al.  Abstract and concrete categories? Evidences from neurodegenerative diseases , 2014, Neuropsychologia.

[23]  B. Desgranges,et al.  When the zebra loses its stripes: Semantic priming in early Alzheimer's disease and semantic dementia , 2011, Cortex.

[24]  C. Caltagirone,et al.  Alzheimer's disease and semantic deficits: a feature-listing study. , 2012, Neuropsychology.

[25]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[26]  J. F. Marques Naming from definition: The role of feature type and feature distinctiveness , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[27]  Pasquale A. Della Rosa,et al.  Functional correlates of preserved naming performance in amnestic Mild Cognitive Impairment , 2015, Neuropsychologia.

[28]  W. Krauth,et al.  Learning algorithms with optimal stability in neural networks , 1987 .

[29]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[30]  S. Cappa,et al.  Conceptual knowledge in the brain: fMRI evidence for a featural organization , 2008, Brain Research.

[31]  L. K. Tyler,et al.  Conceptual Structure and the Structure of Concepts: A Distributed Account of Category-Specific Deficits , 2000, Brain and Language.

[32]  Stefano F Cappa,et al.  Imaging studies of semantic memory , 2008, Current opinion in neurology.

[33]  Giuseppe Sartori,et al.  Semantic relevance, domain specificity and the sensory/functional theory of category-specificity , 2007, Neuropsychologia.

[34]  Mauro Ursino,et al.  A neural network for learning the meaning of objects and words from a featural representation , 2015, Neural Networks.

[35]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .

[36]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[37]  F. Pasquier,et al.  The dynamic time course of semantic memory impairment in Alzheimer's disease: clues from hyperpriming and hypopriming effects. , 2002, Brain : a journal of neurology.

[38]  S. Cappa,et al.  Naming from definition, semantic relevance and feature type: the effects of aging and Alzheimer's disease. , 2011, Neuropsychology.

[39]  Pierre Bonzon,et al.  Towards neuro-inspired symbolic models of cognition: linking neural dynamics to behaviors through asynchronous communications , 2017, Cognitive Neurodynamics.

[40]  J. Hodges,et al.  Semantic feature knowledge and picture naming in dementia of Alzheimer’s type: A new approach , 2005, Brain and Language.

[41]  S. Dopkins,et al.  Loss of distinctive features and a broader pattern of priming in Alzheimer's disease. , 2004, Neuropsychology.

[42]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[43]  D. Bub,et al.  Semantic memory loss in dementia of Alzheimer's type. What do various measures measure? , 1990, Brain : a journal of neurology.

[44]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[45]  Philip A. Cook,et al.  Heteromodal conceptual processing in the angular gyrus , 2013, NeuroImage.

[46]  S. Cappa,et al.  An Italian battery for the assessment of semantic memory disorders , 2013, Neurological Sciences.

[47]  T. Rogers,et al.  The neural and computational bases of semantic cognition , 2016, Nature Reviews Neuroscience.

[48]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[49]  Eduardo Mizraji,et al.  Modeling spatial–temporal operations with context-dependent associative memories , 2015, Cognitive Neurodynamics.

[50]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[51]  G. Sartori,et al.  Semantic Relevance and Semantic Disorders , 2004, Journal of Cognitive Neuroscience.

[52]  F. Pasquier,et al.  The nature of semantic memory deficits in Alzheimer's disease: new insights from hyperpriming effects. , 2001, Brain : a journal of neurology.

[53]  Joseph T. Devlin,et al.  The emergence of category specific deficits in a distributed semantic system , 2002 .

[54]  Mark S. Seidenberg,et al.  Category-Specific Semantic Deficits in Focal and Widespread Brain Damage: A Computational Account , 1998, Journal of Cognitive Neuroscience.

[55]  J. Marquié,et al.  Analyzing feature distinctiveness in the processing of living and non-living concepts in Alzheimer’s disease , 2009, Brain and Cognition.

[56]  Mauro Ursino,et al.  A neural network model of semantic memory linking feature-based object representation and words , 2009, Biosyst..

[57]  L. Abbott,et al.  Limits on the memory storage capacity of bounded synapses , 2007, Nature Neuroscience.

[58]  Mark S. Seidenberg,et al.  Semantic feature production norms for a large set of living and nonliving things , 2005, Behavior research methods.

[59]  Maria Caterina Silveri Interaction between vision and language in category-specific semantic impairment , 1998 .

[60]  Mauro Ursino,et al.  The formation of categories and the representation of feature saliency: analysis with a computational model trained with an Hebbian paradigm. , 2013, Journal of integrative neuroscience.

[61]  Mauro Ursino,et al.  An integrated neural model of semantic memory, lexical retrieval and category formation, based on a distributed feature representation , 2011, Cognitive Neurodynamics.

[62]  D. Perani,et al.  Semantic feature degradation and naming performance. Evidence from neurodegenerative disorders , 2015, Brain and Language.

[63]  G. Lupyan Linguistically Modulated Perception and Cognition: The Label-Feedback Hypothesis , 2012, Front. Psychology.

[64]  C. Caltagirone,et al.  Semantic priming for coordinate distant concepts in Alzheimer's disease patients , 2011, Neuropsychologia.

[65]  L. Tyler,et al.  A progressive category-specific semantic deficit for non-living things , 2000, Neuropsychologia.

[66]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[67]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.