A neural network for learning the meaning of objects and words from a featural representation

The present work investigates how complex semantics can be extracted from the statistics of input features, using an attractor neural network. The study is focused on how feature dominance and feature distinctiveness can be naturally coded using Hebbian training, and how similarity among objects can be managed. The model includes a lexical network (which represents word-forms) and a semantic network composed of several areas: each area is topologically organized (similarity) and codes for a different feature. Synapses in the model are created using Hebb rules with different values for pre-synaptic and post-synaptic thresholds, producing patterns of asymmetrical synapses. This work uses a simple taxonomy of schematic objects (i.e., a vector of features), with shared features (to realize categories) and distinctive features (to have individual members) with different frequency of occurrence. The trained network can solve simple object recognition tasks and object naming tasks by maintaining a distinction between categories and their members, and providing a different role for dominant features vs. marginal features. Marginal features are not evoked in memory when thinking of objects, but they facilitate the reconstruction of objects when provided as input. Finally, the topological organization of features allows the recognition of objects with some modified features.

[1]  A. H. Kawamoto Nonlinear dynamics in the resolution of lexical ambiguity: A parallel distributed processing account. , 1993 .

[2]  E. Oja,et al.  A theory for the acquisition and loss of neuron specificity in visual cortex , 1979, Biological Cybernetics.

[3]  Lance J. Rips,et al.  Semantic distance and the verification of semantic relations , 1973 .

[4]  D. Plaut Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.

[5]  C. Thompson,et al.  Effect of typicality on online category verification of animate category exemplars in aphasia , 2003, Brain and Language.

[6]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[7]  George S. Cree,et al.  Distinctive features hold a privileged status in the computation of word meaning: Implications for theories of semantic memory. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[8]  David E. Rumelhart,et al.  Brain style computation: learning and generalization , 1990 .

[9]  M. Kiefer,et al.  Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions , 2012, Cortex.

[10]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[11]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[12]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[13]  G. Gainotti Anatomical functional and cognitive determinants of semantic memory disorders , 2006, Neuroscience & Biobehavioral Reviews.

[14]  Mauro Ursino,et al.  An integrated neural model of semantic memory, lexical retrieval and category formation, based on a distributed feature representation , 2011, Cognitive Neurodynamics.

[15]  A. Damasio Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[16]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[17]  A. Treves Mean-field analysis of neuronal spike dynamics , 1993 .

[18]  Peter J. Siekmeier,et al.  Enhanced semantic priming in schizophrenia: a computer model based on excessive pruning of local connections in association cortex. , 2002, The British journal of psychiatry : the journal of mental science.

[19]  G. Lupyan Linguistically Modulated Perception and Cognition: The Label-Feedback Hypothesis , 2012, Front. Psychology.

[20]  Christopher M. O'Connor,et al.  Conceptual Hierarchies in a Flat Attractor Network: Dynamics of Learning and Computations , 2009, Cogn. Sci..

[21]  Mauro Ursino,et al.  Recognition of Abstract Objects Via Neural Oscillators: Interaction Among Topological Organization, Associative Memory and Gamma Band Synchronization , 2009, IEEE Transactions on Neural Networks.

[22]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[23]  Mauro Ursino,et al.  A Computational Model of the Lexical-Semantic System Based on a Grounded Cognition Approach , 2010, Front. Psychology.

[24]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  Geoffrey E. Hinton,et al.  Implementing Semantic Networks in Parallel Hardware , 2014 .

[26]  James L. McClelland,et al.  Précis of Semantic Cognition: A Parallel Distributed Processing Approach , 2008, Behavioral and Brain Sciences.

[27]  Gail Tillman,et al.  Neural substrates of semantic memory , 2007, Journal of the International Neuropsychological Society.

[28]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[29]  Stefano F Cappa,et al.  Imaging studies of semantic memory , 2008, Current opinion in neurology.

[30]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[31]  Risto Miikkulainen,et al.  Semantic Boost on Episodic Associations: An Empirically-Based Computational Model , 2007, Cogn. Sci..

[32]  Serge Larochelle,et al.  Determinants of Response Times in the Semantic Verification Task , 1994 .

[33]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[34]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[35]  Ken McRae,et al.  Semantic Memory: Some Insights from Feature-Based Connectionist Attractor Networks , 2004 .

[36]  R. Miikkulainen Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon , 1997, Brain and Language.

[37]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[38]  M. McCloskey,et al.  Natural categories: Well defined or fuzzy sets? , 1978 .

[39]  Lance J. Rips,et al.  Structure and process in semantic memory: A featural model for semantic decisions. , 1974 .

[40]  G. Sartori,et al.  Semantic Relevance and Semantic Disorders , 2004, Journal of Cognitive Neuroscience.

[41]  Richard D. Hichwa,et al.  A neural basis for lexical retrieval , 1996, Nature.

[42]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[43]  E. Ambrosini,et al.  Semantic significance: a new measure of feature salience , 2014, Memory & cognition.

[44]  W. K. Simmons,et al.  The anterior temporal lobes and the functional architecture of semantic memory , 2009, Journal of the International Neuropsychological Society.

[45]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[46]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[47]  Mauro Ursino,et al.  A neural network model of semantic memory linking feature-based object representation and words , 2009, Biosyst..

[48]  Mark S. Seidenberg,et al.  Semantic feature production norms for a large set of living and nonliving things , 2005, Behavior research methods.

[49]  B. Rossion,et al.  Fixation Patterns During Recognition of Personally Familiar and Unfamiliar Faces , 2010, Front. Psychology.

[50]  Elizabeth Jefferies,et al.  Semantic Processing in the Anterior Temporal Lobes: A Meta-analysis of the Functional Neuroimaging Literature , 2010, Journal of Cognitive Neuroscience.

[51]  R. Gibbs,et al.  Embodied experience and linguistic meaning , 2003, Brain and Language.

[52]  Chris McNorgan,et al.  Integrating conceptual knowledge within and across representational modalities , 2011, Cognition.

[53]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[54]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .