Toward a theory of semantic representation

Abstract We present an account of semantic representation that focuses on distinct types of information from which word meanings can be learned. In particular, we argue that there are at least two major types of information from which we learn word meanings. The first is what we call experiential information. This is data derived both from our sensory-motor interactions with the outside world, as well as from our experience of own inner states, particularly our emotions. The second type of information is language-based. In particular, it is derived from the general linguistic context in which words appear. The paper spells out this proposal, summarizes research supporting this view and presents new predictions emerging from this framework.

[1]  E. Warrington,et al.  Abstract and concrete concepts have structurally different representational frameworks. , 2005, Brain : a journal of neurology.

[2]  B. Bahrami,et al.  Motion Detection and Motion Verbs , 2007, Psychological science.

[3]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[4]  Bahador Bahrami,et al.  Visual motion interferes with lexical decision on motion words , 2008, Current Biology.

[5]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991 .

[6]  M. Beeghly,et al.  Talking About Internal States: The Acquisition of an Explicit Theory of Mind , 1982 .

[7]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[8]  Zachary Estes,et al.  Automatic vigilance for negative words is categorical and general , 2008 .

[9]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[10]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .

[11]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[12]  W. Levelt,et al.  Semantic distance effects on object and action naming , 2002, Cognition.

[13]  Marc Jeannerod,et al.  Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing , 2006, Journal of Cognitive Neuroscience.

[14]  S. Kuczaj,et al.  Acquisition of Emotion-Descriptive Language: Receptive and Productive Vocabulary Norms for Ages 18 Months to 6 Years. , 1985 .

[15]  J. Fodor The Language of Thought , 1980 .

[16]  S. Cappa,et al.  The breakdown of semantic knowledge: Insights from a statistical model of meaning representation , 2003, Brain and Language.

[17]  Yoshikazu Ugawa,et al.  Task-Guided Selection of the Dual Neural Pathways for Reading , 2006, Neuron.

[18]  M. Garrett,et al.  Representing the meanings of object and action words: The featural and unitary semantic space hypothesis , 2004, Cognitive Psychology.

[19]  Lois Bloom,et al.  Language acquisition in its developmental context , 1998 .

[20]  P. Calvo,et al.  Handbook of cognitive science : an embodied approach , 2008 .

[21]  Janellen Huttenlocher,et al.  The semantic organization of some simple nouns and verbs , 1979 .

[22]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[23]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  S. Scott,et al.  The role of semantics and grammatical class in the neural representation of words. , 2006, Cerebral cortex.

[25]  Gilles Fauconnier,et al.  Metaphor, metonymy, and binding , 2002 .

[26]  R. Gibbs The Poetics of Mind: Figurative Thought, Language, and Understanding , 1994 .

[27]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[28]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[29]  H. Schütze,et al.  Dimensions of meaning , 1992, Supercomputing '92.

[30]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[31]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[32]  J. R. Firth,et al.  Studies in Linguistic Analysis. , 1974 .

[33]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[34]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[35]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[36]  S. Vereza Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[37]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[38]  Arthur C. Graesser,et al.  Differences in interconcept organization between nouns and verbs , 1987 .

[39]  Rosaleen A. McCarthy,et al.  Multiple meaning systems in the brain: A case for visual semantics , 1994, Neuropsychologia.

[40]  D. Algom,et al.  A rational look at the emotional stroop phenomenon: a generic slowdown, not a stroop effect. , 2004, Journal of experimental psychology. General.

[41]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[42]  R. Sekuler,et al.  Adaptation alters perceived direction of motion , 1976, Vision Research.

[43]  Yuka Sasaki,et al.  Greater Disruption Due to Failure of Inhibitory Control on an Ambiguous Distractor , 2022 .

[44]  T. Talavage,et al.  Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI , 2008, Brain and Language.

[45]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[46]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[47]  Stevan Harnad The Symbol Grounding Problem , 1999, ArXiv.

[48]  David A Balota,et al.  Lexical characteristics of words used in emotional Stroop experiments. , 2006, Emotion.

[49]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[50]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[51]  Jeanette Altarriba,et al.  The distinctiveness of emotion concepts: a comparison between emotion, abstract, and concrete words. , 2004, The American journal of psychology.

[52]  Xiaoping P. Hu,et al.  fMRI evidence for word association and situated simulation in conceptual processing , 2008, Journal of Physiology-Paris.

[53]  Ken McRae,et al.  Category - Specific semantic deficits , 2008 .

[54]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[55]  Rolf A. Zwaan The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[56]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[57]  O. Braddick,et al.  What is Noise for the Motion System? , 1996, Vision Research.

[58]  Gabriella Vigliocco,et al.  Integrating experiential and distributional data to learn semantic representations. , 2009, Psychological review.

[59]  S. Dehaene,et al.  A direct intracranial record of emotions evoked by subliminal words. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Luigi Cattaneo,et al.  Use-induced motor plasticity affects the processing of abstract and concrete language , 2008, Current Biology.

[61]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[62]  Lera Boroditsky,et al.  The Roles of Body and Mind in Abstract Thought , 2002, Psychological science.

[63]  Seana Coulson,et al.  Semantic Leaps: FRAME-SHIFTING , 2001 .

[64]  Michael P. Kaschak,et al.  Perception of Auditory Motion Affects Language Processing , 2006, Cogn. Sci..

[65]  Z. Harris,et al.  Foundations of language , 1941 .

[66]  R. Adolphs,et al.  Impaired Recognition of Social Emotions following Amygdala Damage , 2002, Journal of Cognitive Neuroscience.

[67]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[68]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[69]  R. Gibbs Embodiment and Cognitive Science: Concepts , 2005 .

[70]  Michael J Cortese,et al.  Handbook of Psycholinguistics , 2011 .

[71]  Sonja A. Kotz,et al.  Concreteness in emotional words: ERP evidence from a hemifield study , 2007, Brain Research.

[72]  Green Bf Figure coherence in the kinetic depth effect. , 1961 .

[73]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[74]  H. Wellman,et al.  Early understanding of emotion: Evidence from natural language , 1995 .

[75]  B. Green Figure coherence in the kinetic depth effect. , 1961, Journal of experimental psychology.

[76]  B. Abbott,et al.  The Psychology of Word Meanings. , 1992 .

[77]  G. Vigliocco,et al.  Emotion words, regardless of polarity, have a processing advantage over neutral words , 2009, Cognition.

[78]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[79]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[80]  R. J. Gonsalves For definitions: A reply to Fodor, Garrett, Walker, and Parkes , 1988, Cognition.

[81]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[82]  S. Dehaene,et al.  Nonconscious semantic processing of emotional words modulates conscious access. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[83]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[84]  H. Stadthagen-González,et al.  The Bristol norms for age of acquisition, imageability, and familiarity , 2006, Behavior research methods.

[85]  M. Bradley,et al.  Emotion, attention, and the startle reflex. , 1990, Psychological review.

[86]  Alfonso Caramazza,et al.  All Talk and No Action: A Transcranial Magnetic Stimulation Study of Motor Cortex Activation during Action Word Production , 2004, Journal of Cognitive Neuroscience.

[87]  J. Decety,et al.  The power of simulation: Imagining one's own and other's behavior , 2006, Brain Research.

[88]  박남숙,et al.  Emotion, Cognition and Behavior Responses of the Drivers in Dangerous Driving Scenario , 2009 .

[89]  A. Glenberg,et al.  Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning , 2000 .

[90]  Zohar Eviatar,et al.  The effects of word length and emotionality on hemispheric contribution to lexical decision , 1991, Neuropsychologia.

[91]  Lawrence W. Barsalou,et al.  Language and simulation in conceptual processing , 2008 .

[92]  Michael P. Kaschak,et al.  The Body's Contribution to Language , 2003 .

[93]  J. Jenkins,et al.  Word association norms , 1964 .

[94]  Gabriella Vigliocco,et al.  The Role of Sensory and Motor Information in Semantic Representation: A Review , 2008 .

[95]  Curt Burgess,et al.  Modelling Parsing Constraints with High-dimensional Context Space , 1997 .

[96]  Jeffrey R. Binder,et al.  Modulation of the semantic system by word imageability , 2005, NeuroImage.

[97]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.