Concepts and properties in word spaces

Properties play a central role in most theories of conceptual knowledge. Since computational models derived from word co-occurrence statistics have been claimed to provide a natural basis for semantic representations, the question arises of whether such models are capable of producing reasonable property-based descriptions of concepts, and whether these descriptions are similar to those elicited from humans. This article presents a qualitative analysis of the properties generated by humans in two different settings, as well as those produced, for the same concepts, by two computational models. In order to find high-level generalizations, the analysis is conducted in terms of property types, i.e., categorizing properties into classes such as functional and taxonomic properties. We discover that differences and similarities among models cut across the human/computational distinction, suggesting on the one hand caution in making broad generalizations, e.g., about “grounded” and “amodal” approaches, and, on the other, that different models might reveal different facets of meaning, and thus they should rather be integrated than seen as rival ways to get at the same information.

[1]  J. Firth Papers in linguistics , 1958 .

[2]  Zellig S. Harris,et al.  Mathematical structures of language , 1968, Interscience tracts in pure and applied mathematics.

[3]  Judith N. Levi,et al.  The syntax and semantics of complex nominals , 1978 .

[4]  Marti A. Hearst Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[5]  Curt Burgess,et al.  Modelling Parsing Constraints with High-dimensional Context Space , 1997 .

[6]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[7]  J. Fodor,et al.  Concepts: Where Cognitive Science Went Wrong , 1998 .

[8]  Lawrence W. Barsalou,et al.  Representing Properties Locally , 2001, Cognitive Psychology.

[9]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[10]  G. Murphy,et al.  The Big Book of Concepts , 2002 .

[11]  S. Cappa,et al.  The breakdown of semantic knowledge: Insights from a statistical model of meaning representation , 2003, Brain and Language.

[12]  Kurt Hornik,et al.  Visualizing Independence Using Extended Association and Mosaic Plots , 2003 .

[13]  R. Rapp Word sense discovery based on sense descriptor dissimilarity , 2003, MTSUMMIT.

[14]  M. Garrett,et al.  Representing the meanings of object and action words: The featural and unitary semantic space hypothesis , 2004, Cognitive Psychology.

[15]  Reinhard Rapp A Freely Available Automatically Generated Thesaurus of Related Words , 2004, LREC.

[16]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[17]  Henri Cohen,et al.  Handbook of categorization in cognitive science , 2005 .

[18]  Mark S. Seidenberg,et al.  Semantic feature production norms for a large set of living and nonliving things , 2005, Behavior research methods.

[19]  Magnus Sahlgren,et al.  The Word-Space Model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces , 2006 .

[20]  Kurt Hornik,et al.  The Strucplot Framework: Visualizing Multi-way Contingency Tables with vcd , 2006 .

[21]  George S. Cree,et al.  Distinctive features hold a privileged status in the computation of word meaning: Implications for theories of semantic memory. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[22]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[23]  Mirella Lapata,et al.  Dependency-Based Construction of Semantic Space Models , 2007, CL.

[24]  K. Hornik,et al.  Residual-Based Shadings for Visualizing (Conditional) Independence , 2007 .

[25]  Massimo Poesio,et al.  Extracting concept descriptions from the Web: the importance of attributes and values , 2008, Ontology Learning and Population.