Quantitative Semantic Variation in the Contexts of Concrete and Abstract Words

Across disciplines, researchers are eager to gain insight into empirical features of abstract vs. concrete concepts. In this work, we provide a detailed characterisation of the distributional nature of abstract and concrete words across 16,620 English nouns, verbs and adjectives. Specifically, we investigate the following questions: (1) What is the distribution of concreteness in the contexts of concrete and abstract target words? (2) What are the differences between concrete and abstract words in terms of contextual semantic diversity? (3) How does the entropy of concrete and abstract word contexts differ? Overall, our studies show consistent differences in the distributional representation of concrete and abstract words, thus challenging existing theories of cognition and providing a more fine-grained description of their nature.

[1]  Sabine Schulte im Walde,et al.  Improving Verb Metaphor Detection by Propagating Abstractness to Words, Phrases and Individual Senses , 2017 .

[2]  Sabine Schulte im Walde,et al.  Distinguishing Literal and Non-Literal Usage of German Particle Verbs , 2016, NAACL.

[3]  P. Hoffman,et al.  Opposing Effects of Semantic Diversity in Lexical and Semantic Relatedness Decisions , 2015, Journal of experimental psychology. Human perception and performance.

[4]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[5]  S. Cappa,et al.  The neural representation of abstract words: the role of emotion. , 2014, Cerebral cortex.

[6]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[7]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[8]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[9]  Guy Dove.  Beyond perceptual symbols: A call for representational pluralism , 2009, Cognition.

[10]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[11]  E. Shoben,et al.  Differential Context Effects in the Comprehension of Abstract and Concrete Verbal Materials , 1983 .

[12]  Daniel C. Richardson,et al.  Spatial representations activated during real-time comprehension of verbs , 2003, Cogn. Sci..

[13]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[14]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[15]  Helmut Schmidt,et al.  Probabilistic part-of-speech tagging using decision trees , 1994 .

[16]  Yair Neuman,et al.  Literal and Metaphorical Sense Identification through Concrete and Abstract Context , 2011, EMNLP.

[17]  Amy Beth Warriner,et al.  Concreteness ratings for 40 thousand generally known English word lemmas , 2014, Behavior research methods.

[18]  Diego Frassinelli,et al.  Contextual Characteristics of Concrete and Abstract Words , 2017, IWCS.

[19]  Harold Bekkering,et al.  Context Effects in Embodied Lexical-Semantic Processing , 2010, Front. Psychology.

[20]  T. Rogers,et al.  Semantic diversity: A measure of semantic ambiguity based on variability in the contextual usage of words , 2012, Behavior Research Methods.

[21]  L. Burnard.  The British National Corpus , 1998 .

[22]  Roland Schäfer,et al.  Building Large Corpora from the Web Using a New Efficient Tool Chain , 2012, LREC.

[23]  H. Chertkow,et al.  Semantic memory , 2002, Current neurology and neuroscience reports.

[24]  Christian Bentz,et al.  A Quantitative Empirical Analysis of the Abstract/Concrete Distinction , 2014, Cogn. Sci..

[25]  Stefan Evert,et al.  The Statistics of Word Cooccur-rences: Word Pairs and Collocations , 2004 .

[26]  Sabine Schulte im Walde,et al.  Exploring Multi-Modal Text+Image Models to Distinguish between Abstract and Concrete Nouns , 2017 .

[27]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[28]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.