Leveraging Preposition Ambiguity to Assess Representation of Semantic Interaction in CDSM

Consider the meanings of the following phrases: “red apple,” “red hair,” and “red state.” The meaning of the word “red” in each of these examples interacts with the meaning of the noun it modifies, applying a different color to the first two and a political affiliation to the third. This is an example of a common phenomenon in natural language in which the meaning of a whole expression is not derived from a simple sum of its parts, but is composed by interactions among their meanings. Semantic interactions have been acknowledged in the philosophical literature, notably by Frege [9], who asserted that a word in isolation is only an abstraction, and its precise meaning only assigned when it is placed in the context of a proposition. Further, semantic interaction is a detectable component of human language processing, as evidenced by the well documented phenomenon of sentential priming [8].

[1]  Stephen Clark,et al.  Mathematical Foundations for a Compositional Distributional Model of Meaning , 2010, ArXiv.

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  M. Marelli,et al.  SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual Entailment , 2014, *SEMEVAL.

[4]  Annette Herskovits,et al.  Semantics and Pragmatics of Locative Expressions , 1985, Cogn. Sci..

[5]  Walter Kintsch,et al.  Predication , 2001, Cogn. Sci..

[6]  Patrick Pantel,et al.  From Frequency to Meaning: Vector Space Models of Semantics , 2010, J. Artif. Intell. Res..

[7]  E. Guevara A Regression Model of Adjective-Noun Compositionality in Distributional Semantics , 2010 .

[8]  Mehrnoosh Sadrzadeh,et al.  Experimental Support for a Categorical Compositional Distributional Model of Meaning , 2011, EMNLP.

[9]  Mirella Lapata,et al.  Vector-based Models of Semantic Composition , 2008, ACL.

[10]  Mirella Lapata,et al.  A Comparison of Vector-based Representations for Semantic Composition , 2012, EMNLP.

[11]  Marco Baroni,et al.  A practical and linguistically-motivated approach to compositional distributional semantics , 2014, ACL.

[12]  J. Henderson,et al.  Semantic facilitation of lexical access during sentence processing. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Lukás Burget,et al.  Strategies for training large scale neural network language models , 2011, 2011 IEEE Workshop on Automatic Speech Recognition & Understanding.

[14]  Ioannis Korkontzelos,et al.  Estimating Linear Models for Compositional Distributional Semantics , 2010, COLING.

[15]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[16]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[17]  Georgiana Dinu,et al.  DISSECT - DIStributional SEmantics Composition Toolkit , 2013, ACL.

[18]  Yoshua Bengio,et al.  Neural Probabilistic Language Models , 2006 .

[19]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[20]  Juliane Junker Dont Count On It , 2016 .

[21]  Mirella Lapata,et al.  Composition in Distributional Models of Semantics , 2010, Cogn. Sci..