Static and Dynamic Vector Semantics for Lambda Calculus Models of Natural Language

Vector models of language are based on the contextual aspects of language, the distributions of words and how they co-occur in text. Truth conditional models focus on the logical aspects of language, compositional properties of words and how they compose to form sentences. In the truth conditional approach, the denotation of a sentence determines its truth conditions, which can be taken to be a truth value, a set of possible worlds, a context change potential, or similar. In the vector models, the degree of co-occurrence of words in context determines how similar the meanings of words are. In this paper, we put these two models together and develop a vector semantics for language based on the simply typed lambda calculus models of natural language. We provide two types of vector semantics: a static one that uses techniques familiar from the truth conditional tradition and a dynamic one based on a form of dynamic interpretation inspired by Heim’s context change potentials. We show how the dynamic model can be applied to entailment between a corpus and a sentence and provide examples.

[1]  Mehrnoosh Sadrzadeh,et al.  Context Update for Lambdas and Vectors , 2016, LACL.

[2]  Leon Henkin,et al.  Completeness in the theory of types , 1950, Journal of Symbolic Logic.

[3]  Mehrnoosh Sadrzadeh,et al.  Lambek vs. Lambek: Functorial vector space semantics and string diagrams for Lambek calculus , 2013, Ann. Pure Appl. Log..

[4]  Richard Montague,et al.  The Proper Treatment of Quantification in Ordinary English , 1973 .

[5]  Ido Dagan,et al.  Crowdsourcing Inference-Rule Evaluation , 2012, ACL.

[6]  Ewan Klein,et al.  Type-driven translation , 1985 .

[7]  Stephen Clark,et al.  A Type-Driven Tensor-Based Semantics for CCG , 2014, EACL 2014.

[8]  Mark Steedman,et al.  The syntactic process , 2004, Language, speech, and communication.

[9]  Mirella Lapata,et al.  Composition in Distributional Models of Semantics , 2010, Cogn. Sci..

[10]  Irene Heim,et al.  Semantics in generative grammar , 1998 .

[11]  Nanda Kambhatla,et al.  Combining Lexical, Syntactic, and Semantic Features with Maximum Entropy Models for Information Extraction , 2004, ACL.

[12]  Mary Dalrymple,et al.  LFG Semantics via Constraints , 1993, EACL.

[13]  Alfred Tarski,et al.  Introduction to Logic and to the Methodology of Deductive Sciences , 1943 .

[14]  Frank Veltman,et al.  Defaults in update semantics , 1996, J. Philos. Log..

[15]  Mehrnoosh Sadrzadeh,et al.  Concrete Models and Empirical Evaluations for the Categorical Compositional Distributional Model of Meaning , 2015, CL.

[16]  Andrew McCallum,et al.  Unsupervised Relation Discovery with Sense Disambiguation , 2012, ACL.

[17]  Reinhard Muskens,et al.  Language, Lambdas, and Logic , 2003 .

[18]  Reinhard Muskens,et al.  Categorial Grammar and Lexical-Functional Grammar ⁄ , 2001 .

[19]  Reinhard Muskens.  New Directions in Type-Theoretic Grammars , 2010, J. Log. Lang. Inf..

[20]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[21]  Stephen Clark,et al.  Mathematical Foundations for a Compositional Distributional Model of Meaning , 2010, ArXiv.

[22]  Barbara H. Partee,et al.  Noun Phrase Interpretation and Type‐shifting Principles , 2008 .

[23]  Tom M. Mitchell,et al.  Vector Space Semantic Parsing: A Framework for Compositional Vector Space Models , 2013, CVSM@ACL.

[24]  Stephen Pulman,et al.  Using the Framework , 1996 .

[25]  LAURI KARTTUNEN,et al.  PRESUPPOSITION AND LINGUISTIC CONTEXT , 1974 .

[26]  Paul Portner,et al.  Formal Semantics: The Essential Readings , 2002 .

[27]  John B. Goodenough,et al.  Contextual correlates of synonymy , 1965, CACM.

[28]  H. Savin,et al.  The projection problem for presuppositions , 1971 .

[29]  Philippe de Groote,et al.  Towards a Montagovian Account of Dynamics , 2006 .

[30]  Mark Steedman,et al.  Combined Distributional and Logical Semantics , 2013, TACL.

[31]  Marco Baroni,et al.  Nouns are Vectors, Adjectives are Matrices: Representing Adjective-Noun Constructions in Semantic Space , 2010, EMNLP.

[32]  Christopher Potts,et al.  A large annotated corpus for learning natural language inference , 2015, EMNLP.

[33]  Marco Baroni,et al.  Frege in Space: A Program for Composition Distributional Semantics , 2014, LILT.

[34]  Hoifung Poon.  Unsupervised Semantic Parsing (USP) User Guide , 2009 .

[35]  Philippe de Groote,et al.  Towards Abstract Categorial Grammars , 2001, ACL.

[36]  Andrew McCallum,et al.  Modeling Relations and Their Mentions without Labeled Text , 2010, ECML/PKDD.