On the Proper Treatment of Quantifiers in Probabilistic Logic Semantics

As a format for describing the meaning of natural language sentences, probabilistic logic combines the expressivity of first-order logic with the ability to handle graded information in a principled fashion. But practical probabilistic logic frameworks usually assume a finite domain in which each entity corresponds to a constant in the logic (domain closure assumption). They also assume a closed world where everything has a very low prior probability. These assumptions lead to some problems in the inferences that these systems make. In this paper, we show how to formulate Textual Entailment (RTE) inference problems in probabilistic logic in a way that takes the domain closure and closed-world assumptions into account. We evaluate our proposed technique on three RTE datasets, on a synthetic dataset with a focus on complex forms of quantification, on FraCas and on one more natural dataset. We show that our technique leads to improvements on the more natural dataset, and achieves 100% accuracy on the synthetic dataset and on the relevant part of FraCas.

[1]  Stephen Pulman,et al.  Using the Framework , 1996 .

[2]  Eunsol Choi,et al.  Scaling Semantic Parsers with On-the-Fly Ontology Matching , 2013, EMNLP.

[3]  Andrew McCallum,et al.  Introduction to Statistical Relational Learning , 2007 .

[4]  Mark Steedman,et al.  Combined Distributional and Logical Semantics , 2013, TACL.

[5]  Katrin Erk,et al.  Integrating Logical Representations with Probabilistic Information using Markov Logic , 2011, IWCS.

[6]  Raymond J. Mooney,et al.  Efficient Markov Logic Inference for Natural Language Semantics , 2014, StarAI@AAAI.

[7]  Johan Bos,et al.  Linguistically Motivated Large-Scale NLP with C&C and Boxer , 2007, ACL.

[8]  Patrick Pantel,et al.  DIRT @SBT@discovery of inference rules from text , 2001, KDD '01.

[9]  Andrew Chou,et al.  Semantic Parsing on Freebase from Question-Answer Pairs , 2013, EMNLP.

[10]  C. R.,et al.  On referring , 1950 .

[11]  M. Wreen EXISTENTIAL IMPORT , 2010 .

[12]  Nils J. Nilsson,et al.  Probabilistic Logic * , 2022 .

[13]  Chris Callison-Burch,et al.  PPDB: The Paraphrase Database , 2013, NAACL.

[14]  Christopher D. Manning,et al.  An extended model of natural logic , 2009, IWCS.

[15]  Johan Bos,et al.  Is there a place for logic in recognizing textual entailment , 2013, LILT.

[16]  Marco Marelli,et al.  A SICK cure for the evaluation of compositional distributional semantic models , 2014, LREC.

[17]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[18]  Michael R. Genesereth,et al.  Logical foundations of artificial intelligence , 1987 .

[19]  Ido Dagan,et al.  Recognizing Textual Entailment: Models and Applications , 2013, Recognizing Textual Entailment: Models and Applications.

[20]  Richard Montague,et al.  The Proper Treatment of Quantification in Ordinary English , 1973 .

[21]  Matthew Richardson,et al.  The Alchemy System for Statistical Relational AI: User Manual , 2007 .

[22]  Johan Bos,et al.  Wide-Coverage Semantic Analysis with Boxer , 2008, STEP.

[23]  Cuong Chau,et al.  Montague Meets Markov: Deep Semantics with Probabilistic Logical Form , 2013, *SEMEVAL.

[24]  Claire Cardie,et al.  Learning with Compositional Semantics as Structural Inference for Subsentential Sentiment Analysis , 2008, EMNLP.

[25]  Christopher D. Manning,et al.  Modeling Semantic Containment and Exclusion in Natural Language Inference , 2008, COLING.

[26]  Ido Dagan,et al.  TruthTeller: Annotating Predicate Truth , 2013, NAACL.

[27]  Eneko Agirre,et al.  SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity , 2012, *SEMEVAL.

[28]  Mark Steedman,et al.  A* CCG Parsing with a Supertag-factored Model , 2014, EMNLP.

[29]  Christopher D. Manning,et al.  Natural Logic for Textual Inference , 2007, ACL-PASCAL@ACL.

[30]  Dekang Lin,et al.  DIRT – Discovery of Inference Rules from Text , 2001 .

[31]  Dan Flickinger,et al.  An Open Source Grammar Development Environment and Broad-coverage English Grammar Using HPSG , 2000, LREC.