Is there a place for logic in recognizing textual entailment

From a purely theoretical point of view, it makes sense to approach recognizing textual entailment (RTE) with the help of logic. After all, entailment matters are all about logic. In practice, only few RTE systems follow the bumpy road from words to logic. This is probably because it requires a combination of robust, deep semantic analysis and logical inference — and why develop something with this com- plexity if you perhaps can get away with something simpler? In this article, with the help of an RTE system based on Combinatory Cat- egorial Grammar, Discourse Representation Theory, and first-order theorem proving, we make an empirical assessment of the logic-based approach. High precision paired with low recall is a key characteristic of this system. The bottleneck in achieving high recall is the lack of a systematic way to produce relevant background knowledge. There is a place for logic in RTE, but it is (still) overshadowed by the knowledge acquisition problem.

[1]  Christopher D. Manning,et al.  Natural language inference , 2009 .

[2]  Patrick Pantel,et al.  DIRT @SBT@discovery of inference rules from text , 2001, KDD '01.

[3]  Daniel Gallin,et al.  Intensional and Higher-Order Modal Logic , 1975 .

[4]  Yiannis N. Moschovakis,et al.  A Logical Calculus of Meaning and Synonymy , 2006 .

[5]  Ido Dagan,et al.  Instance-based Evaluation of Entailment Rule Acquisition , 2007, ACL.

[6]  Stuart M. Shieber,et al.  Prolog and Natural-Language Analysis , 1987 .

[7]  L. T. F. Gamut Logic, language, and meaning , 1991 .

[8]  I. I. N. Kamp Combining Montague Semantics and Discourse Representation , 1996 .

[9]  James R. Curran,et al.  Parsing the WSJ Using CCG and Log-Linear Models , 2004, ACL.

[10]  Chris Fox,et al.  A Higher-Order Fine-Grained Logic for Intensional Semantics , 2002 .

[11]  M.McGee Wood,et al.  Natural language processing in Prolog , 1990 .

[12]  Pieter A. M. Seuren Meaning and Grammar , 2009 .

[13]  Gennaro Chierchia,et al.  Meaning and Grammar: An Introduction to Semantics , 1990 .

[14]  Yuliya Lierler,et al.  Knowledge Representation and Question Answering , 2008, Handbook of Knowledge Representation.

[15]  John A. Carroll,et al.  Applied morphological processing of English , 2001, Natural Language Engineering.

[16]  K. Claessen,et al.  New Techniques that Improve MACE-style Finite Model Finding , 2007 .

[17]  Chris Fox,et al.  Foundations of intensional semantics , 2005 .

[18]  Chris Fox,et al.  Expressiveness and Complexity in Underspecified Semantics , 2010 .

[19]  Johan Bos,et al.  Linguistically Motivated Large-Scale NLP with C&C and Boxer , 2007, ACL.

[20]  Per Martin-Löf,et al.  Intuitionistic type theory , 1984, Studies in proof theory.

[21]  William McCune,et al.  Automated Deduction in Equational Logic and Cubic Curves , 1996, Lecture Notes in Computer Science.

[22]  Geoff Sutcliffe,et al.  The Results - of the CADE-13 ATP System Competition , 2004, Journal of Automated Reasoning.

[23]  Rudolf Carnap,et al.  Meaning and Necessity , 1947 .

[24]  G. Frege On Sense and Reference , 1948 .

[25]  Johan Bos,et al.  Computational Semantics in Discourse: Underspecification, Resolution, and Inference , 2004, J. Log. Lang. Inf..

[26]  Dekang Lin,et al.  DIRT – Discovery of Inference Rules from Text , 2001 .

[27]  Johan Bos,et al.  Wide-Coverage Semantic Analysis with Boxer , 2008, STEP.

[28]  Annisa Ihsani,et al.  Automatic Induction of Background Knowledge Axioms for Recognising Textual Entailment , 2012 .

[29]  Irene Heim,et al.  Semantics in generative grammar , 1998 .

[30]  Anders Søgaard,et al.  Patrick Blackburn and Johan Bos, Representation and Inference for Natural Language , 2007, Stud Logica.

[31]  Ido Dagan,et al.  The Third PASCAL Recognizing Textual Entailment Challenge , 2007, ACL-PASCAL@ACL.

[32]  Johan Bos,et al.  Recognising Textual Entailment with Logical Inference , 2005, HLT.

[33]  Ralph Grishman,et al.  Using NOMLEX to Produce Nominalization Patterns for Information Extraction , 1998, ACL 1998.

[34]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[35]  William McCune Automatic Proofs and Counterexamples for Some Ortholattice Identities , 1998, Inf. Process. Lett..

[36]  Reinhard Muskens,et al.  Sense and the Computation of Reference , 2005 .

[37]  Christopher D. Manning,et al.  Learning to recognize features of valid textual entailments , 2006, NAACL.

[38]  Mark Steedman,et al.  The syntactic process , 2004, Language, speech, and communication.

[39]  R. Cooper Type Theory and Semantics in Flux , 2012 .

[40]  Andrei Voronkov,et al.  The design and implementation of VAMPIRE , 2002, AI Commun..

[41]  Hans de Nivelle,et al.  A Resolution Decision Procedure for the Guarded Fragment , 1998, CADE.

[42]  Marie Duzí,et al.  Procedural Semantics for Hyperintensional Logic - Foundations and Applications of Transparent Intensional Logic , 2010, Logic, Epistemology, and the Unity of Science.

[43]  R. Montague Formal philosophy; selected papers of Richard Montague , 1974 .

[44]  Richmond H. Thomason,et al.  A model theory for propositional attitudes , 1980 .

[45]  Pavel Tichý,et al.  The Foundations of Frege's Logic , 1988 .