NaturalLI: Natural Logic Inference for Common Sense Reasoning

Common-sense reasoning is important for AI applications, both in NLP and many vision and robotics tasks. We propose NaturalLI: a Natural Logic inference system for inferring common sense facts ‐ for instance, that cats have tails or tomatoes are round ‐ from a very large database of known facts. In addition to being able to provide strictly valid derivations, the system is also able to produce derivations which are only likely valid, accompanied by an associated confidence. We both show that our system is able to capture strict Natural Logic inferences on the FraCaS test suite, and demonstrate its ability to predict common sense facts with 49% recall and 91% precision.

[1]  Oren Etzioni,et al.  TextRunner: Open Information Extraction on the Web , 2007, NAACL.

[2]  Nicolas Le Roux,et al.  A latent factor model for highly multi-relational data , 2012, NIPS.

[3]  Thomas F. Icard III,et al.  Recent Progress on Monotonicity , 2014, LILT.

[4]  Stephen Pulman,et al.  Using the Framework , 1996 .

[5]  David W. Conrath,et al.  Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy , 1997, ROCLING/IJCLCLP.

[6]  Lenhart K. Schubert Can we derive general world knowledge from texts , 2002 .

[7]  Danqi Chen,et al.  Learning New Facts From Knowledge Bases With Neural Tensor Networks and Semantic Word Vectors , 2013, ICLR.

[8]  Andrew McCallum,et al.  Relation Extraction with Matrix Factorization and Universal Schemas , 2013, NAACL.

[9]  Eunsol Choi,et al.  Scaling Semantic Parsers with On-the-Fly Ontology Matching , 2013, EMNLP.

[10]  Tom M. Mitchell,et al.  Improving Learning and Inference in a Large Knowledge-Base using Latent Syntactic Cues , 2013, EMNLP.

[11]  Andrew Y. Ng,et al.  Improving Word Representations via Global Context and Multiple Word Prototypes , 2012, ACL.

[12]  Ellen M Voorhees Question answering in TREC , 2001, CIKM '01.

[13]  Raymond Reiter,et al.  A Logic for Default Reasoning , 1987, Artif. Intell..

[14]  Thomas F. Icard Inclusion and Exclusion in Natural Language , 2012, Stud Logica.

[15]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[16]  Lenhart K. Schubert,et al.  Deriving Generalized Knowledge from Corpora Using WordNet Abstraction , 2009, EACL.

[17]  Oren Etzioni,et al.  Learning First-Order Horn Clauses from Web Text , 2010, EMNLP.

[18]  John McCarthy,et al.  Circumscription - A Form of Non-Monotonic Reasoning , 1980, Artif. Intell..

[19]  J. Benthem A brief history of natural logic , 2008 .

[20]  Jason Weston,et al.  Learning Structured Embeddings of Knowledge Bases , 2011, AAAI.

[21]  Ido Dagan,et al.  Global Learning of Typed Entailment Rules , 2011, ACL.

[22]  Philipp Koehn,et al.  Abstract Meaning Representation for Sembanking , 2013, LAW@ACL.

[23]  Gerhard Weikum,et al.  Deriving a Web-Scale Common Sense Fact Database , 2011, AAAI.

[24]  John McCarthy,et al.  Circumscription—a form of non-monotonic reasoning , 1987 .

[25]  Victor Manual Sánchez Valencia,et al.  Studies on natural logic and categorial grammar , 1991 .

[26]  Ramesh Nallapati,et al.  Multi-instance Multi-label Learning for Relation Extraction , 2012, EMNLP.

[27]  Oren Etzioni,et al.  Open Language Learning for Information Extraction , 2012, EMNLP.

[28]  J. V. Benthem Johan van Benthem , 2008 .

[29]  Judea Pearl,et al.  Probabilistic Semantics for Nonmonotonic Reasoning: A Survey , 1989, KR.

[30]  Andrew McCallum,et al.  Probabilistic Databases of Universal Schema , 2012, AKBC-WEKEX@NAACL-HLT.

[31]  Raymond J. Mooney,et al.  Learning to Parse Database Queries Using Inductive Logic Programming , 1996, AAAI/IAAI, Vol. 2.

[32]  Alex J. Djalali Synthetic Logic , 2014, LILT.

[33]  Mark Steedman,et al.  Combined Distributional and Logical Semantics , 2013, TACL.

[34]  Oren Etzioni,et al.  Open question answering over curated and extracted knowledge bases , 2014, KDD.

[35]  Victor Sanchez,et al.  Studies on Natural Logic and Categorial Grammar , 1991 .

[36]  Oren Etzioni,et al.  Adapting Open Information Extraction to Domain-Specific Relations , 2010, AI Mag..

[37]  Daniel Jurafsky,et al.  Semantic Taxonomy Induction from Heterogenous Evidence , 2006, ACL.

[38]  Christopher D. Manning,et al.  An extended model of natural logic , 2009, IWCS.

[39]  Treebank Penn,et al.  Linguistic Data Consortium , 1999 .

[40]  Christopher D. Manning,et al.  Natural Logic for Textual Inference , 2007, ACL-PASCAL@ACL.

[41]  Oren Etzioni,et al.  Identifying Relations for Open Information Extraction , 2011, EMNLP.

[42]  Estevam R. Hruschka,et al.  Toward an Architecture for Never-Ending Language Learning , 2010, AAAI.

[43]  Christopher D. Manning,et al.  Modeling Semantic Containment and Exclusion in Natural Language Inference , 2008, COLING.

[44]  Luke S. Zettlemoyer,et al.  Online Learning of Relaxed CCG Grammars for Parsing to Logical Form , 2007, EMNLP.

[45]  Yorick Wilks,et al.  Natural language inference. , 1973 .

[46]  Jonathan Berant,et al.  Semantic Parsing via Paraphrasing , 2014, ACL.

[47]  Christopher D. Manning,et al.  Philosophers are Mortal: Inferring the Truth of Unseen Facts , 2013, CoNLL.

[48]  Christopher D. Manning,et al.  Natural language inference , 2009 .

[49]  Dirk Herrmann,et al.  Essays In Logical Semantics , 2016 .

[50]  Luke S. Zettlemoyer,et al.  Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations , 2011, ACL.

[51]  J. Benthem Essays in Logical Semantics , 1986 .