Large-Scale Cost-Based Abduction in Full-Fledged First-Order Predicate Logic with Cutting Plane Inference

Abduction is inference to the best explanation. Abduction has long been studied intensively in a wide range of contexts, from artificial intelligence research to cognitive science. While recent advances in large-scale knowledge acquisition warrant applying abduction with large knowledge bases to real-life problems, as of yet no existing approach to abduction has achieved both the efficiency and formal expressiveness necessary to be a practical solution for large-scale reasoning on real-life problems. The contributions of our work are the following: (i) we reformulate abduction as an Integer Linear Programming (ILP) optimization problem, providing full support for first-order predicate logic (FOPL); (ii) we employ Cutting Plane Inference, which is an iterative optimization strategy developed in Operations Research for making abductive reasoning in full-fledged FOPL tractable, showing its efficiency on a real-life dataset; (iii) the abductive inference engine presented in this paper is made publicly available.

[1]  David Poole,et al.  Logic programming, abduction and probability , 1993, New Generation Computing.

[2]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[3]  Jerry R. Hobbs.  Ontological Promiscuity , 1985, ACL.

[4]  Raymond J. Mooney,et al.  Abductive Markov Logic for Plan Recognition , 2011, Proceedings of the AAAI Conference on Artificial Intelligence.

[5]  Raymond Mooney,et al.  Bayesian Abductive Logic Programs , 2010, StarAI@AAAI.

[6]  Nathanael Chambers,et al.  Unsupervised Learning of Narrative Schemas and their Participants , 2009, ACL.

[7]  Ido Dagan,et al.  A Confidence Model for Syntactically-Motivated Entailment Proofs , 2011, RANLP.

[8]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[9]  Sebastian Riedel.  Improving the Accuracy and Efficiency of MAP Inference for Markov Logic , 2008, UAI.

[10]  Dirk Hovy,et al.  Unsupervised Discovery of Domain-Specific Knowledge from Text , 2011, ACL.

[11]  Jerry R. Hobbs,et al.  Abductive Reasoning with a Large Knowledge Base for Discourse Processing , 2011, IWCS.

[12]  Dean Allemang,et al.  The Computational Complexity of Abduction , 1991, Artif. Intell..

[13]  Rohit J. Kate and Raymond J. Mooney.  Probabilistic Abduction using Markov Logic Networks , 2009 .

[14]  Johan Bos,et al.  Wide-Coverage Semantic Analysis with Boxer , 2008, STEP.

[15]  Oren Etzioni,et al.  Learning First-Order Horn Clauses from Web Text , 2010, EMNLP.

[16]  H. Prendinger,et al.  First-Order Diagnosis by Propositional Reasoning: A Representation-Based Approach , 1999 .

[17]  Ido Dagan,et al.  Global Learning of Typed Entailment Rules , 2011, ACL.

[18]  Eugene Santos,et al.  A Linear Constraint Satisfaction Approach to Cost-Based Abduction , 1994, Artif. Intell..

[19]  Jerry R. Hobbs,et al.  Learning from Reading Syntactically Complex Biology Texts , 2007, AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.

[20]  Ido Dagan,et al.  Recognizing textual entailment: Rational, evaluation and approaches – Erratum , 2010, Natural Language Engineering.

[21]  Ashraf M. Abdelbar,et al.  An efficient LP-based admissible heuristic for cost-based abduction , 2005, J. Exp. Theor. Artif. Intell..

[22]  Robert P. Goldman,et al.  A Probabilistic Model of Plan Recognition , 1991, AAAI.

[23]  Rajat Raina,et al.  Robust Textual Inference Via Learning and Abductive Reasoning , 2005, AAAI.

[24]  Murray Shanahan,et al.  Perception as Abduction: Turning Sensor Data Into Meaningful Representation , 2005, Cogn. Sci..

[25]  Jerry R. Hobbs,et al.  Implementing Weighted Abduction in Markov Logic , 2011, IWCS.

[26]  Gene A. Tagliarini,et al.  An Evolutionary Optimization Approach to Cost-Based Abduction, with Comparison to PSO , 2007, 2007 International Joint Conference on Neural Networks.

[27]  Thorsten Joachims,et al.  Cutting-plane training of structural SVMs , 2009, Machine Learning.

[28]  George B. Dantzig,et al.  Solution of a Large-Scale Traveling-Salesman Problem , 1954, Oper. Res..

[29]  R. Möller,et al.  Multimedia Interpretation as Abduction , 2007 .

[30]  Hwee Tou Ng,et al.  Abductive Plan Recognition and Diagnosis: A Comprehensive Empirical Evaluation , 1992, KR.

[31]  Josef Ruppenhofer,et al.  FrameNet II: Extended theory and practice , 2006 .

[32]  Mitsuru Ishizuka,et al.  Fast Hypothetical Reasoning by Parallel Processing , 2000, PRICAI.

[33]  Sebastian Riedel,et al.  Incremental Integer Linear Programming for Non-projective Dependency Parsing , 2006, EMNLP.

[34]  Kentaro Inui,et al.  ILP-Based Reasoning for Weighted Abduction , 2011, Plan, Activity, and Intent Recognition.