Mapping to Declarative Knowledge for Word Problem Solving

Math word problems form a natural abstraction to a range of quantitative reasoning problems, such as understanding financial news, sports results, and casualties of war. Solving such problems requires the understanding of several mathematical concepts such as dimensional analysis, subset relationships, etc. In this paper, we develop declarative rules which govern the translation of natural language description of these concepts to math expressions. We then present a framework for incorporating such declarative knowledge into word problem solving. Our method learns to map arithmetic word problem text to math expressions, by learning to select the relevant declarative knowledge for each operation of the solution expression. This provides a way to handle multiple concepts in the same problem while, at the same time, supporting interpretability of the answer expression. Our method models the mapping to declarative knowledge as a latent variable, thus removing the need for expensive annotations. Experimental evaluation suggests that our domain knowledge based solver outperforms all other systems, and that it generalizes better in the realistic case where the training data it is exposed to is biased in a different way than the test data.

[1]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[2]  Ming-Wei Chang,et al.  Guiding Semi-Supervision with Constraint-Driven Learning , 2007, ACL.

[3]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[4]  Dan Roth,et al.  Unit Dependency Graph and Its Application to Arithmetic Word Problem Solving , 2016, AAAI.

[5]  Kevin Gimpel,et al.  Weakly-Supervised Learning with Cost-Augmented Contrastive Estimation , 2014, EMNLP.

[6]  Ming-Wei Chang,et al.  Driving Semantic Parsing from the World’s Response , 2010, CoNLL.

[7]  Hirokazu Anai,et al.  Semantic Parsing of Pre-university Math Problems , 2017, ACL.

[8]  Ming-Wei Chang,et al.  Structured learning with constrained conditional models , 2012, Machine Learning.

[9]  Mark Johnson,et al.  Using Universal Linguistic Knowledge to Guide Grammar Induction , 2010, EMNLP.

[10]  Chitta Baral,et al.  Learning To Use Formulas To Solve Simple Arithmetic Problems , 2016, ACL.

[11]  Oren Etzioni,et al.  Parsing Algebraic Word Problems into Equations , 2015, TACL.

[12]  Shuming Shi,et al.  Automatically Solving Number Word Problems by Semantic Parsing and Reasoning , 2015, EMNLP.

[13]  Gerald DeJong Investigating Explanation-Based Learning , 1992 .

[14]  Noah A. Smith,et al.  Annealing Structural Bias in Multilingual Weighted Grammar Induction , 2006, ACL.

[15]  Oren Etzioni,et al.  Question Answering via Integer Programming over Semi-Structured Knowledge , 2016, IJCAI.

[16]  Shuming Shi,et al.  Learning Fine-Grained Expressions to Solve Math Word Problems , 2017, EMNLP.

[17]  Yonatan Bisk,et al.  Simple Robust Grammar Induction with Combinatory Categorial Grammars , 2012, AAAI.

[18]  Ben Taskar,et al.  Posterior Regularization for Structured Latent Variable Models , 2010, J. Mach. Learn. Res..

[19]  Luke S. Zettlemoyer,et al.  Learning to Automatically Solve Algebra Word Problems , 2014, ACL.

[20]  Dan Klein,et al.  Learning Dependency-Based Compositional Semantics , 2011, CL.

[21]  Ronan Le Bras,et al.  Beyond Sentential Semantic Parsing: Tackling the Math SAT with a Cascade of Tree Transducers , 2017, EMNLP.

[22]  Wang Ling,et al.  Program Induction by Rationale Generation: Learning to Solve and Explain Algebraic Word Problems , 2017, ACL.

[23]  Dan Roth,et al.  A Linear Programming Formulation for Global Inference in Natural Language Tasks , 2004, CoNLL.

[24]  Gerald DeJong,et al.  Explanation-Based Learning , 2014, Computing Handbook, 3rd ed..

[25]  Lipu Zhou,et al.  Learn to Solve Algebra Word Problems Using Quadratic Programming , 2015, EMNLP.

[26]  Dan Roth,et al.  Solving General Arithmetic Word Problems , 2016, EMNLP.

[27]  Percy Liang,et al.  Adversarial Examples for Evaluating Reading Comprehension Systems , 2017, EMNLP.

[28]  Oren Etzioni,et al.  Learning to Solve Arithmetic Word Problems with Verb Categorization , 2014, EMNLP.

[29]  Hannaneh Hajishirzi,et al.  MAWPS: A Math Word Problem Repository , 2016, NAACL.

[30]  Ming-Wei Chang,et al.  Learning from Explicit and Implicit Supervision Jointly For Algebra Word Problems , 2016, EMNLP.

[31]  Dan Roth,et al.  Equation Parsing : Mapping Sentences to Grounded Equations , 2016, EMNLP.