A Meaning-Based Statistical English Math Word Problem Solver

We introduce MeSys, a meaning-based approach, for solving English math word problems (MWPs) via understanding and reasoning in this paper. It first analyzes the text, transforms both body and question parts into their corresponding logic forms, and then performs inference on them. The associated context of each quantity is represented with proposed role-tags (e.g., nsubj, verb, etc.), which provides the flexibility for annotating an extracted math quantity with its associated context information (i.e., the physical meaning of this quantity). Statistical models are proposed to select the operator and operands. A noisy dataset is designed to assess if a solver solves MWPs mainly via understanding or mechanical pattern matching. Experimental results show that our approach outperforms existing systems on both benchmark datasets and the noisy dataset, which demonstrates that the proposed approach understands the meaning of each quantity in the text more.

[1]  Stephen J. Pape,et al.  Middle School Children's Problem-Solving Behavior: A Cognitive Analysis from a Reading Comprehension Perspective , 2004 .

[2]  Oren Etzioni,et al.  Learning to Solve Arithmetic Word Problems with Verb Categorization , 2014, EMNLP.

[3]  Anirban Mukherjee,et al.  A review of methods for automatic understanding of natural language mathematical problems , 2008, Artificial Intelligence Review.

[4]  Wei-Yun Ma,et al.  Designing a Tag-Based Statistical Math Word Problem Solver with Reasoning and Explanation , 2015, ROCLING.

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Dan Roth,et al.  Reasoning about Quantities in Natural Language , 2015, TACL.

[7]  Dipti Misra Sharma,et al.  Deep Neural Network based system for solving Arithmetic Word problems , 2017, IJCNLP.

[8]  Luke S. Zettlemoyer,et al.  Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions , 2013, TACL.

[9]  Luke S. Zettlemoyer,et al.  Learning to Automatically Solve Algebra Word Problems , 2014, ACL.

[10]  Oren Etzioni,et al.  My Computer Is an Honor Student - but How Intelligent Is It? Standardized Tests as a Measure of AI , 2016, AI Mag..

[11]  Wang Ling,et al.  Program Induction by Rationale Generation: Learning to Solve and Explain Algebraic Word Problems , 2017, ACL.

[12]  Dan Roth,et al.  Unit Dependency Graph and Its Application to Arithmetic Word Problem Solving , 2016, AAAI.

[13]  Shuming Shi,et al.  Deep Neural Solver for Math Word Problems , 2017, EMNLP.

[14]  Keh-Yih Su,et al.  Explanation Generation for a Math Word Problem Solver , 2015, ROCLING/IJCLCLP.

[15]  Ren Yun,et al.  Frame-Based Calculus of Solving Arithmetic Multi-Step Addition and Subtraction Word Problems , 2010, 2010 Second International Workshop on Education Technology and Computer Science.

[16]  Keh-Yih Su,et al.  A Meaning-based English Math Word Problem Solver with Understanding, Reasoning and Explanation , 2016, COLING.

[17]  Thies Pfeiffer,et al.  Modeling Math Word Problems with Augmented Semantic Networks , 2012, NLDB.

[18]  Dan Roth,et al.  Illinois Math Solver: Math Reasoning on the Web , 2016, NAACL.

[19]  Shuming Shi,et al.  Learning Fine-Grained Expressions to Solve Math Word Problems , 2017, EMNLP.

[20]  Shuming Shi,et al.  Automatically Solving Number Word Problems by Semantic Parsing and Reasoning , 2015, EMNLP.

[21]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[22]  Ming-Wei Chang,et al.  Learning from Explicit and Implicit Supervision Jointly For Algebra Word Problems , 2016, EMNLP.

[23]  Lipu Zhou,et al.  Learn to Solve Algebra Word Problems Using Quadratic Programming , 2015, EMNLP.

[24]  Dan Roth,et al.  Solving General Arithmetic Word Problems , 2016, EMNLP.

[25]  Yefim Bakman,et al.  Robust Understanding of Word Problems with Extraneous Information , 2007, math/0701393.

[26]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[27]  Chitta Baral,et al.  Learning To Use Formulas To Solve Simple Arithmetic Problems , 2016, ACL.

[28]  Oren Etzioni,et al.  Parsing Algebraic Word Problems into Equations , 2015, TACL.