Explorer Solving Probability Problems in Natural Language

The ability to solve probability word problems such as those found in introductory discrete mathematics textbooks, is an important cognitive and intellectual skill. In this paper, we develop a two-step endto-end fully automated approach for solving such questions that is able to automatically provide answers to exercises about probability formulated in natural language. In the first step, a question formulated in natural language is analysed and transformed into a highlevel model specified in a declarative language. In the second step, a solution to the high-level model is computed using a probabilistic programming system. On a dataset of 2160 probability problems, our solver is able to correctly answer 97.5% of the questions given a correct model. On the end-toend evaluation, we are able to answer 12.5% of the questions (or 31.1% if we exclude examples not supported by design).

[1]  Jack P. Gelb.  Experiments with a Natural Language Problem-Solving System , 1971, IJCAI.

[2]  Ben Taskar,et al.  Introduction to statistical relational learning , 2007 .

[3]  J. Lang,et al.  ProbLog: A Probabilistic Prolog and Its Application in Link Discovery , 2007, IJCAI.

[4]  Sumit Gulwani,et al.  Synthesis of Geometry Proof Problems , 2014, AAAI.

[5]  Guy Van den Broeck,et al.  Tractability through Exchangeability: A New Perspective on Efficient Probabilistic Inference , 2014, AAAI.

[6]  Oren Etzioni,et al.  Diagram Understanding in Geometry Questions , 2014, AAAI.

[7]  Luke S. Zettlemoyer,et al.  Learning to Automatically Solve Algebra Word Problems , 2014, ACL.

[8]  Oren Etzioni,et al.  Learning to Solve Arithmetic Word Problems with Verb Categorization , 2014, EMNLP.

[9]  Luc De Raedt,et al.  Probabilistic (logic) programming concepts , 2015, Machine Learning.

[10]  Oren Etzioni,et al.  Solving Geometry Problems: Combining Text and Diagram Interpretation , 2015, EMNLP.

[11]  Luc De Raedt,et al.  Statistical Relational Artificial Intelligence: Logic, Probability, and Computation , 2016, Statistical Relational Artificial Intelligence.

[12]  José Hernández-Orallo,et al.  Computer models solving intelligence test problems: Progress and implications , 2016, Artif. Intell..

[13]  Habib Hamam,et al.  Artificial Intelligence Review , 2019, Advanced Methodologies and Technologies in Artificial Intelligence, Computer Simulation, and Human-Computer Interaction.