First Neural Conjecturing Datasets and Experiments

We describe several datasets and first experiments with creating conjectures by neural methods. The datasets are based on the Mizar Mathematical Library processed in several forms and the problems extracted from it by the MPTP system and proved by the E prover using the ENIGMA guidance. The conjecturing experiments use the Transformer architecture and in particular its GPT-2 implementation.

[1]  Yuxi Li,et al.  Deep Reinforcement Learning , 2018, Reinforcement Learning for Cyber-Physical Systems.

[2]  Stephan Schulz,et al.  System Description: E 1.8 , 2013, LPAR.

[3]  Koen Claessen,et al.  Hipster: Integrating Theory Exploration in a Proof Assistant , 2014, CICM.

[4]  Thibault Gauthier,et al.  Initial Experiments with Statistical Conjecturing over Large Formal Corpora , 2016, FM4M/MathUI/ThEdu/DP/WIP@CIKM.

[5]  Qingxiang Wang,et al.  First Experiments with Neural Translation of Informal to Formal Mathematics , 2018, CICM.

[6]  Josef Urban,et al.  Stateful Premise Selection by Recurrent Neural Networks , 2020, LPAR.

[7]  Siemion Fajtlowicz,et al.  On conjectures of Graffiti , 1988, Discret. Math..

[8]  Qingxiang Wang,et al.  Exploration of neural machine translation in autoformalization of mathematics in Mizar , 2019, CPP.

[9]  Cezary Kaliszyk,et al.  Automating Formalization by Statistical and Semantic Parsing of Mathematics , 2017, ITP.

[10]  Douglas B. Lenat,et al.  AM, an artificial intelligence approach to discovery in mathematics as heuristic search , 1976 .

[11]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[12]  Simon Colton,et al.  Automated Theory Formation in Pure Mathematics , 2002, Distinguished dissertations.

[13]  Cezary Kaliszyk,et al.  Learning to Parse on Aligned Corpora (Rough Diamond) , 2015, ITP.

[14]  Josef Urban,et al.  MPTP 0.2: Design, Implementation, and Initial Experiments , 2006, Journal of Automated Reasoning.

[15]  Thibault Gauthier,et al.  Self-Learned Formula Synthesis in Set Theory , 2019, ArXiv.

[16]  Josef Urban,et al.  XML-izing Mizar: Making Semantic Processing and Presentation of MML Easy , 2005, MKM.

[17]  Josef Urban,et al.  ENIGMA-NG: Efficient Neural and Gradient-Boosted Inference Guidance for E , 2019, CADE.