AI Feynman: A physics-inspired method for symbolic regression

Our physics-inspired algorithm for symbolic regression is able to discover complex physics equations from mere tables of numbers. A core challenge for both physics and artificial intelligence (AI) is symbolic regression: finding a symbolic expression that matches data from an unknown function. Although this problem is likely to be NP-hard in principle, functions of practical interest often exhibit symmetries, separability, compositionality, and other simplifying properties. In this spirit, we develop a recursive multidimensional symbolic regression algorithm that combines neural network fitting with a suite of physics-inspired techniques. We apply it to 100 equations from the Feynman Lectures on Physics, and it discovers all of them, while previous publicly available software cracks only 71; for a more difficult physics-based test set, we improve the state-of-the-art success rate from 15 to 90%.

[1]  Steven L Brunton,et al.  Sparse identification of nonlinear dynamics for rapid model recovery. , 2018, Chaos.

[2]  S. Jantarang,et al.  3G mobile wireless routing optimization by genetic algorithm , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[3]  R. Fox,et al.  Classical Electrodynamics, 3rd ed. , 1999 .

[4]  W. Marsden.  I and J , 2012 .

[5]  一紀 正路.  Pennsylvania State Universityに留学して , 1975 .

[6]  Jihoon Yang,et al.  Genetic Algorithm-based Dynamic Vehicle Route Search using Car-to-Car Communication , 2010 .

[7]  Christian Gagné,et al.  A Statistical Learning Perspective of Genetic Programming , 2009, EuroGP.

[8]  Nicholay Topin,et al.  Super-convergence: very fast training of neural networks using large learning rates , 2018, Defense + Commercial Sensing.

[9]  Alexandre Koyre.  The Astronomical Revolution : Copernicus - Kepler - Borelli , 2013 .

[10]  Matthew D. Schwartz,et al.  Quantum Field Theory and the Standard Model , 2013 .

[11]  Sankar K. Pal,et al.  Genetic Algorithms for Pattern Recognition , 2017 .

[12]  Steven Weinberg.  Gravitation and Cosmology: Principles and Applications of the General Theory of Relativity , 1973 .

[13]  Rajkumar Venkatesan,et al.  A genetic algorithms approach to growth phase forecasting of wireless subscribers , 2002 .

[14]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[15]  R. Leighton,et al.  Feynman Lectures on Physics , 1971 .

[16]  Lawrence Sklar,et al.  The astronomical revolution , 2012 .

[17]  Bethany Delman.  Genetic algorithms in cryptography , 2004 .

[18]  Richard J. Bauer,et al.  Genetic Algorithms and Investment Strategies , 1994 .

[19]  Ronald C. Arkin,et al.  Using Genetic Algorithms to Learn Reactive Control Parameters for Autonomous Robotic Navigation , 1994, Adapt. Behav..

[20]  Max Tegmark,et al.  Toward an artificial intelligence physicist for unsupervised learning. , 2019, Physical review. E.

[21]  Renáta Dubcáková,et al.  Eureqa: software review , 2011, Genetic Programming and Evolvable Machines.

[22]  S. Brunton,et al.  Discovering governing equations from data by sparse identification of nonlinear dynamical systems , 2015, Proceedings of the National Academy of Sciences.

[23]  Terence Soule,et al.  Genetic Programming: Theory and Practice , 2003 .

[24]  Leslie N. Smith,et al.  A disciplined approach to neural network hyper-parameters: Part 1 - learning rate, batch size, momentum, and weight decay , 2018, ArXiv.

[25]  Max Tegmark,et al.  Why Does Deep and Cheap Learning Work So Well? , 2016, Journal of Statistical Physics.

[26]  Trent McConaghy,et al.  FFX: Fast, Scalable, Deterministic Symbolic Regression Technology , 2011 .

[27]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[28]  Michael D. Schmidt,et al.  Automated refinement and inference of analytical models for metabolic networks , 2011, Physical biology.

[29]  R. Wagoner,et al.  Gravitation and Cosmology: Principles and Applications of the General Theory of Relativity , 1973 .