Evolutionary Design of Numerical Methods: Generating Finite Difference and Integration Schemes by Differential Evolution

Classical and new numerical schemes are generated using evolutionary computing. Differential Evolution is used to find the coefficients of finite difference approximations of function derivatives, and of single and multi-step integration methods. The coefficients are reverse engineered based on samples from a target function and its derivative used for training. The Runge-Kutta schemes are trained using the order condition equations. An appealing feature of the evolutionary method is the low number of model parameters. The population size, termination criterion and number of training points are determined in a sensitivity analysis. Computational results show good agreement between evolved and analytical coefficients. In particular, a new fifth-order Runge-Kutta scheme is computed which adheres to the order conditions with a sum of absolute errors of order 10^-14. Execution of the evolved schemes proved the intended orders of accuracy. The outcome of this study is valuable for future developments in the design of complex numerical methods that are out of reach by conventional means.

[1]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[2]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[3]  Giuseppe Nicosia,et al.  Global Optimization for Algebraic Geometry - Computing Runge-Kutta Methods , 2012, LION.

[4]  Suleiman Mohammad BaniHani.  On the development and some application of a genetic algorithm based lookup table approach for efficient numerical integration in the method of finite spheres , 2007 .

[5]  William E. Boyce,et al.  Elementary differential equations and boundary value problems - Fourth edition , 1986 .

[6]  Conor Ryan,et al.  An Analysis of Diversity of Constants of Genetic Programming , 2003, EuroGP.

[7]  F. Krogh,et al.  Solving Ordinary Differential Equations , 2019, Programming for Computations - Python.

[8]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[9]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Tea Tusar,et al.  Differential Evolution versus Genetic Algorithms in Multiobjective Optimization , 2007, EMO.

[11]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[12]  Franz Rothlauf,et al.  Design of Modern Heuristics , 2011, Natural Computing Series.

[13]  Lee Spector,et al.  Genetic programming for quantum computers , 1998 .

[14]  Kiyotaka Izumi,et al.  Evolving Runge-Kutta-Gill RBF networks to estimate the dynamics of a multi-link manipulator , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[15]  C. Hung,et al.  A Comparative Study on Differential Evolution and Genetic Algorithms for Some Combinatorial Problems , 2009 .

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  C. Tsitouras,et al.  Using neural networks for the derivation of Runge–Kutta–Nyström pairs for integration of orbits , 2012 .

[18]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[19]  Peter M. A. Sloot,et al.  Free-surface flow simulations for discharge-based operation of hydraulic structure gates , 2012, ArXiv.

[20]  Daniel Howard,et al.  Genetic programming of the stochastic interpolation framework: convection–diffusion equation , 2011, Soft Comput..

[21]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[22]  Xin Yao,et al.  Solving equations by hybrid evolutionary computation techniques , 2000, IEEE Trans. Evol. Comput..

[23]  Jinung An,et al.  An Adaptive Cauchy Differential Evolution Algorithm for Global Numerical Optimization , 2013, TheScientificWorldJournal.