Solving differential equations with constructed neural networks

A novel hybrid method for the solution of ordinary and partial differential equations is presented here. The method creates trial solutions in neural network form using a scheme based on grammatical evolution. The trial solutions are enhanced periodically using a local optimization procedure. The proposed method is tested on a series of ordinary differential equations, systems of ordinary differential equations as well as on partial differential equations with Dirichlet boundary conditions and the results are reported.

[1]  Ragnar Norberg,et al.  Differential equations for moments of present values in life insurance , 1995 .

[2]  Anthony Brabazon,et al.  A Grammar Model for Foreign-Exchange Trading , 2003, IC-AI.

[3]  J. Verwer.  Explicit Runge-Kutta methods for parabolic partial differential equations , 1996 .

[4]  Andrew J. Meade,et al.  Solution of nonlinear ordinary differential equations by feedforward neural networks , 1994 .

[5]  Euripidis Glavas,et al.  Neural network construction and training using grammatical evolution , 2008, Neurocomputing.

[6]  Arieh Iserles,et al.  Geometric integration: numerical solution of differential equations on manifolds , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[7]  J. Butcher.  The numerical analysis of ordinary differential equations: Runge-Kutta and general linear methods , 1987 .

[8]  Michael O'Neill,et al.  Grammatical evolution - evolutionary automatic programming in an arbitrary language , 2003, Genetic programming.

[9]  Luo Siwei,et al.  Numerical solution of differential equations by radial basis function neural networks , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[10]  J. Lambert.  Numerical Methods for Ordinary Differential Systems: The Initial Value Problem , 1991 .

[11]  Richard Wesley Hamming,et al.  Stable Predictor-Corrector Methods for Ordinary Differential Equations , 1959, JACM.

[12]  Yan-ze Peng.  Exact solutions for some nonlinear partial differential equations , 2003 .

[13]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[14]  Vladimir E. Korepin,et al.  Differential Equations for Quantum Correlation Functions , 1990 .

[15]  S. Ruan,et al.  A delay-differential equation model of HIV infection of CD4(+) T-cells. , 2000, Mathematical biosciences.

[16]  Gang,et al.  Controlling chaos in systems described by partial differential equations. , 1993, Physical review letters.

[17]  Fathalla A. Rihan,et al.  Numerical modelling in biosciences using delay differential equations , 2000 .

[18]  J. Douglas,et al.  On Predictor-Corrector Methods for Nonlinear Parabolic Differential Equations , 1963 .

[19]  R. Tetzlaff,et al.  A learning algorithm for cellular neural networks (CNN) solving nonlinear partial differential equations , 1995, Proceedings of ISSE'95 - International Symposium on Signals, Systems and Electronics.

[20]  Joke Blom,et al.  A comparison of stiff ode solvers for atmospheric chemistry problems , 1995 .

[21]  M. J. D. Powell,et al.  A tolerant algorithm for linearly constrained optimization calculations , 1989, Math. Program..

[22]  Carsten Franke,et al.  Solving partial differential equations by collocation using radial basis functions , 1998, Appl. Math. Comput..

[23]  Konrad Reif,et al.  Multilayer neural networks for solving a class of partial differential equations , 2000, Neural Networks.

[24]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[25]  Conor Ryan,et al.  Grammatical Evolution , 2001, Genetic Programming Series.

[26]  Satish S. Udpa,et al.  Finite-element neural networks for solving differential equations , 2005, IEEE Transactions on Neural Networks.

[27]  J. Behlke,et al.  A new approximate whole boundary solution of the Lamm differential equation for the analysis of sedimentation velocity experiments. , 2002, Biophysical chemistry.

[28]  Isaac E. Lagaris,et al.  Solving differential equations with genetic programming , 2006, Genetic Programming and Evolvable Machines.

[29]  A. Kotikov,et al.  Differential equations method: the calculation of vertex-type Feynman diagrams , 1991 .

[30]  Gregory E. Fasshauer,et al.  Solving differential equations with radial basis functions: multilevel methods and smoothing , 1999, Adv. Comput. Math..

[31]  D. Parisi,et al.  Solving differential equations with unsupervised neural networks , 2003 .

[32]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[33]  J. W.,et al.  A Approved for Public Release , 1996 .

[34]  Andrew J. Meade,et al.  The numerical solution of linear ordinary differential equations by feedforward neural networks , 1994 .

[35]  Janos Ladik,et al.  Numerical solution of a partial differential equation system describing chemical kinetics and diffusion in a cell with the aid of compartmentalization , 1989 .

[36]  Albert Wambecq,et al.  Rational Runge-Kutta methods for solving systems of ordinary differential equations , 2005, Computing.