Approximate Solutions to Ordinary Differential Equations Using Least Squares Support Vector Machines

In this paper, a new approach based on least squares support vector machines (LS-SVMs) is proposed for solving linear and nonlinear ordinary differential equations (ODEs). The approximate solution is presented in closed form by means of LS-SVMs, whose parameters are adjusted to minimize an appropriate error function. For the linear and nonlinear cases, these parameters are obtained by solving a system of linear and nonlinear equations, respectively. The method is well suited to solving mildly stiff, nonstiff, and singular ODEs with initial and boundary conditions. Numerical results demonstrate the efficiency of the proposed method over existing methods.

[1]  Andrea Toselli,et al.  Domain decomposition methods : algorithms and theory , 2005 .

[2]  J. Lambert.  Numerical Methods for Ordinary Differential Equations , 1991 .

[3]  J. Lambert.  Numerical Methods for Ordinary Differential Systems: The Initial Value Problem , 1991 .

[4]  C. W. Gear,et al.  Hybrid Methods for Initial Value Problems in Ordinary Differential Equations , 1965 .

[5]  David R. Kincaid,et al.  Numerical analysis: mathematics of scientific computing (2nd ed) , 1996 .

[6]  L. Shampine,et al.  A collocation method for boundary value problems , 1972 .

[7]  Satish S. Udpa,et al.  Finite-element neural networks for solving differential equations , 2005, IEEE Transactions on Neural Networks.

[8]  Hyuk Lee,et al.  Neural algorithm for solving differential equations , 1990 .

[9]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[10]  Kevin Stanley McFall,et al.  Artificial Neural Network Method for Solution of Boundary Value Problems With Exact Satisfaction of Arbitrary Boundary Conditions , 2009, IEEE Transactions on Neural Networks.

[11]  Li Cheng,et al.  Online Identification of Nonlinear Spatiotemporal Systems Using Kernel Learning Approach , 2011, IEEE Transactions on Neural Networks.

[12]  Johan A. K. Suykens,et al.  Cellular Neural Networks, Multi-Scroll Chaos and Synchronization , 2005 .

[13]  Andrew J. Meade,et al.  The numerical solution of linear ordinary differential equations by feedforward neural networks , 1994 .

[14]  Johan A. K. Suykens,et al.  Approximate Confidence and Prediction Intervals for Least Squares Support Vector Regression , 2011, IEEE Transactions on Neural Networks.

[15]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[16]  Euripidis Glavas,et al.  Solving differential equations with constructed neural networks , 2009, Neurocomputing.

[17]  Jiménez,et al.  Neural network differential equation and plasma equilibrium solver. , 1995, Physical review letters.

[18]  Johan A. K. Suykens,et al.  Optimal control by least squares support vector machines , 2001, Neural Networks.

[19]  Mehdi R. Zargham,et al.  Real-Time Vector Quantization and Clustering Based on Ordinary Differential Equations , 2011, IEEE Transactions on Neural Networks.

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[21]  M. M. Chawla,et al.  Finite difference methods for two-point boundary value problems involving high order differential equations , 1979 .

[22]  Lucie P. Aarts,et al.  Solving Nonlinear Differential Equations by a Neural Network Method , 2001, International Conference on Computational Science.

[23]  Hadi Sadoghi Yazdi,et al.  Unsupervised kernel least mean square algorithm for solving ordinary differential equations , 2011, Neurocomputing.

[24]  Tong Heng Lee,et al.  Data-Based Identification and Control of Nonlinear Systems via Piecewise Affine Approximation , 2011, IEEE Transactions on Neural Networks.

[25]  Jiang Li,et al.  A self-starting linear multistep method for a direct solution of the general second-order initial value problem , 2009, Int. J. Comput. Math..

[26]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[27]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[28]  Fernando Pérez-Cruz,et al.  Support Vector Regression for the simultaneous learning of a multivariate function and its derivatives , 2005, Neurocomputing.

[29]  Matematik,et al.  Numerical Methods for Ordinary Differential Equations: Butcher/Numerical Methods , 2005 .

[30]  D. O. Awoyemi,et al.  A new sixth-order algorithm for general second order ordinary differential equations , 2001, Int. J. Comput. Math..

[31]  Isaac E. Lagaris,et al.  Solving differential equations with genetic programming , 2006, Genetic Programming and Evolvable Machines.

[32]  D. Sarafyan.  New algorithms for the continuous approximate solutions of ordinary differential equations and the upgrading of the order of the processes , 1990 .