Solution of the 2-dimensional Bratu problem using neural network, swarm intelligence and sequential quadratic programming

Abstract In this paper, stochastic techniques have been developed to solve the 2-dimensional Bratu equations with the help of feed-forward artificial neural networks, optimized with particle swarm optimization (PSO) and sequential quadratic programming (SQP) algorithms. A hybrid of the above two algorithms, referred to as the PSO-SQP method is also studied. The original 2-dimensional equations are solved by first transforming them into equivalent one-dimensional boundary value problems (BVPs). These are then modeled using neural networks. The optimization problem for training the weights of the network has been addressed using particle swarm techniques for global search, integrated with an SQP method for rapid local convergence. The methodology is evaluated by applying on three different test cases of BVPs for the Bratu equations. Monte Carlo simulations and extensive analyses are carried out to validate the accuracy, convergence and effectiveness of the schemes. A comparative study of proposed results is made with available exact solution, as well as, reported numerical results.

[1]  B. Gidas,et al.  Symmetry and related properties via the maximum principle , 1979 .

[2]  S. N. Sivanandam,et al.  Multiprocessor Scheduling Using Hybrid Particle Swarm Optimization with Dynamically Varying Inertia , 2007, Int. J. Comput. Sci. Appl..

[3]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment of nonlinear Emden–Fowler equation using stochastic technique , 2011, Annals of Mathematics and Artificial Intelligence.

[4]  K. Schittkowski NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[5]  Hadi Sadoghi Yazdi,et al.  Unsupervised adaptive neural-fuzzy inference system for solving differential equations , 2010, Appl. Soft Comput..

[6]  John P. Boyd,et al.  One-point pseudospectral collocation for the one-dimensional Bratu equation , 2011, Appl. Math. Comput..

[7]  C. Monterola,et al.  Solving the nonlinear Schrodinger equation with an unsupervised neural network. , 2003, Optics express.

[8]  Raja Muhammad Asif Zahoor,et al.  A new stochastic approach for solution of Riccati differential equation of fractional order , 2010, Annals of Mathematics and Artificial Intelligence.

[9]  Junaid Ali Khan,et al.  Solution of Fractional Order System of Bagley-Torvik Equation Using Evolutionary Computational Intelligence , 2011 .

[10]  Alaeddin Malek,et al.  Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques , 2009, J. Frankl. Inst..

[11]  Klaus Schittkowski,et al.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[12]  Muhammed I. Syam,et al.  An efficient method for solving Bratu equations , 2006, Appl. Math. Comput..

[13]  Saeid Abbasbandy,et al.  The Lie-group shooting method for solving the Bratu equation , 2011 .

[14]  Manoj Kumar,et al.  Multilayer perceptrons and radial basis function neural network methods for the solution of differential equations: A survey , 2011, Comput. Math. Appl..

[15]  Junaid Ali Khan,et al.  Hybrid evolutionary computational approach: Application to van der pol oscillator , 2011 .

[16]  Muhammad Asif Zahoor Raja,et al.  Solution of the one-dimensional Bratu equation arising in the fuel ignition model using ANN optimised with PSO and SQP , 2014 .

[17]  Christopher Monterola,et al.  Solving the nonlinear Schrodinger equation with an unsupervised neural network. , 2001, Optics express.

[18]  R. Fletcher Practical Methods of Optimization , 1988 .

[19]  Muhammad Asif Zahoor Raja,et al.  Unsupervised neural networks for solving Troesch's problem , 2013 .

[20]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[21]  D. Parisi,et al.  Solving differential equations with unsupervised neural networks , 2003 .

[22]  Ahmed Faheem Zobaa,et al.  Optimal $C$-Type Passive Filter Based on Minimization of the Voltage Harmonic Distortion for Nonlinear Loads , 2012, IEEE Transactions on Industrial Electronics.

[23]  D. West,et al.  Degenerate noncollinear emission from a type I collinear parametric oscillator. , 2001, Optics express.

[24]  Junaid Ali Khan,et al.  Stochastic Computational Approach for Complex Nonlinear Ordinary Differential Equations , 2011 .

[25]  Jianjun Wang,et al.  A steganographic method based upon JPEG and particle swarm optimization algorithm , 2007, Inf. Sci..

[26]  Raja Muhammad Asif Zahoor,et al.  Evolutionary Computational Intelligence in Solving the Fractional Differential Equations , 2010, ACIIDS.

[27]  K. Schmitt,et al.  The Liouville–Bratu–Gelfand Problem for Radial Operators , 2002 .

[28]  Raja Muhammad Asif Zahoor,et al.  Neural network optimized with evolutionary computing technique for solving the 2-dimensional Bratu problem , 2012, Neural Computing and Applications.

[29]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[30]  M. Raja Stochastic numerical treatment for solving Troesch’s problem , 2014 .

[31]  D. Frank-Kamenetskii,et al.  Diffusion and heat exchange in chemical kinetics , 1955 .

[32]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for nonlinear MHD Jeffery-Hamel problem using neural networks optimized with interior point algorithm , 2014, Neurocomputing.

[33]  Qian Guo,et al.  Thermo-electro-hydrodynamic model for electrospinning process , 2004 .

[34]  K. Swarup,et al.  Sequential quadratic programming based differential evolution algorithm for optimal power flow problem , 2011 .

[35]  Ricardo de A. Araújo Swarm-based translation-invariant morphological prediction method for financial time series forecasting , 2010, Inf. Sci..

[36]  Muhammed I. Syam,et al.  The modified Broyden-variational method for solving nonlinear elliptic differential equations , 2007 .

[37]  Mohsen Hayati,et al.  Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations , 2009, Appl. Soft Comput..

[38]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for solving one-dimensional Bratu problem using neural networks , 2012, Neural Computing and Applications.

[39]  Raza Samar,et al.  Numerical treatment of nonlinear MHD Jeffery–Hamel problems using stochastic algorithms , 2014 .

[40]  Junaid Ali Khan,et al.  Novel Approach for a van der Pol Oscillator in the Continuous Time Domain , 2011 .

[41]  Junaid Ali Khan,et al.  SWARM INTELLIGENCE OPTIMIZED NEURAL NETWORKS FOR SOLVING FRACTIONAL DIFFERENTIAL EQUATIONS , 2011 .

[42]  G. Bratu Sur les équations intégrales non linéaires , 1913 .

[43]  R. Jalilian,et al.  Non-polynomial spline method for solving Bratu's problem , 2010, Comput. Phys. Commun..

[44]  Ron Buckmire,et al.  On Exact and Numerical Solutions of the One-Dimensional Planar Bratu Problem , 2003 .