Exactly satisfying initial conditions neural network models for numerical treatment of first Painlevé equation

A new stochastic intelligence method is developed to solve first Painleve equation.Design of three unsupervised ANN models that satisfying exactly initial conditions.Optimization capability of SQP is exploited for training of design parameter of ANNs.Accuracy and convergence are validated in term of various performance criterions.Impact on effectiveness of the models is investigated by varying neurons in ANNs. In this paper, novel computing approach using three different models of feed-forward artificial neural networks (ANNs) are presented for the solution of initial value problem (IVP) based on first Painleve equation. These mathematical models of ANNs are developed in an unsupervised manner with capability to satisfy the initial conditions exactly using log-sigmoid, radial basis and tan-sigmoid transfer functions in hidden layers to approximate the solution of the problem. The training of design parameters in each model is performed with sequential quadratic programming technique. The accuracy, convergence and effectiveness of the proposed schemes are evaluated on the basis of the results of statistical analyses through sufficient large number of independent runs with different number of neurons in each model as well. The comparisons of these results of proposed schemes with standard numerical and analytical solutions validate the correctness of the design models.

[1]  Raja Muhammad Asif Zahoor,et al.  Solution of the 2-dimensional Bratu problem using neural network, swarm intelligence and sequential quadratic programming , 2014, Neural Computing and Applications.

[2]  Manoj Kumar,et al.  Multilayer perceptrons and radial basis function neural network methods for the solution of differential equations: A survey , 2011, Comput. Math. Appl..

[3]  Raja Muhammad Asif Zahoor,et al.  Application of three unsupervised neural network models to singular nonlinear BVP of transformed 2D Bratu equation , 2014, Neural Computing and Applications.

[4]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[5]  Andrew P. Bassom,et al.  Numerical studies of the fourth Painlevé equation , 1993 .

[6]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for nonlinear MHD Jeffery-Hamel problem using neural networks optimized with interior point algorithm , 2014, Neurocomputing.

[7]  Seung-Yeop Lee,et al.  Viscous shocks in Hele–Shaw flow and Stokes phenomena of the Painlevé I transcendent , 2010, 1005.0369.

[8]  Nicolai A. Kudryashov,et al.  The first and second Painlevé equations of higher order and some relations between them , 1997 .

[9]  Raja Muhammad Asif Zahoor,et al.  Neural network optimized with evolutionary computing technique for solving the 2-dimensional Bratu problem , 2012, Neural Computing and Applications.

[10]  Junaid Ali Khan,et al.  Novel Approach for a van der Pol Oscillator in the Continuous Time Domain , 2011 .

[11]  M. Raja.  Stochastic numerical treatment for solving Troesch’s problem , 2014 .

[12]  Junaid Ali Khan,et al.  Numerical Treatment for Painlevé Equation I Using Neural Networks and Stochastic Solvers , 2013 .

[13]  Junaid Ali Khan,et al.  Solution of Fractional Order System of Bagley-Torvik Equation Using Evolutionary Computational Intelligence , 2011 .

[14]  Ji-Huan He.  Variational iteration method – a kind of non-linear analytical technique: some examples , 1999 .

[15]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment of nonlinear Emden–Fowler equation using stochastic technique , 2011, Annals of Mathematics and Artificial Intelligence.

[16]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[17]  S. Edward Rajan,et al.  Retinal vessel segmentation employing ANN technique by Gabor and moment invariants-based features , 2014, Appl. Soft Comput..

[18]  Fahd Jrad,et al.  Painlevé Test and Higher Order Differential Equations , 2002, nlin/0301043.

[19]  Siddhartha Bhattacharyya,et al.  Binary image denoising using a quantum multilayer self organizing neural network , 2014, Appl. Soft Comput..

[20]  Raja Muhammad Asif Zahoor,et al.  A new stochastic approach for solution of Riccati differential equation of fractional order , 2010, Annals of Mathematics and Artificial Intelligence.

[21]  Moon Ho Lee,et al.  A new constructive neural network method for noise processing and its application on stock market prediction , 2014, Appl. Soft Comput..

[22]  Hadi Sadoghi Yazdi,et al.  Unsupervised adaptive neural-fuzzy inference system for solving differential equations , 2010, Appl. Soft Comput..

[23]  Junaid Ali Khan,et al.  Stochastic Computational Approach for Complex Nonlinear Ordinary Differential Equations , 2011 .

[24]  Ahmed Faheem Zobaa,et al.  Optimal $C$-Type Passive Filter Based on Minimization of the Voltage Harmonic Distortion for Nonlinear Loads , 2012, IEEE Transactions on Industrial Electronics.

[25]  Muhammad Asif Zahoor Raja,et al.  Numerical treatment for boundary value problems of Pantograph functional differential equation using computational intelligence algorithms , 2014 .

[26]  Raja Muhammad Asif Zahoor,et al.  Evolutionary Computational Intelligence in Solving the Fractional Differential Equations , 2010, ACIIDS.

[27]  Mingfang Ni,et al.  A Lagrange Relaxation Method for Solving Weapon-Target Assignment Problem , 2011 .

[28]  Muhammad Asif Zahoor Raja,et al.  Solution of the one-dimensional Bratu equation arising in the fuel ignition model using ANN optimised with PSO and SQP , 2014 .

[29]  Esmail Hesameddini,et al.  The Use of Variational Iteration Method and Homotopy Perturbation Method for Painleve Equation I , 2009 .

[30]  Ji-Huan He.  SOME ASYMPTOTIC METHODS FOR STRONGLY NONLINEAR EQUATIONS , 2006 .

[31]  Hussein Zedan,et al.  The implementation of an intelligent and video-based fall detection system using a neural network , 2014, Appl. Soft Comput..

[32]  Raza Samar,et al.  Numerical treatment of nonlinear MHD Jeffery–Hamel problems using stochastic algorithms , 2014 .

[33]  Nameer N. El-Emam,et al.  An intelligent computing technique for fluid flow problems using hybrid adaptive neural network and genetic algorithm , 2011, Appl. Soft Comput..

[34]  K. Schittkowski.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[35]  Lun Zhang,et al.  On tronquée solutions of the first Painlevé hierarchy , 2010 .

[36]  Larry D. Wittie,et al.  Application of a “Staggered Walk” Algorithm for Generating Large-Scale Morphological Neuronal Networks , 2012, Comput. Intell. Neurosci..

[37]  A. B. Olde Daalhuis,et al.  Hyperasymptotics for nonlinear ODEs II. The first Painlevé equation and a second-order Riccati equation , 2005 .

[38]  Mohsen Hayati,et al.  Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations , 2009, Appl. Soft Comput..

[39]  Nikolai A. Kudryashov.  Amalgamations of the Painlevé equations , 2003 .

[40]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for solving one-dimensional Bratu problem using neural networks , 2012, Neural Computing and Applications.

[41]  Bengt Fornberg,et al.  A numerical methodology for the Painlevé equations , 2011, J. Comput. Phys..

[42]  K. Swarup,et al.  Sequential quadratic programming based differential evolution algorithm for optimal power flow problem , 2011 .

[43]  Ka Fai Cedric Yiu,et al.  Neural Network Analysis for the detection of glaucomatous damage , 2014, Appl. Soft Comput..

[44]  Mohamed Chtourou,et al.  Neural network control of nonlinear dynamic systems using hybrid algorithm , 2014, Appl. Soft Comput..

[45]  Raja Muhammad Asif Zahoor,et al.  Comparison of three unsupervised neural network models for first Painlevé Transcendent , 2014, Neural Computing and Applications.

[46]  D. Parisi,et al.  Solving differential equations with unsupervised neural networks , 2003 .

[47]  Raja Muhammad Asif Zahoor,et al.  A New Stochastic Technique for Painlevé Equation-I Using Neural Network Optimized with Swarm Intelligence , 2012, Comput. Intell. Neurosci..

[48]  Christopher Monterola,et al.  Solving the nonlinear Schrodinger equation with an unsupervised neural network. , 2001, Optics express.

[49]  Muhammad Asif Zahoor Raja,et al.  Unsupervised neural networks for solving Troesch's problem , 2013 .