Comparison of three unsupervised neural network models for first Painlevé Transcendent

Abstract In this paper, a reliable soft computing framework is presented for the approximate solution of initial value problem (IVP) of first Painlevé equation using three unsupervised neural network models optimized with sequential quadratic programming (SQP). These mathematical models are constructed in the form of feed-forward architecture including log-sigmoid, radial base and tan-sigmoid activation functions in the hidden layers. The optimization of designed parameters for each model is performed with SQP, an efficient constraint optimization problem-solving algorithm. The designed methodology is tested on the IVP, and comparative study is carried out with standard solution based on numerical and analytical solvers. The accuracy, convergence and effectiveness of the schemes are validated on the given benchmark problem by large number of simulations and their comprehensive analysis.

[1]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment of nonlinear Emden–Fowler equation using stochastic technique , 2011, Annals of Mathematics and Artificial Intelligence.

[2]  Raja Muhammad Asif Zahoor,et al.  Evolutionary Computational Intelligence in Solving the Fractional Differential Equations , 2010, ACIIDS.

[3]  Andrew P. Bassom,et al.  Numerical studies of the fourth Painlevé equation , 1993 .

[4]  D. West,et al.  Degenerate noncollinear emission from a type I collinear parametric oscillator. , 2001, Optics express.

[5]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for nonlinear MHD Jeffery-Hamel problem using neural networks optimized with interior point algorithm , 2014, Neurocomputing.

[6]  Seung-Yeop Lee,et al.  Viscous shocks in Hele–Shaw flow and Stokes phenomena of the Painlevé I transcendent , 2010, 1005.0369.

[7]  Raja Muhammad Asif Zahoor,et al.  A new stochastic approach for solution of Riccati differential equation of fractional order , 2010, Annals of Mathematics and Artificial Intelligence.

[8]  Ji-Huan He.  Variational iteration method – a kind of non-linear analytical technique: some examples , 1999 .

[9]  Ji-Huan He.  SOME ASYMPTOTIC METHODS FOR STRONGLY NONLINEAR EQUATIONS , 2006 .

[10]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[11]  Lucie P. Aarts,et al.  Neural Network Method for Solving Partial Differential Equations , 2001, Neural Processing Letters.

[12]  A. B. Olde Daalhuis,et al.  Hyperasymptotics for nonlinear ODEs II. The first Painlevé equation and a second-order Riccati equation , 2005 .

[13]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for solving one-dimensional Bratu problem using neural networks , 2012, Neural Computing and Applications.

[14]  Raja Muhammad Asif Zahoor,et al.  Application of three unsupervised neural network models to singular nonlinear BVP of transformed 2D Bratu equation , 2014, Neural Computing and Applications.

[15]  Raja Muhammad Asif Zahoor,et al.  Exactly satisfying initial conditions neural network models for numerical treatment of first Painlevé equation , 2015, Appl. Soft Comput..

[16]  Raja Muhammad Asif Zahoor,et al.  Neural network optimized with evolutionary computing technique for solving the 2-dimensional Bratu problem , 2012, Neural Computing and Applications.

[17]  D. Parisi,et al.  Solving differential equations with unsupervised neural networks , 2003 .

[18]  C. Monterola,et al.  Solving the nonlinear Schrodinger equation with an unsupervised neural network. , 2003, Optics express.

[19]  Junaid Ali Khan,et al.  Solution of Fractional Order System of Bagley-Torvik Equation Using Evolutionary Computational Intelligence , 2011 .

[20]  Alaeddin Malek,et al.  Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques , 2009, J. Frankl. Inst..

[21]  Klaus Schittkowski,et al.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[22]  Raza Samar,et al.  Numerical treatment of nonlinear MHD Jeffery–Hamel problems using stochastic algorithms , 2014 .

[23]  Hadi Sadoghi Yazdi,et al.  Unsupervised adaptive neural-fuzzy inference system for solving differential equations , 2010, Appl. Soft Comput..

[24]  K. Schittkowski.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[25]  R. J. Szabo,et al.  Fermionic Quantum Gravity , 2000 .

[26]  Shunji Kawamoto,et al.  Reduction of KdV and Cylindrical KdV Equations to Painlevé Equation , 1982 .

[27]  D. A. Spence,et al.  Multiple solutions for natural convective flows in an internally heated, vertical channel with viscous dissipation and pressure work , 1982 .

[28]  Christopher Monterola,et al.  Solving the nonlinear Schrodinger equation with an unsupervised neural network. , 2001, Optics express.

[29]  Muhammad Asif Zahoor Raja,et al.  Numerical treatment for boundary value problems of Pantograph functional differential equation using computational intelligence algorithms , 2014 .

[30]  Muhammad Asif Zahoor Raja,et al.  Unsupervised neural networks for solving Troesch's problem , 2013 .

[31]  Junaid Ali Khan,et al.  Novel Approach for a van der Pol Oscillator in the Continuous Time Domain , 2011 .

[32]  Junaid Ali Khan,et al.  SWARM INTELLIGENCE OPTIMIZED NEURAL NETWORKS FOR SOLVING FRACTIONAL DIFFERENTIAL EQUATIONS , 2011 .

[33]  Athanassios S. Fokas,et al.  Discrete Painlevé equations and their appearance in quantum gravity , 1991 .

[34]  Muhammad Asif Zahoor Raja,et al.  Solution of the one-dimensional Bratu equation arising in the fuel ignition model using ANN optimised with PSO and SQP , 2014 .

[35]  Junaid Ali Khan,et al.  Stochastic Computational Approach for Complex Nonlinear Ordinary Differential Equations , 2011 .

[36]  Richard Haberman,et al.  Slowly Varying Jump and Transition Phenomena Associated with Algebraic Bifurcation Problems , 1979 .

[37]  Raja Muhammad Asif Zahoor,et al.  Numerical treatment for boundary value problems of Pantograph functional differential equation using computational intelligence algorithms , 2014, Appl. Soft Comput..

[38]  M. Raja.  Stochastic numerical treatment for solving Troesch’s problem , 2014 .

[39]  Junaid Ali Khan,et al.  Numerical Treatment for Painlevé Equation I Using Neural Networks and Stochastic Solvers , 2013 .

[40]  Raja Muhammad Asif Zahoor,et al.  Heuristic computational approach using swarm intelligence in solving fractional differential equations , 2010, GECCO '10.

[41]  Junaid Ali Khan,et al.  Stochastic numerical treatment for thin film flow of third grade fluid using unsupervised neural networks , 2015 .

[42]  L. Debnath.  Solitons and the Inverse Scattering Transform , 2012 .

[43]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[44]  Lun Zhang,et al.  On tronquée solutions of the first Painlevé hierarchy , 2010 .

[45]  Junaid Ali Khan,et al.  Hybrid evolutionary computational approach: Application to van der pol oscillator , 2011 .

[46]  Islamic Azad University,et al.  The Use of Variational Iteration Method and Homotopy Perturbation Method for Painlevé Equation I , 2009 .

[47]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[48]  Raja Muhammad Asif Zahoor,et al.  Solution of the 2-dimensional Bratu problem using neural network, swarm intelligence and sequential quadratic programming , 2014, Neural Computing and Applications.

[49]  Manoj Kumar,et al.  Multilayer perceptrons and radial basis function neural network methods for the solution of differential equations: A survey , 2011, Comput. Math. Appl..