Constructing ordinary sum differential equations using polynomial networks

Data relations can define general sum partial differential equations of a composite function additive derivative model. Time-series data observations can analogously describe an ordinary sum differential equation with time derivatives, which is possible to be solved using partial derivative term substitutions of time-dependent series. Differential polynomial neural network is a new type of neural network, which constructs and substitutes for an unknown general partial differential equation from data observations, developed by the author. It generates sum series of convergent partial polynomial derivative terms, which can describe an unknown complex function time-series. This type of non-linear regression decomposes a system model, described by the general differential equation, into many partial low order derivative specifications of selected relative sum terms. Common soft-computing techniques in general can apply input variables of only absolute interval values of a specific data range. The character of relative data allows processing a wider range of test interval values than defined by a training set. The characteristics of the composite sum differential equation solutions can facilitate a much greater variety of model forms than is allowed using standard soft computing methods. Recurrent neural network proved to form simple solid time-series models, most of which it is possible to describe using ordinary differential equations, so the comparisons were done.

[1]  Tofigh Allahviranloo,et al.  Nth-order fuzzy linear differential equations , 2008, Inf. Sci..

[2]  Hitoshi Iba,et al.  Polynomial harmonic GMDH learning networks for time series modeling , 2003, Neural Networks.

[3]  Sung-Kwun Oh,et al.  The design of self-organizing Polynomial Neural Networks , 2002, Inf. Sci..

[4]  L Zjavka,et al.  Recognition of Generalized Patterns by a Differential Polynomial Neural Network , 2012 .

[5]  Euripidis Glavas,et al.  Solving differential equations with constructed neural networks , 2009, Neurocomputing.

[6]  Amit Konar,et al.  Particle Swarm Optimization and Differential Evolution Algorithms: Technical Analysis, Applications and Hybridization Perspectives , 2008, Advances of Computational Intelligence in Industrial Systems.

[7]  Yuehui Chen,et al.  Time-series forecasting using a system of ordinary differential equations , 2011, Inf. Sci..

[8]  Hitoshi Iba,et al.  Inference of differential equation models by genetic programming , 2002, Inf. Sci..

[9]  Hod Lipson,et al.  Inference of hidden variables in systems of differential equations with genetic programming , 2013, Genetic Programming and Evolvable Machines.

[10]  Marek Wojciechowski,et al.  Solving Differential Equations by Means of Feed-Forward Artificial Neural Networks , 2012, ICAISC.

[11]  Siwei Luo,et al.  Numerical solution of elliptic partial differential equation using radial basis function neural networks , 2003, Neural Networks.

[12]  Sanjoy Das The Polynomial Neural Network , 1995, Inf. Sci..

[13]  Ah Chung Tsoi,et al.  Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[14]  Kathryn A. Dowsland,et al.  Simulated Annealing , 1989, Encyclopedia of GIS.

[15]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[16]  Chenglin Bai,et al.  Exact solutions for nonlinear partial differential equation: a new approach , 2001 .

[17]  Václav Snásel,et al.  Fuzzy classification by evolutionary algorithms , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[18]  Sung-Kwun Oh,et al.  Polynomial neural networks architecture: analysis and design , 2003, Comput. Electr. Eng..

[19]  Konrad Reif,et al.  Multilayer neural networks for solving a class of partial differential equations , 2000, Neural Networks.

[20]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[21]  Lishan Kang,et al.  Evolutionary Modeling of Systems of Ordinary Differential Equations with Genetic Programming , 2000, Genetic Programming and Evolvable Machines.

[22]  Lucie P. Aarts,et al.  Neural Network Method for Solving Partial Differential Equations , 2001, Neural Processing Letters.

[23]  W. Y. Chau,et al.  Mathematical theory of reduction of physical parameters and similarity analysis , 1979 .

[24]  Ajith Abraham,et al.  Failure and power utilization system models of differential equations by polynomial neural networks , 2013, 13th International Conference on Hybrid Intelligent Systems (HIS 2013).

[25]  Enrique J. Carmona,et al.  Solving differential equations with Fourier series and Evolution Strategies , 2012, Appl. Soft Comput..