Parameter identification for time-varying systems by evolutionary neural network

Elman, which is one of the well-known recurrent neural networks, has been improved to easily apply in parameter identification of time-varying systems during the past decade. In this paper, a learning algorithm for Elman neural networks (ENN) based on improved particle swarm optimization (IPSO), which is a swarm intelligent algorithm, is presented. IPSO and Elman are hybridized to form IPSO-ENN evolutionary algorithm, which is employed to parameter estimation. Simulation experiments show that IPSO-ENN is a more effective swarm intelligent algorithm, which results in an identifier with the best trained model. Time-varying system of the IPSO-ENN is obtained.

[1]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[2]  Kwok-wing Chau,et al.  Particle Swarm Optimization Training Algorithm for ANNs in Stage Prediction of Shing Mun River , 2006 .

[3]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[4]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[5]  Naira Hovakimyan,et al.  Passivity-based neural network adaptive output feedback control for nonlinear nonnegative dynamical systems , 2005, IEEE Transactions on Neural Networks.

[6]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[7]  Gao Xue-peng,et al.  Recurrent Neural Networks and Their Application in System Identification , 2003 .

[8]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[9]  Duc Truong Pham,et al.  Dynamic System Identification Using Recurrent Neural Networks , 1995 .

[10]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[11]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[12]  David B. Fogel,et al.  Evolving artificial intelligence , 1992 .

[13]  T. L. Vincent,et al.  Optimality in parametric systems , 1981 .

[14]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[15]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[16]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[17]  Nils J. Nilsson,et al.  Artificial Intelligence: A New Synthesis , 1997 .

[18]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[19]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[20]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .