Elman Network with Embedded Memory for System Identification

This paper presents a new recurrent neural network (RNN) structure called ENEM for dynamic system identification. ENEM structure is based on Elman network and NARX neural network. In order to show the performance of ENEM for system identifi- cation, the results were also compared to the results of Elman network, Jordan network and their modified models. The identification results of linear and nonlinear systems have shown that the proposed ENEM structure is better than the other results of RNN models.

[1]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[2]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[3]  Mekki Ksouri,et al.  A comparative study on the channel modeling using feedforward and recurrent neural network structures , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[4]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[5]  Seppo J. Ovaska,et al.  A modified Elman neural network model with application to dynamical systems identification , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[6]  Duc Truong Pham,et al.  Identification of linear and nonlinear dynamic systems using recurrent neural networks , 1993, Artif. Intell. Eng..

[7]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[8]  J.E.W. Holm,et al.  Training recurrent neural networks with leap-frog , 1998, IEEE International Symposium on Industrial Electronics. Proceedings. ISIE'98 (Cat. No.98TH8357).

[9]  Hung Hom.  Process Identification using a Modified Elman Neural Net , 1994 .

[10]  D. T. Psent,et al.  Training of Elman networks and dynamic system modelling , .

[11]  Tsungnan Lin,et al.  What to remember: how memory order affects the performance of NARX neural networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[12]  Von-Wun Soo,et al.  A comparative study of recurrent neural network architectures on learning temporal sequences , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[13]  Dervis Karaboga,et al.  Training recurrent neural networks by using parallel tabu search algorithm based on crossover operation , 2004, Eng. Appl. Artif. Intell..

[14]  Seref Sagiroglu,et al.  A New Approach Based on Recurrent Neural Networks for System Identification , 2003, ISCIS.

[15]  Bernhard Sendhoff,et al.  An Extended Elman Net for Modeling Time Series , 1997, ICANN.

[16]  Lakhmi C. Jain,et al.  Recurrent Neural Networks: Design and Applications , 1999 .

[17]  Peter Tiňo,et al.  Learning long-term dependencies is not as difficult with NARX recurrent neural networks , 1995 .

[18]  C. Lee Giles,et al.  How embedded memory in recurrent neural network architectures helps learning long-term temporal dependencies , 1998, Neural Networks.

[19]  Duc Truong Pham,et al.  Training Elman and Jordan networks for system identification using genetic algorithms , 1999, Artif. Intell. Eng..

[20]  Duc Truong Pham,et al.  Neural Networks for Identification, Prediction and Control , 1995 .

[21]  C A Bailer-Jones,et al.  A recurrent neural network for modelling dynamical systems. , 1998, Network.

[22]  Xuemei Ren,et al.  Recurrent neural networks for identification of nonlinear systems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[23]  Sun-Yuan Kung,et al.  The past is important: a method for determining memory structure in NARX neural networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[24]  Ji-Xin Qian,et al.  Recurrent neural networks for recursive identification of nonlinear dynamic process , 1994, Proceedings of 1994 IEEE International Conference on Industrial Technology - ICIT '94.

[25]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[26]  D. P. Kwok,et al.  Process identification using a modified Elman neural net , 1994, Proceedings of ICSIPNN '94. International Conference on Speech, Image Processing and Neural Networks.