Indirect adaptive control of nonlinear dynamic systems using self recurrent wavelet neural networks via adaptive learning rates

This paper proposes an indirect adaptive control method using self recurrent wavelet neural networks (SRWNNs) for dynamic systems. The architecture of the SRWNN is a modified model of the wavelet neural network (WNN). However, unlike the WNN, since a mother wavelet layer of the SRWNN is composed of self-feedback neurons, the SRWNN can store the past information of wavelets. In the proposed control architecture, two SRWNNs are used as both an identifier and a controller. The SRWNN identifier approximates dynamic systems and provides the SRWNN controller with information about the system sensitivity. The gradient-descent method using adaptive learning rates (ALRs) is applied to train all weights of the SRWNN. The ALRs are derived from discrete Lyapunov stability theorem, which are applied to guarantee the convergence of the proposed control system. Finally, we perform some simulations to verify the effectiveness of the proposed control scheme.

[1]  George D. Magoulas,et al.  Improving the Convergence of the Backpropagation Algorithm Using Learning Rate Adaptation Methods , 1999, Neural Computation.

[2]  Barak A. Pearlmutter.  Learning state space trajectories in recurrent neural networks : a preliminary report. , 1988 .

[3]  Jin-Bae Park,et al.  Stable Intelligent Control of Chaotic Systems via Wavelet Neural Network , 2003 .

[4]  F.H.F. Leung,et al.  A novel GA-based neural network for short-term load forecasting , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[5]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[6]  J. H. Tucker,et al.  An enhanced backpropagation training algorithm , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[9]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[10]  Malrey Lee,et al.  Evolution of behaviors in autonomous robot using artificial neural network and genetic algorithm , 2003, Inf. Sci..

[11]  Tommy W. S. Chow,et al.  A recurrent neural-network-based real-time learning control strategy applying to nonlinear systems with unknown dynamics , 1998, IEEE Trans. Ind. Electron..

[12]  Kar-Ann Toh,et al.  Deterministic global optimization for FNN training , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[13]  S. Yao,et al.  Evolving wavelet neural networks for function approximation , 1996 .

[14]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[15]  Shu-Hung Leung,et al.  Fast convergence for backpropagation network with magnified gradient function , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[16]  Kok Kiong Tan,et al.  Nonlinear adaptive control of interconnected systems using neural networks , 2006, IEEE Transactions on Neural Networks.

[17]  Jun Zhang,et al.  Wavelet neural networks for function learning , 1995, IEEE Trans. Signal Process..

[18]  Faa-Jeng Lin,et al.  Hybrid controller with recurrent neural network for magnetic levitation system , 2005 .

[19]  Sigeru Omatu,et al.  Process control by on-line trained neural controllers , 1992, IEEE Trans. Ind. Electron..

[20]  Xiaoou Li,et al.  Dynamic system identification via recurrent multilayer perceptron , 2002, Inf. Sci..

[21]  P.-H. Shen,et al.  An Adaptive Recurrent-Neural-Network Motion Controller for X-Y Table in CNC Machine , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Leang-San Shieh,et al.  A new approach for neural control of nonlinear discrete dynamic systems , 2005, Inf. Sci..

[23]  Tianping Chen,et al.  Universal approximation capability of EBF neural networks with arbitrary activation functions , 1996 .

[24]  Bradley R. Holt,et al.  A Neural Network Structure for System Identification , 1990, 1990 American Control Conference.

[25]  Hong Chen,et al.  Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks , 1993, IEEE Trans. Neural Networks.

[26]  Sung Jin Yoo,et al.  Stable Predictive Control of Chaotic Systems Using Self-Recurrent Wavelet Neural Network , 2005 .

[27]  Guanrong Chen,et al.  Control of chaotic dynamical systems using radial basis function network approximators , 2000, Inf. Sci..

[28]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[29]  Gérard Dreyfus,et al.  Training wavelet networks for nonlinear dynamic input-output modeling , 1998, Neurocomputing.

[30]  Takayuki Yamada,et al.  Learning control using neural networks , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[31]  Liangyue Cao,et al.  Predicting chaotic time series with wavelet networks , 1995 .

[32]  Jin Bae Park,et al.  Direct adaptive control using self recurrent wavelet neural network via adaptive learning rates for stable path tracking of mobile robots , 2005, Proceedings of the 2005, American Control Conference, 2005..

[33]  Wen Yu,et al.  Nonlinear system identification using discrete-time recurrent neural networks with stable learning algorithms , 2004, Inf. Sci..

[34]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[35]  Q. Marashdeh,et al.  Nonlinear forward problem solution for electrical capacitance tomography using feed-forward neural network , 2006, IEEE Sensors Journal.