Remarks on Solving Algebraic Riccati Matrix Equations using a Hopfield Neural Network and Application to Optimal Control Problems

This paper discusses a method of solving algebraic Riccati matrix equations using a Hopfield neural network and presents its application to the optimal control of dynamic systems with a quadratic cost function. To solve an algebraic Riccati matrix equation using the optimization ability of a Hopfield neural network, an energy function is defined using the elements of the algebraic Riccati matrix equation and a penalty function of incorporating the positive definite constraint of the solution. The energy function is minimized through the dynamics of the Hopfield neural network, and the converged neuron states provide the solution of the algebraic Riccati matrix equation. Computational experiments using a linear second-order system confirm that the Hopfield neural network can solve the algebraic Riccati matrix equation with sufficient accuracy. The optimal control of an automotive vehicle is demonstrated as a practical application of controlling dynamic systems using the solution obtained by the Hopfield neural network; the simulation results indicate the feasibility and effectiveness of the proposed neural network–based optimal control.

[1]  S. W. Ellacott,et al.  Aspects of the numerical analysis of neural networks , 1994, Acta Numerica.

[2]  Jun Wang,et al.  A multilayer recurrent neural network for solving continuous-time algebraic Riccati equations , 1998, Neural Networks.

[3]  F. M. Ham,et al.  A neurocomputing approach for solving the algebraic matrix Riccati equation , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[4]  Anju Vyas Print , 2003 .

[5]  Magali R. G. Meireles,et al.  A comprehensive review for industrial applicability of artificial neural networks , 2003, IEEE Trans. Ind. Electron..

[6]  Mitsuo Gen,et al.  Neural network approach for general assignment problem , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  Mohamed A. Zohdy,et al.  Robust optimal control using recurrent dynamic neural network , 2001, Proceeding of the 2001 IEEE International Symposium on Intelligent Control (ISIC '01) (Cat. No.01CH37206).

[8]  Martin T. Hagan,et al.  An introduction to the use of neural networks in control systems , 2002 .

[9]  Jan Peters,et al.  Model learning for robot control: a survey , 2011, Cognitive Processing.

[10]  Oscar Castillo,et al.  Proceedings of the International MultiConference of Engineers and Computer Scientists 2007, IMECS 2007, March 21-23, 2007, Hong Kong, China , 2007, IMECS.