Control of discrete-time systems via online learning and estimation

Online learning state trajectory control for discrete-time systems is considered herein. An improvement to a method previously developed that learns the control input as a function of the desired states for state trajectory tracking control is investigated. The improved method consists of letting the learned control effort be split into a nominal map and a learned adjustment in addition to online estimation of control parameters such as the system's Jacobian and controllability matrix. The method employs the technique known as block-input state realization to transform the system to one with equal number of states and inputs. A neural network structure called the nodal link perceptron network learns the adjustment of the nominal map as a function of the desired states while the Jacobian matrix and the controllability matrix are estimated online via a modified Broyden method to achieve the overall control input. The proposed controller is explored through three different simulations. The method can successfully deal with the nonlinearities and uncertainties inherent in complex systems. This method serves as a model free alternative for intelligent control of complex and uncertain systems

[1]  Alireza Khayatian.  Multirate and block methods for modeling and control of pulse modulated systems , 1993 .

[2]  Nader Sadegh.  A multilayer nodal link perceptron network with least squares training algorithm , 1998 .

[3]  Kumpati S. Narendra,et al.  Control of nonlinear dynamical systems using neural networks: controllability and stabilization , 1993, IEEE Trans. Neural Networks.

[4]  日本自動制御協会,et al.  システムと制御 = Systems and control , 1971 .

[5]  Pedro Albertos,et al.  Block multirate input-output model for sampled-data control systems , 1990 .

[6]  Nader Sadegh.  A nodal link perceptron network with applications to control of a nonholonomic system , 1995, IEEE Trans. Neural Networks.

[7]  Nader Sadegh,et al.  Trajectory learning and output feedback control of nonlinear discrete-time systems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[8]  Singiresu S. Rao.  Engineering Optimization : Theory and Practice , 2010 .

[9]  P. Kokotovic,et al.  Feedback linearization of sampled-data systems , 1988 .

[10]  Jon Rigelsford,et al.  Modelling and Control of Robot Manipulators , 2000 .

[11]  Nader Sadegh,et al.  A perceptron network for functional identification and control of nonlinear systems , 1993, IEEE Trans. Neural Networks.

[12]  D. Gorinevsky.  An approach to parametric nonlinear least square optimization and application to task-level learning control , 1997, IEEE Trans. Autom. Control..

[13]  Nader Sadegh,et al.  Short horizon optimal control of nonlinear systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).