Output tracking for nonlinear stochastic systems by iterative learning control

An iterative learning control (ILC) algorithm, which in essence is a stochastic approximation algorithm, is proposed for output tracking for nonlinear stochastic systems with unknown dynamics and unknown noise statistics. The nonlinear function of the system dynamics is allowed to grow up as fast as a polynomial of any degree, but the system is linear with respect to control. It is proved that the ILC generated by the algorithm a.s. converges to the optimal one at each time t/spl isin/[0,1,...,N] and the output tracking error is asymptotically minimized in the mean square sense as the number of iterates tends to infinity, although the convergence rate is rather slow. The only information used in the algorithm is the noisy observation of the system output and the reference signal y/sub d/(t). When the system state equation is free of noise and the system output is realizable, then the exact state tracking is asymptotically achieved and the tracking error is purely due to the observation noise.

[1]  Riccardo Marino,et al.  Adaptive control of linear time-varying systems , 2003, Autom..

[2]  L. Gerencsér,et al.  The mathematics of noise-free SPSA , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[3]  Han-Fu Chen,et al.  A Kiefer-Wolfowitz algorithm with randomized differences , 1999, IEEE Trans. Autom. Control..

[4]  Chen Hanfu.  Stochastic approximation with state-dependent noise , 2000 .

[5]  In-Joong Ha,et al.  Correction to "asymptotic state tracking in a class of nonlinear systems via learning-based inversion" , 2000, IEEE Trans. Autom. Control..

[6]  Mingxuan Sun,et al.  An iterative learning controller with initial state learning , 1999, IEEE Trans. Autom. Control..

[7]  J. Koronacki.  Random-seeking methods for the stochastic unconstrained optimization , 1975 .

[8]  In-Joong Ha,et al.  A learning approach to precision speed control of servomotors and its application to a VCR , 1999, IEEE Trans. Control. Syst. Technol..

[9]  Xi-Ren Cao,et al.  Pole assignment for stochastic systems with unknown coefficients , 2000 .

[10]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[11]  Madhukar Pandit,et al.  Optimizing iterative learning control of cyclic production processes with application to extruders , 1999, IEEE Trans. Control. Syst. Technol..

[12]  Jay H. Lee,et al.  Model-based iterative learning control with a quadratic criterion for time-varying linear systems , 2000, Autom..

[13]  Chiang-Ju Chien.  A discrete iterative learning control for a class of nonlinear time-varying systems , 1998 .

[14]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[15]  D. Gorinevsky.  An approach to parametric nonlinear least square optimization and application to task-level learning control , 1997, IEEE Trans. Autom. Control..

[16]  John B. Moore,et al.  Exponential convergence of a learning controller for robot manipulators , 1991 .

[17]  Samer S. Saab,et al.  A discrete-time stochastic learning control algorithm , 2001, IEEE Trans. Autom. Control..

[18]  E. Rogers,et al.  Iterative learning control for discrete-time systems with exponential rate of convergence , 1996 .

[19]  F. Giri,et al.  Pole placement direct adaptive control for time-varying ill-modeled plants , 1990 .

[20]  G. Goodwin,et al.  Adaptive control of time-varying linear systems , 1988 .

[21]  Chen Chuan-miao,et al.  Superconvergence for rectangular serendipity finite elements , 2003 .