An Iterative Learning Control Algorithm With Gain Adaptation for Stochastic Systems

This paper proposes an iterative learning control (ILC) algorithm with gain adaptation for discrete-time stochastic systems. The algorithm is based on Kesten's accelerated stochastic approximation (SA) algorithm. The gain adaptation uses only tracking error information, and, hence, is a data-driven adaptation approach. If stochastic noises account for a small proportion of the tracking error, the learning gain matrix remains constant with a high probability. If stochastic noises dominate the tracking error, the learning gain matrix is decreasing. Therefore, the new ILC algorithm converges more quickly than existing SA-based algorithms. In addition, the classic P-type ILC law for noise-free systems is a special case of the new ILC algorithm. The behaviors of the proposed ILC algorithm are demonstrated through examples.

[1]  Emre Kural,et al.  96 A Survey of Iterative Learning Control Al earning-based method for high-performance tracking control , 2006 .

[2]  Kevin L. Moore,et al.  Unified Analysis of Iterative Learning and Repetitive Controllers in Trial Domain , 2014, IEEE Transactions on Automatic Control.

[3]  Yi Yang,et al.  Discrete-Time Robust Iterative Learning Kalman Filtering for Repetitive Processes , 2016, IEEE Transactions on Automatic Control.

[4]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[5]  Kok Kiong Tan,et al.  Necessary and sufficient condition for convergence of iterative learning algorithm , 2002, Autom..

[6]  Wei Zhang,et al.  On almost sure and mean square convergence of P-type ILC under randomly varying iteration lengths , 2016, Autom..

[7]  Jeroen van de Wijdeven,et al.  Iterative Learning Control for uncertain systems: Robust monotonic convergence analysis , 2009, Autom..

[8]  Philippe Neveux,et al.  Robust filtering for uncertain systems , 2001, Signal Process..

[9]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[10]  Jian-Xin Xu,et al.  State-Constrained Iterative Learning Control for a Class Of MIMO Systems , 2013, IEEE Transactions on Automatic Control.

[11]  Dong Shen,et al.  A Novel Markov Chain Based ILC Analysis for Linear Stochastic Systems Under General Data Dropouts Environments , 2017, IEEE Transactions on Automatic Control.

[12]  Han-Fu Chen.  Stochastic approximation and its applications , 2002 .

[13]  Samer S. Saab,et al.  A discrete-time stochastic learning control algorithm , 2001, IEEE Trans. Autom. Control..

[14]  Dong Shen.  Data-Driven Learning Control for Stochastic Nonlinear Systems: Multiple Communication Constraints and Limited Storage , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[15]  R. Longchamp,et al.  Iterative Learning Control based on Stochastic Approximation , 2008 .

[16]  Jingyi Zhu,et al.  Tracking capability of stochastic gradient algorithm with constant gain , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[17]  Junping Du,et al.  High‐precision formation control of nonlinear multi‐agent systems with switching topologies: A learning approach , 2015 .

[18]  Dong Shen,et al.  Survey on stochastic iterative learning control , 2014 .

[19]  S. Saab.  Stochastic P-type/D-type iterative learning control algorithms , 2003 .

[20]  A. Karimi,et al.  Iterative Learning Control Using Stochastic Approximation Theory with Application to a Mechatronic System , 2010 .

[21]  Furong Gao,et al.  Iterative learning Kalman filter for repetitive processes , 2016 .

[22]  Huijun Gao,et al.  Robust Filtering for Uncertain 2-D Systems , 2014 .

[23]  Bernard Delyon,et al.  Accelerated Stochastic Approximation , 1993, SIAM J. Optim..

[24]  H. Kesten.  Accelerated Stochastic Approximation , 1958 .