Survey on stochastic iterative learning control

Abstract Iterative learning control (ILC) is suitable for systems that are able to repeatedly complete several tasks over a fixed time interval. Since it was first proposed, ILC has been further developed through extensive efforts. However, there are few related results on systems with stochastic signals, where by stochastic signal we mean one that is described by a random variable. Stochastic iterative learning control (SILC) is defined as ILC for systems that contain stochastic signals including system noises, measurement noises, random packet losses, etc. This manuscript surveys the current state of the art in SILC from the perspective of key techniques, which are divided into three parts: SILC for linear stochastic systems, SILC for nonlinear stochastic systems, and systems with other stochastic signals. In addition, three promising directions are also provided, namely stochastic ILC for point-to-point control, stochastic ILC for iteration-varying reference tracking, and decentralized/distributed coordinated stochastic ILC, respectively.

[1]  Shangtai Jin,et al.  Data-driven optimal terminal iterative learning control , 2012 .

[2]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[3]  Chiang-Ju Chien,et al.  An output-based adaptive iterative learning controller for high relative degree uncertain linear systems , 2004, Autom..

[4]  Dong Shen,et al.  A Kiefer‐Wolfowitz Algorithm Based Iterative Learning Control for Hammerstein‐Wiener Systems , 2012 .

[5]  Marlin H. Mickle,et al.  Learning control algorithms for tracking "slowly" varying trajectories , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Kevin L. Moore,et al.  Iterative learning control in optimal tracking problems with specified data points , 2013, Autom..

[7]  Zhang Li.  Study on the Application of Iterative Learning Control to Terminal Control of Linear Time-varying Systems , 2005 .

[8]  Mikael Norrlöf,et al.  DISTURBANCE REJECTION USING AN ILC ALGORITHM WITH ITERATION VARYING FILTERS , 2004 .

[9]  Samer S. Saab.  Optimality of first-order ILC among higher order ILC , 2006, IEEE Transactions on Automatic Control.

[10]  Tommy W. S. Chow,et al.  2-D system theory based iterative learning control for linear continuous systems with time delays , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  王福忠,et al.  Iterative learning control for a class of nonlinear systems with measurement dropouts , 2012 .

[12]  Jian-Xin Xu,et al.  RECURSIVE DIRECT LEARNING OF CONTROL EFFORTS FOR TRAJECTORIES WITH DIFFERENT MAGNITUDE SCALES , 2008 .

[13]  Jian-Xin Xu,et al.  Direct learning of control efforts for trajectories with different magnitude scales , 1997, Autom..

[14]  John Hauser,et al.  Learning control for a class of nonlinear systems , 1987, 26th IEEE Conference on Decision and Control.

[15]  Chiang-Ju Chien,et al.  Design and Analysis of Fuzzy-Neural Discrete Adaptive Iterative Learning Control for Nonlinear Plants , 2013 .

[16]  David H. Owens,et al.  Norm-Optimal Iterative Learning Control With Intermediate Point Weighting: Theory, Algorithms, and Experimental Evaluation , 2013, IEEE Transactions on Control Systems Technology.

[17]  Kevin L. Moore,et al.  Multi-agent coordination by iterative learning control: Centralized and decentralized strategies , 2011, 2011 IEEE International Symposium on Intelligent Control.

[18]  Jian-Xin Xu,et al.  On iterative learning from different tracking tasks in the presence of time-varying uncertainties , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Kevin L. Moore,et al.  Iterative learning control and repetitive control in hard disk drive industry—A tutorial , 2008 .

[20]  Eric Rogers,et al.  Iterative Learning Control for Multiple Point-to-Point Tracking Application , 2011, IEEE Transactions on Control Systems Technology.

[21]  Masaru Uchiyama,et al.  Formation of High-Speed Motion Pattern of a Mechanical Arm by Trial , 1978 .

[22]  Jianxin Xu,et al.  Linear and Nonlinear Iterative Learning Control , 2003 .

[23]  Jian-Xin Xu,et al.  Initial state iterative learning for final state control in motion systems , 2008, Autom..

[24]  Junping Du,et al.  Robust iterative learning control design for uncertain time-delay systems based on a performance index , 2010 .

[25]  Chris Freeman,et al.  Constrained Point-to-Point Iterative Learning Control with Experimental Verification , 2012 .

[26]  Jian-Xin Xu.  Direct learning of control efforts for trajectories with different time scales , 1998 .

[27]  Han-Fu Chen,et al.  Output tracking for nonlinear stochastic systems by iterative learning control , 2004, IEEE Transactions on Automatic Control.

[28]  Junping Du,et al.  Robust learning controller design for MIMO stochastic discrete‐time systems: An H∞‐based approach , 2011 .

[29]  Han Ding,et al.  Point-to-Point Motion Control for a High-Acceleration Positioning Table via Cascaded Learning Schemes , 2007, IEEE Transactions on Industrial Electronics.

[30]  G Gauthier,et al.  Robust design of Terminal ILC with an Internal Model Control using μ-analysis and a genetic algorithm approach , 2010, Proceedings of the 2010 American Control Conference.

[31]  K. Moore,et al.  Iterative Learning Control: Robustness and Monotonic Convergence for Interval Systems , 2010 .

[32]  S. Saab.  A stochastic iterative learning control algorithm with application to an induction motor , 2004 .

[33]  Chiang-Ju Chien,et al.  A Combined Adaptive Law for Fuzzy Iterative Learning Control of Nonlinear Systems With Varying Control Tasks , 2008, IEEE Transactions on Fuzzy Systems.

[34]  Han-Fu Chen,et al.  Iterative learning control for large scale nonlinear systems with observation noise , 2012, Autom..

[35]  Hyo-Sung Ahn,et al.  Special issue on “iterative learning control” , 2011 .

[36]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[37]  Tong Heng Lee,et al.  Terminal iterative learning control with an application to RTPCVD thickness control , 1999, Autom..

[38]  Hyo-Sung Ahn,et al.  Formation control of mobile agents based on inter-agent distance dynamics , 2011, Autom..

[39]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[40]  Jian-Xin Xu,et al.  A survey on iterative learning control for nonlinear systems , 2011, Int. J. Control.

[41]  Ying Tan,et al.  Iterative Learning Control With Mixed Constraints for Point-to-Point Tracking , 2013, IEEE Transactions on Control Systems Technology.

[42]  Zeungnam Bien,et al.  Iterative learning control: analysis, design, integration and applications , 1998 .

[43]  Svante Gunnarsson,et al.  On the disturbance properties of high order iterative learning control algorithms , 2006, Autom..

[44]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[45]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[46]  Jian-Xin Xu,et al.  An ILC scheme for a class of nonlinear continuous‐time systems with time‐iteration‐varying parameters subject to second‐order internal model , 2011 .

[47]  Dong Shen,et al.  Iterative learning control for stochastic point-to-point tracking system , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[48]  Eric Rogers,et al.  Iterative learning control applied to a gantry robot and conveyor system , 2010 .

[49]  Javier Alonso-Mora,et al.  Limited benefit of joint estimation in multi‐agent iterative learning , 2012 .

[50]  John J. Craig,et al.  Adaptive control of manipulators through repeated trials , 1984 .

[51]  G. Gauthier,et al.  High order robust Terminal Iterative Learning Control design using Genetic Algorithm , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[52]  Han-Fu Chen,et al.  Identification and Stochastic Adaptive Control , 1991 .

[53]  O. Bosgra,et al.  Residual vibration suppression using Hankel iterative learning control , 2006, 2006 American Control Conference.

[54]  Samer S. Saab.  Selection of the learning gain matrix of an iterative learning control algorithm in presence of measurement noise , 2005, IEEE Transactions on Automatic Control.

[55]  Kevin L. Moore,et al.  Trajectory‐keeping in satellite formation flying via robust periodic learning control , 2010 .

[56]  Masayoshi Tomizuka,et al.  An Iterative Learning Control design for Self-ServoWriting in Hard Disk Drives , 2010 .

[58]  S. Saab.  Stochastic P-type/D-type iterative learning control algorithms , 2003 .

[59]  Gong-You Tang,et al.  PD-type iterative learning control for nonlinear time-delay system with external disturbance 1 1 This project was supported by the National Natural Science Foundation of China (60074001) and the Natural Science Foundation of Shandong Province (Y2000G02). , 2006 .

[60]  Kevin L. Moore,et al.  Discrete-time Intermittent Iterative Learning Controller with Independent Data Dropouts , 2008 .

[61]  Han-Fu Chen,et al.  A Kiefer-Wolfowitz algorithm with randomized differences , 1999, IEEE Trans. Autom. Control..

[62]  Ying Tan,et al.  Unified iterative learning control schemes for nonlinear dynamic systems with nonlinear input uncertainties , 2012, Autom..

[63]  YangQuan Chen,et al.  Iterative Learning Control: Convergence, Robustness and Applications , 1999 .

[64]  Yang Liu,et al.  An iterative learning approach to formation control of multi-agent systems , 2012, Syst. Control. Lett..

[65]  Benoit Boulet,et al.  Terminal Iterative Learning Control design with singular value decomposition decoupling for thermoforming ovens , 2009, 2009 American Control Conference.

[66]  Samer S. Saab.  Optimal selection of the forgetting matrix into an iterative learning control algorithm , 2005, IEEE Transactions on Automatic Control.

[67]  Xuhui Bu,et al.  Iterative learning control for a class of nonlinear systems with random packet losses , 2013 .

[68]  Eun Jeong Lee,et al.  Design of learning input shaping technique for residual vibration suppression in an industrial robot , 2006 .

[69]  YangQuan Chen,et al.  Intermittent iterative learning control , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[70]  Alireza Karimi,et al.  A statistical analysis of certain iterative learning control algorithms , 2008, Int. J. Control.

[71]  K. Moore,et al.  Editorial: Special issue on iterative learning control , 2000 .

[72]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[73]  Han-Fu Chen,et al.  Almost sure convergence of iterative learning control for stochastic systems , 2003, Science in China Series F.

[74]  Tong Duy Son,et al.  Terminal iterative learning control with multiple intermediate pass points , 2011, Proceedings of the 2011 American Control Conference.

[75]  YangQuan Chen,et al.  A high-order terminal iterative learning control scheme [RTP-CVD application] , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[76]  Deyuan Meng,et al.  Iterative learning approaches to design finite-time consensus protocols for multi-agent systems , 2012, Syst. Control. Lett..

[77]  D. Shen,et al.  Iterative learning control for non-linear systems with deadzone input and time delay in presence of measurement noise , 2011 .

[78]  Madhukar Pandit,et al.  CONVERGENCE AND ROBUSTNESS OF ITERATIVE LEARNING CONTROL FOR STRONGLY POSITIVE SYSTEMS , 2008 .

[79]  Dong Shen,et al.  Iterative Learning Control With Unknown Control Direction: A Novel Data-Based Approach , 2011, IEEE Transactions on Neural Networks.

[80]  Xuhui Bu,et al.  Stability of first and high order iterative learning control with data dropouts , 2011 .

[81]  Han-Fu Chen.  Stochastic approximation and its applications , 2002 .

[82]  Samer S. Saab,et al.  A discrete-time stochastic learning control algorithm , 2001, IEEE Trans. Autom. Control..

[83]  Zhongsheng Hou,et al.  Adaptive ILC for a class of discrete-time systems with iteration-varying trajectory and random initial condition , 2008, Autom..

[84]  A.G. Alleyne,et al.  Iterative Learning Control for robotic deposition using machine vision , 2008, 2008 American Control Conference.

[85]  Francis J. Doyle,et al.  Survey on iterative learning control, repetitive control, and run-to-run control , 2009 .

[86]  A. Tayebi,et al.  Robust Iterative Learning Control Design: Application to a Robot Manipulator , 2008, IEEE/ASME Transactions on Mechatronics.

[87]  Tao Tang,et al.  Terminal iterative learning control based station stop control of a train , 2011, Int. J. Control.

[88]  Deyuan Meng,et al.  Finite-time consensus for multi-agent systems via terminal feedback iterative learning , 2011 .

[89]  Tao Liu,et al.  IMC-based iterative learning control for batch processes with uncertain time delay , 2010 .

[90]  Ying Tan,et al.  Point-to-point iterative learning control with mixed constraints , 2011, Proceedings of the 2011 American Control Conference.

[91]  Max Donath,et al.  American Control Conference , 1993 .

[92]  Ying Tan,et al.  Iterative learning control and repetitive control , 2011, Int. J. Control.

[93]  Furong Gao,et al.  Robust two-dimensional iterative learning control for batch processes with state delay and time-varying uncertainties , 2010 .

[94]  Junping Du,et al.  Tracking control over a finite interval for multi-agent systems with a time-varying reference trajectory , 2012, Syst. Control. Lett..

[95]  Na Li,et al.  Convergence analysis in sense of Lebesgue-p norm of decentralized non-repetitive iterative learning control for linear large-scale systems , 2009, J. Syst. Sci. Complex..

[96]  Kevin L. Moore,et al.  Stability of discrete-time iterative learning control with random data dropouts and delayed controlled signals in networked control systems , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[97]  Xiaoe Ruan,et al.  Decentralized Iterative Learning Controllers for Nonlinear Large-scale Systems to Track Trajectories with Different Magnitudes , 2008 .

[98]  Xuhui Bu,et al.  H∞ iterative learning controller design for a class of discrete-time systems with data dropouts , 2014, Int. J. Syst. Sci..

[99]  Jun Wu,et al.  Iterative learning control for network systems with communication delay or data dropout , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.