Independent vs. joint estimation in multi-agent iterative learning control

This paper studies iterative learning control (ILC) in a multi-agent framework, wherein a group of agents simultaneously and repeatedly perform the same task. The agents improve their performance by using the knowledge gained from previous executions. Assuming similarity between the agents, we investigate whether exchanging information between the agents improves an individual's learning performance. That is, does an individual agent benefit from the experience of the other agents? We consider the multi-agent iterative learning problem as a two-step process of: first, estimating the repetitive disturbance of each agent; and second, correcting for it. We present a comparison of an agent's disturbance estimate in the case of (I) independent estimation, where each agent has access only to its own measurement, and (II) joint estimation, where information of all agents is globally accessible. We analytically derive an upper bound of the performance improvement due to joint estimation. Results are obtained for two limiting cases: (i) pure process noise, and (ii) pure measurement noise. The benefits of information sharing are negligible in (i). For (ii), a performance improvement is observed when a high similarity between the agents is guaranteed.

[1]  Mikael Norrlöf,et al.  DISTURBANCE REJECTION USING AN ILC ALGORITHM WITH ITERATION VARYING FILTERS , 2004 .

[2]  Michel Verhaegen,et al.  Filtering and System Identification: Frontmatter , 2007 .

[3]  Zeungnam Bien,et al.  Iterative learning control: analysis, design, integration and applications , 1998 .

[4]  Andrew G. Alleyne,et al.  A Cross-Coupled Iterative Learning Control Design for Precision Motion Control , 2008, IEEE Transactions on Control Systems Technology.

[5]  Jay H. Lee,et al.  Control of Wafer Temperature Uniformity in Rapid Thermal Processing Using an Optimal Iterative Learning Control Technique , 2001 .

[6]  K. Moore,et al.  Iterative Learning Control: Robustness and Monotonic Convergence for Interval Systems , 2010 .

[7]  Si-Zhao Joe Qin,et al.  A two-stage iterative learning control technique combined with real-time feedback for independent disturbance rejection , 2004, Autom..

[8]  David H. Owens,et al.  Basis functions and parameter optimisation in high-order iterative learning control , 2006, Autom..

[9]  M. Phan,et al.  Higher-order iterative learning control by pole placement and noise filtering , 2002 .

[10]  Jian-Xin Xu,et al.  Iterative Learning Control , 1998 .

[11]  R. Longchamp,et al.  Iterative Learning Control based on Stochastic Approximation , 2008 .

[12]  YangQuan Chen,et al.  Iterative learning control for multi-agent formation , 2009, 2009 ICCAS-SICE.

[13]  Guanrong Chen,et al.  Kalman Filtering with Real-time Applications , 1987 .

[14]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[15]  Michel Verhaegen,et al.  A structured matrix approach to efficient calculation of LQG repetitive learning controllers in the lifted setting , 2010, Int. J. Control.

[16]  Raffaello D'Andrea,et al.  Coordinating Hundreds of Cooperative, Autonomous Vehicles in Warehouses , 2007, AI Mag..

[17]  V. Verdult,et al.  Filtering and System Identification: A Least Squares Approach , 2007 .

[18]  B. Francis,et al.  A lifting technique for linear periodic systems with applications to sampled-data control , 1991 .

[19]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[20]  Jay H. Lee,et al.  Model-based iterative learning control with a quadratic criterion for time-varying linear systems , 2000, Autom..

[21]  Raffaello D'Andrea,et al.  Optimization-based iterative learning control for trajectory tracking , 2009, 2009 European Control Conference (ECC).

[22]  Mikael Norrlöf,et al.  An adaptive iterative learning control algorithm with experiments on an industrial robot , 2002, IEEE Trans. Robotics Autom..

[23]  Richard W. Longman,et al.  A mathematical theory of learning control for linear discrete multivariable systems , 1988 .

[24]  R. Tousain,et al.  Design strategy for iterative learning control based on optimal control , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[25]  Eric Guizzo,et al.  Three Engineers, Hundreds of Robots, One Warehouse , 2008, IEEE Spectrum.