Optimization-based iterative learning for precise quadrocopter trajectory tracking

Current control systems regulate the behavior of dynamic systems by reacting to noise and unexpected disturbances as they occur. To improve the performance of such control systems, experience from iterative executions can be used to anticipate recurring disturbances and proactively compensate for them. This paper presents an algorithm that exploits data from previous repetitions in order to learn to precisely follow a predefined trajectory. We adapt the feed-forward input signal to the system with the goal of achieving high tracking performance—even under the presence of model errors and other recurring disturbances. The approach is based on a dynamics model that captures the essential features of the system and that explicitly takes system input and state constraints into account. We combine traditional optimal filtering methods with state-of-the-art optimization techniques in order to obtain an effective and computationally efficient learning strategy that updates the feed-forward input signal according to a customizable learning objective. It is possible to define a termination condition that stops an execution early if the deviation from the nominal trajectory exceeds a given bound. This allows for a safe learning that gradually extends the time horizon of the trajectory. We developed a framework for generating arbitrary flight trajectories and for applying the algorithm to highly maneuverable autonomous quadrotor vehicles in the ETH Flying Machine Arena testbed. Experimental results are discussed for selected trajectories and different learning algorithm parameters.

[1]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[3]  Guanrong Chen,et al.  Kalman Filtering with Real-time Applications , 1987 .

[4]  Richard W. Longman,et al.  A mathematical theory of learning control for linear discrete multivariable systems , 1988 .

[5]  Guanrong Chen,et al.  Kalman filtering: with real-time applications (2nd ed.) , 1991 .

[6]  B. Francis,et al.  A lifting technique for linear periodic systems with applications to sampled-data control , 1991 .

[7]  E. Rogers,et al.  Iterative learning control using optimal feedback and feedforward actions , 1996 .

[8]  K. Moore Multi-loop control approach to designing iterative learning controllers , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[9]  YangQuan Chen,et al.  Iterative Learning Control: Convergence, Robustness and Applications , 1999 .

[10]  Richard W. Longman,et al.  Iterative learning control and repetitive control for engineering practice , 2000 .

[11]  Jay H. Lee,et al.  Control of Wafer Temperature Uniformity in Rapid Thermal Processing Using an Optimal Iterative Learning Control Technique , 2000 .

[12]  A. Piazzi,et al.  Quintic G/sup 2/-splines for trajectory planning of autonomous vehicles , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[13]  R. Tousain,et al.  Design strategy for iterative learning control based on optimal control , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[14]  Svante Gunnarsson,et al.  Time and frequency domain convergence properties in iterative learning control , 2002 .

[15]  Si-Zhao Joe Qin,et al.  A two-stage iterative learning control technique combined with real-time feedback for independent disturbance rejection , 2004, Autom..

[16]  Abdelaziz Benallegue,et al.  Dynamic feedback controller of Euler angles and wind parameters estimation for a quadrotor unmanned aerial vehicle , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[17]  Feng-Li Lian,et al.  Study of feasible trajectory generation algorithms for control of planar mobile robots , 2005, 2005 IEEE International Conference on Robotics and Biomimetics - ROBIO.

[18]  Steven Lake Waslander,et al.  Multi-agent quadrotor testbed control design: integral sliding mode vs. reinforcement learning , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  K. Lee,et al.  Semi-empirical model-based multivariable iterative learning control of an RTP system , 2005 .

[20]  Roland Siegwart,et al.  Backstepping and Sliding-mode Techniques Applied to an Indoor Micro Quadrotor , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[21]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[22]  Robert Mahony,et al.  Modelling and control of a quad-rotor robot , 2006 .

[23]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[24]  Abdelaziz Benallegue,et al.  Backstepping Control for a Quadrotor Helicopter , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Gerd Hirzinger,et al.  Energy-efficient Autonomous Four-rotor Flying Robot Controlled at 1 kHz , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[26]  James F. Whidborne,et al.  A prototype of an autonomous controller for a quadrotor UAV , 2007, 2007 European Control Conference (ECC).

[27]  K.P. Valavanis,et al.  Unmanned helicopter waypoint trajectory tracking using model predictive control , 2007, 2007 Mediterranean Conference on Control & Automation.

[28]  Claire J. Tomlin,et al.  Quadrotor Helicopter Trajectory Tracking Control , 2008 .

[29]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[30]  Y. Bouktir,et al.  Trajectory planning for a quadrotor helicopter , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[31]  G.V. Raffo,et al.  Backstepping/nonlinear H∞ control for path tracking of a quadrotor unmanned aerial vehicle , 2008, 2008 American Control Conference.

[32]  Oliver Purwin,et al.  Performing aggressive maneuvers using iterative learning control , 2009, 2009 IEEE International Conference on Robotics and Automation.

[33]  Dule Shu,et al.  Robust tracking control of an underactuated quadrotor aerial-robot based on a parametric uncertain model , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[34]  Raffaello D'Andrea,et al.  Optimization-based iterative learning control for trajectory tracking , 2009, 2009 European Control Conference (ECC).

[35]  Saif A. Al-Hiddabi,et al.  Quadrotor control using feedback linearization with dynamic extension , 2009, 2009 6th International Symposium on Mechatronics and its Applications.

[36]  J. Bokor,et al.  Discrete time minimax tracking control with state and disturbance estimation II: Time-varying reference and disturbance signals , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[37]  Steven Lake Waslander,et al.  Aerodynamics and control of autonomous quadrotor helicopters in aggressive maneuvering , 2009, 2009 IEEE International Conference on Robotics and Automation.

[38]  Jing Chen,et al.  Trajectory generation for aircraft based on differential flatness and spline theory , 2010, 2010 International Conference on Information, Networking and Automation (ICINA).

[39]  Youmin Zhang,et al.  Dead reckoning and Kalman filter design for trajectory tracking of a quadrotor UAV , 2010, Proceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications.

[40]  Vijay Kumar,et al.  The GRASP Multiple Micro-UAV Testbed , 2010, IEEE Robotics & Automation Magazine.

[41]  Sarangapani Jagannathan,et al.  Output Feedback Control of a Quadrotor UAV Using Neural Networks , 2010, IEEE Transactions on Neural Networks.

[42]  Anthony Tzes,et al.  Constrained-control of a quadrotor helicopter for trajectory tracking under wind-gust disturbances , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[43]  Bing Zhu,et al.  Trajectory Linearization Control for a quadrotor helicopter , 2010, IEEE ICCA 2010.

[44]  Vijay Kumar,et al.  Trajectory Generation and Control for Precise Aggressive Maneuvers with Quadrotors , 2010, ISER.

[45]  Michel Verhaegen,et al.  A structured matrix approach to efficient calculation of LQG repetitive learning controllers in the lifted setting , 2010, Int. J. Control.

[46]  Youmin Zhang,et al.  Design of feedback linearization control and reconfigurable control allocation with application to a quadrotor UAV , 2010, 2010 Conference on Control and Fault-Tolerant Systems (SysTol).

[47]  K. Moore,et al.  Iterative Learning Control: Robustness and Monotonic Convergence for Interval Systems , 2010 .

[48]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.

[49]  Zongyu Zuo,et al.  Trajectory tracking control design with command-filtered compensation for a quadrotor , 2010 .

[50]  Raffaello D'Andrea,et al.  Quadrocopter performance benchmarking using optimal control , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Sandipan Mishra,et al.  Robust Iterative Learning Control: L1 adaptive feedback control in an ILC framework , 2011, Proceedings of the 2011 American Control Conference.

[52]  Chris J. B. Macnab,et al.  Robust adaptive control of a quadrotor helicopter , 2011 .

[53]  Bin Xian,et al.  A nonlinear adaptive control approach for quadrotor UAVs , 2011, 2011 8th Asian Control Conference (ASCC).

[54]  R. D’Andrea,et al.  Adaptive Open-Loop Aerobatic Maneuvers for Quadrocopters , 2011 .