RLO-MPC: Robust Learning-Based Output Feedback MPC for Improving the Performance of Uncertain Systems in Iterative Tasks

In this work we address the problem of performing a repetitive task when we have uncertain observations and dynamics. We formulate this problem as an iterative infinite horizon optimal control problem with output feedback. Previously, this problem was solved for linear time-invariant (LTI) system for the case when noisy full-state measurements are available using a robust iterative learning control framework, which we refer to as robust learning-based model predictive control (RL-MPC). However, this work does not apply to the case when only noisy observations of part of the state are available. This limits the applicability of current approaches in practice: First, in practical applications we typically do not have access to the full state. Second, uncertainties in the observations, when not accounted for, can lead to instability and constraint violations. To overcome these limitations, we propose a combination of RL-MPC with robust output feedback model predictive control, named robust learning-based output feedback model predictive control (RLO-MPC). We show recursive feasibility and stability, and prove theoretical guarantees on the performance over iterations. We validate the proposed approach with a numerical example in simulation and a quadrotor stabilization task in experiments.

[1]  Jay H. Lee,et al.  Convergence of constrained model-based predictive control for batch processes , 2000, IEEE Trans. Autom. Control..

[2]  Frank Allgöwer,et al.  Min-max output feedback predictive control with guaranteed stability , 2022 .

[3]  Marco Pavone,et al.  A Simple and Efficient Tube-based Robust Output Feedback Model Predictive Control Scheme , 2019, 2020 European Control Conference (ECC).

[4]  Johan Löfberg,et al.  TOWARDS JOINT STATE ESTIMATION AND CONTROL IN MINIMAX MPC , 2002 .

[5]  Francesco Borrelli,et al.  Learning Model Predictive Control for Iterative Tasks. A Data-Driven Control Framework , 2016, IEEE Transactions on Automatic Control.

[6]  Francesco Borrelli,et al.  Autonomous racing using learning Model Predictive Control , 2016, 2017 American Control Conference (ACC).

[7]  Rolf Findeisen,et al.  Robust output feedback MPC for uncertain linear systems with reduced conservatism , 2017 .

[8]  Xiaojing Zhang,et al.  Robust learning model predictive control for iterative tasks: Learning from experience , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[9]  Ugo Rosolia,et al.  Robust Learning Model Predictive Control for Linear Systems , 2019, ArXiv.

[10]  Francesco Borrelli,et al.  Learning Model Predictive Control for Iterative Tasks: A Computationally Efficient Approach for Linear System , 2017, ArXiv.

[11]  Christopher D. McKinnon,et al.  Learn Fast, Forget Slow: Safe Predictive Learning Control for Systems With Unknown and Changing Dynamics Performing Repetitive Tasks , 2018, IEEE Robotics and Automation Letters.

[12]  Raffaello D'Andrea,et al.  Optimization-based iterative learning for precise quadrocopter trajectory tracking , 2012, Autonomous Robots.

[13]  Jay H. Lee,et al.  Model predictive control technique combined with iterative learning for batch processes , 1999 .

[14]  Basil Kouvaritakis,et al.  Model Predictive Control: Classical, Robust and Stochastic , 2015 .

[15]  Angela P. Schoellig,et al.  Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning , 2021, Annu. Rev. Control. Robotics Auton. Syst..

[16]  J. R. Cueli,et al.  Iterative nonlinear model predictive control. Stability, robustness and applications , 2008 .

[17]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[18]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[19]  João Pedro Hespanha,et al.  Simultaneous nonlinear model predictive control and state estimation , 2017, Autom..

[20]  Manfred Morari,et al.  Multi-Parametric Toolbox 3.0 , 2013, 2013 European Control Conference (ECC).

[21]  David Q. Mayne,et al.  Robust model predictive control of constrained linear systems with bounded disturbances , 2005, Autom..

[22]  David Q. Mayne,et al.  Invariant approximations of the minimal robust positively Invariant set , 2005, IEEE Transactions on Automatic Control.