Safe Learning-based Model Predictive Control under State- and Input-dependent Uncertainty using Scenario Trees

The complex and uncertain dynamics of emerging systems pose several unique challenges that need to be overcome in order to design high-performance controllers. A key challenge is that safety is often achieved at the expense of closed-loop performance. This is particularly important when the uncertainty description is provided in the form of a bounded set that is estimated offline from limited data. Replacing this bounded set with a learned state- and input-dependent uncertainty enables representing the the variation of uncertainty in the model throughout the state space, thus improving closed-loop performance. Gaussian process (GP) models are a good candidate for learning such a representation; however, they produce a nonlinear and nonconvex description of the uncertainty set that is difficult to incorporate into currently available robust model predictive control (MPC) frameworks. In this work, we present a learning- and scenario-based MPC (L-sMPC) strategy that systematically accounts for feedback in the prediction using a state- and input-dependent scenario tree computed from a GP uncertainty model. To ensure that the closed-loop system evolution remains safe, we also propose a projection-based safety certification scheme that ensures the control inputs keep the system within an appropriately defined invariant set. The advantages of the proposed L-sMPC method in terms of improved performance and an enlarged feasible region are illustrated on a benchmark double integrator problem.

[1]  D. Mayne,et al.  Computation of invariant sets for piecewise affine discrete time systems subject to bounded disturbances , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  Juraj Kabzan,et al.  Cautious Model Predictive Control Using Gaussian Process Regression , 2017, IEEE Transactions on Control Systems Technology.

[3]  D. Limón,et al.  On the Computation of Robust Control Invariant Sets for Piecewise Affine Systems , 2007 .

[4]  Thomas Gerstner,et al.  Dimension–Adaptive Tensor–Product Quadrature , 2003, Computing.

[5]  Manfred Morari,et al.  Multi-Parametric Toolbox 3.0 , 2013, 2013 European Control Conference (ECC).

[6]  Frank Allgöwer,et al.  Learning-Based Robust Model Predictive Control with State-Dependent Uncertainty , 2018 .

[7]  Stefano Marelli,et al.  UQLab: a framework for uncertainty quantification in MATLAB , 2014 .

[8]  David Q. Mayne,et al.  Robust model predictive control using tubes , 2004, Autom..

[9]  Jaime F. Fisac,et al.  Reachability-based safe learning with Gaussian processes , 2014, 53rd IEEE Conference on Decision and Control.

[10]  David Q. Mayne,et al.  Reachability analysis of discrete-time systems with disturbances , 2006, IEEE Transactions on Automatic Control.

[11]  Joel A. Paulson,et al.  Approximate Closed-Loop Robust Model Predictive Control With Guaranteed Stability and Constraint Satisfaction , 2020, IEEE Control Systems Letters.

[12]  Stephen P. Boyd,et al.  Extensions of Gauss Quadrature Via Linear Programming , 2014, Found. Comput. Math..

[13]  Alberto Bemporad,et al.  Scenario-based model predictive control of stochastic constrained linear systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[14]  Lukas Hewing,et al.  Learning-Based Model Predictive Control: Toward Safe Learning in Control , 2020, Annu. Rev. Control. Robotics Auton. Syst..

[15]  E. Kerrigan Robust Constraint Satisfaction: Invariant Sets and Predictive Control , 2000 .

[16]  Angela P. Schoellig,et al.  Learning-based nonlinear model predictive control to improve vision-based mobile robot path-tracking in challenging outdoor environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Jaime F. Fisac,et al.  A General Safety Framework for Learning-Based Control in Uncertain Robotic Systems , 2017, IEEE Transactions on Automatic Control.

[18]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[19]  Stein W. Wallace,et al.  Generating Scenario Trees for Multistage Decision Problems , 2001, Manag. Sci..

[20]  Francesco Borrelli,et al.  A Learning-Based Framework for Velocity Control in Autonomous Driving , 2016, IEEE Transactions on Automation Science and Engineering.

[21]  Hans Bock,et al.  Quadrature-based scenario tree generation for Nonlinear Model Predictive Control , 2014 .

[22]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[23]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[24]  Sebastian Engell,et al.  Multi-stage nonlinear model predictive control applied to a semi-batch polymerization reactor under uncertainty , 2013 .

[25]  Franco Blanchini,et al.  Set invariance in control , 1999, Autom..

[26]  Bojan Likar,et al.  Predictive control of a gas-liquid separation plant based on a Gaussian process model , 2007, Comput. Chem. Eng..

[27]  S. Shankar Sastry,et al.  Provably safe and robust learning-based model predictive control , 2011, Autom..

[28]  David Q. Mayne,et al.  Robust output feedback model predictive control of constrained linear systems , 2006, Autom..

[29]  Luigi Chisci,et al.  Systems with persistent disturbances: predictive control with restricted constraints , 2001, Autom..

[30]  Ali Mesbah,et al.  Stochastic model predictive control with active uncertainty learning: A Survey on dual control , 2017, Annu. Rev. Control..