Learning-Based Robust Model Predictive Control with State-Dependent Uncertainty

Abstract A robust model predictive control (RMPC) approach for linear systems with bounded state-dependent uncertainties is proposed. Such uncertainties can arise from unmodeled non-linearities or external disturbances, for example. By explicitly considering the state dependency of the uncertainty sets in the RMPC approach, it is shown how closed-loop performance can be improved over existing approaches that consider worst-case uncertainty. Being able to handle state-dependent uncertainties is particularly relevant in learning-based MPC where the system model is learned from data and confidence in the model typically varies over the state space. The efficacy of the proposed approach for learning-based RMPC is illustrated with a numerical example, where uncertainty sets are obtained from data using Gaussian Process regression.

[1]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[2]  Fakhrul Alam,et al.  Gaussian Process Model Predictive Control of an Unmanned Quadrotor , 2016, Journal of Intelligent & Robotic Systems.

[3]  Carlos Canudas de Wit,et al.  Friction Models and Friction Compensation , 1998, Eur. J. Control.

[4]  S. Shankar Sastry,et al.  Provably safe and robust learning-based model predictive control , 2011, Autom..

[5]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[6]  Thomas Parisini,et al.  Robust Model Predictive Control of Nonlinear Systems With Bounded and State-Dependent Uncertainties , 2009, IEEE Transactions on Automatic Control.

[7]  Stephen J. Wright,et al.  Nonlinear Predictive Control and Moving Horizon Estimation — An Introductory Overview , 1999 .

[8]  David Q. Mayne,et al.  Robust model predictive control of constrained linear systems with bounded disturbances , 2005, Autom..

[9]  L. Grüne,et al.  Nonlinear Model Predictive Control : Theory and Algorithms. 2nd Edition , 2011 .

[10]  Kumpati S. Narendra,et al.  Gradient methods for the optimization of dynamical systems containing neural networks , 1991, IEEE Trans. Neural Networks.

[11]  Angela P. Schoellig,et al.  Learning-based nonlinear model predictive control to improve vision-based mobile robot path-tracking in challenging outdoor environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Luigi Chisci,et al.  Systems with persistent disturbances: predictive control with restricted constraints , 2001, Autom..

[13]  Alberto Bemporad,et al.  Robust model predictive control: A survey , 1998, Robustness in Identification and Control.