Approximate moving horizon estimation and robust nonlinear model predictive control via deep learning

Abstract Optimization-based methods for output-feedback control enable dealing with multiple-input and multiple-output nonlinear systems in the presence of uncertainties and constraints. The combination of moving horizon estimation (MHE) and nonlinear model predictive control (NMPC) can be especially powerful because of its general formulation but its implementation requires solving two optimization problems at every sampling instant, which can be challenging due to hardware or time constraints. We propose to take advantage of the expressive capabilities of deep neural networks to approximate the solution of the MHE and NMPC problems. By substituting the MHE and NMPC with their learning-based counterparts, the required online computations are significantly reduced. We also propose to use sensitivity analysis to compute an approximate upper-bound of the maximum one-step divergence from the optimal performance caused by the approximation error. The efficacy of the proposed learning-based approach is illustrated with simulation results of a semi-batch reactor for industrial polymerization.

[1]  Tor Arne Johansen,et al.  Approximate explicit receding horizon control of constrained nonlinear systems , 2004, Autom..

[2]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[3]  Lorenz T. Biegler,et al.  Advanced-step Multistage Nonlinear Model Predictive Control , 2018 .

[4]  Anthony V. Fiacco,et al.  Introduction to Sensitivity and Stability Analysis in Nonlinear Programming , 2012 .

[5]  Vijay Kumar,et al.  Approximating Explicit Model Predictive Control Using Constrained Neural Networks , 2018, 2018 Annual American Control Conference (ACC).

[6]  Daniel Limon,et al.  Stability properties of multi-stage nonlinear model predictive control , 2020, Syst. Control. Lett..

[7]  Sigurd Skogestad,et al.  Real-Time Optimization under Uncertainty Applied to a Gas Lifted Well Network , 2016 .

[8]  Denis Navarro,et al.  Deep Learning-Based Model Predictive Control for Resonant Power Converters , 2018, IEEE Transactions on Industrial Informatics.

[9]  Thomas Parisini,et al.  A receding-horizon regulator for nonlinear systems and a neural approximation , 1995, Autom..

[10]  Benjamin Karg,et al.  Efficient Representation and Approximation of Model Predictive Control Laws via Deep Learning , 2018, IEEE Transactions on Cybernetics.

[11]  Benjamin Karg,et al.  Learning-based approximation of robust nonlinear predictive control with state estimation applied to a towing kite , 2019, 2019 18th European Control Conference (ECC).

[12]  F. James,et al.  Multidimensional sampling for simulation and integration: measures, discrepancies, and quasi-random numbers , 1996, hep-ph/9606309.

[13]  Teodoro Alamo,et al.  Probabilistic performance validation of deep learning‐based robust NMPC controllers , 2019, International Journal of Robust and Nonlinear Control.

[14]  Sebastian Engell,et al.  A Synergistic Approach to Robust Output Feedback Control: Tube-based Multi-stage NMPC , 2018 .

[15]  Benjamin Karg,et al.  A deep learning-based approach to robust nonlinear model predictive control , 2018 .

[16]  Carol S. Woodward,et al.  Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers , 2020, ACM Trans. Math. Softw..

[17]  D. Mayne,et al.  Min-max feedback model predictive control for constrained linear systems , 1998, IEEE Trans. Autom. Control..

[18]  David Q. Mayne,et al.  Robust model predictive control of constrained linear systems with bounded disturbances , 2005, Autom..

[19]  Alberto Bemporad,et al.  Scenario-based model predictive control of stochastic constrained linear systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[20]  Alberto Bemporad,et al.  The explicit linear quadratic regulator for constrained systems , 2003, Autom..

[21]  Benjamin Karg,et al.  Deep learning-based embedded mixed-integer model predictive control , 2018, 2018 European Control Conference (ECC).

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[24]  Frank Allgöwer,et al.  Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Control , 2020, IEEE Robotics and Automation Letters.

[25]  Sebastian Engell,et al.  Rapid development of modular and sustainable nonlinear model predictive control solutions , 2017 .

[26]  Sebastian Engell,et al.  Multi-stage nonlinear model predictive control applied to a semi-batch polymerization reactor under uncertainty , 2013 .

[27]  Tor Arne Johansen,et al.  Flexible Piecewise Function Evaluation Methods Based on Truncated Binary Search Trees and Lattice Representation in Explicit MPC , 2012, IEEE Transactions on Control Systems Technology.

[28]  Sebastian Engell,et al.  Economics optimizing control of a multi-product reactive distillation process under model uncertainty , 2018, Comput. Chem. Eng..

[29]  Moritz Diehl,et al.  Handling uncertainty in economic nonlinear model predictive control: A comparative case study , 2014 .

[30]  Benjamin Karg,et al.  Stability and feasibility of neural network-based controllers via output range analysis , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[31]  Frank Allgöwer,et al.  Learning an Approximate Model Predictive Controller With Guarantees , 2018, IEEE Control Systems Letters.

[32]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[33]  Zhenghong Yu,et al.  Worst-case formulations of model predictive control for systems with bounded parameters , 1997, Autom..

[34]  Bjarne Foss,et al.  Improving Scenario Decomposition for Multistage MPC Using a Sensitivity-Based Path-Following Algorithm , 2018, IEEE Control Systems Letters.

[35]  Roberto Tempo,et al.  Randomized methods for design of uncertain systems: Sample complexity and sequential algorithms , 2013, Autom..