Stochastic model predictive control for constrained discrete-time Markovian switching systems

In this paper we study constrained stochastic optimal control problems for Markovian switching systems, an extension of Markovian jump linear systems (MJLS), where the subsystems are allowed to be nonlinear. We develop appropriate notions of invariance and stability for such systems and provide terminal conditions for stochastic model predictive control (SMPC) that guarantee mean-square stability and robust constraint fulfillment of the Markovian switching system in closed-loop with the SMPC law under very weak assumptions. In the special but important case of constrained MJLS we present an algorithm for computing explicitly the SMPC control law off-line, that combines dynamic programming with parametric piecewise quadratic optimization.

[1]  Panagiotis Patrinos,et al.  A new algorithm for solving convex parametric quadratic programs based on graphical derivatives of solution mappings , 2010, Autom..

[2]  D. Sworder.  Feedback control of a class of linear systems with jump parameters , 1969 .

[3]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[4]  E. Kerrigan.  Robust Constraint Satisfaction: Invariant Sets and Predictive Control , 2000 .

[5]  Yannick Blaise,et al.  Impact of mixing imperfections on yeast bioreactor performances: Scale-down reactor concept and related experimental tools , 2012 .

[6]  Fabrizio Zampolli,et al.  Optimal Monetary Policy in a Regime-Switching Economy: The Response to Abrupt Shifts in Exchange Rate Dynamics , 2006 .

[7]  Alberto Bemporad,et al.  Stabilizing Model Predictive Control of Stochastic Constrained Linear Systems , 2012, IEEE Transactions on Automatic Control.

[8]  Dudley,et al.  Real Analysis and Probability: Measurability: Borel Isomorphism and Analytic Sets , 2002 .

[9]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[10]  D. Sworder,et al.  Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria , 1975 .

[11]  David Q. Mayne,et al.  Reachability analysis of discrete-time systems with disturbances , 2006, IEEE Transactions on Automatic Control.

[12]  R. Akella,et al.  Optimal control of production rate in a failure prone manufacturing system , 1985, 1985 24th IEEE Conference on Decision and Control.

[13]  Pantelis Sopasakis,et al.  Stochastic Model Predictive Control for Constrained Networked Control Systems with Random Time Delay , 2011 .

[14]  R. P. Marques,et al.  Discrete-Time Markov Jump Linear Systems , 2004, IEEE Transactions on Automatic Control.

[15]  Alessandro N. Vargas,et al.  Constrained model predictive control of jump linear systems with noise and non-observed Markov state , 2006, 2006 American Control Conference.

[16]  Arturo Tejada,et al.  On nonlinear discrete-time systems driven by Markov chains , 2010, J. Frankl. Inst..

[17]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .

[18]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[19]  L. Ghaoui,et al.  LMI optimization for nonstandard Riccati equations arising in stochastic control , 1996, IEEE Trans. Autom. Control..

[20]  M. Kothare,et al.  Robust constrained model predictive control using linear matrix inequalities , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[21]  G. Nicolao,et al.  On almost sure stability of discrete-time Markov jump linear systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[22]  Hisham Abou-Kandil,et al.  On the solution of discrete-time Markovian jump linear quadratic control problems , 1995, Autom..

[23]  Yuguang Fang,et al.  Stochastic stability of jump linear systems , 2002, IEEE Trans. Autom. Control..

[24]  K. T. Tan,et al.  Linear systems with state and control constraints: the theory and application of maximal output admissible sets , 1991 .

[25]  Alberto Bemporad,et al.  Scenario-based model predictive control of stochastic constrained linear systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[26]  El Kebir Boukas,et al.  Stability of discrete-time linear systems with Markovian jumping parameters , 1995, Math. Control. Signals Syst..

[27]  Ji-Woong Lee,et al.  Uniform stabilization of discrete-time switched and Markovian jump linear systems , 2006, Autom..

[28]  Oswaldo Luiz do Valle Costa,et al.  Constrained quadratic state feedback control of discrete-time Markovian jump linear systems , 1999, Autom..

[29]  W. Wonham.  Random differential equations in control theory , 1970 .

[30]  Panagiotis Patrinos,et al.  Convex parametric piecewise quadratic optimization: Theory and algorithms , 2011, Autom..

[31]  Jamal Daafouz,et al.  Stability analysis and control synthesis for switched systems: a switched Lyapunov function approach , 2002, IEEE Trans. Autom. Control..

[32]  R. Rockafellar,et al.  Implicit Functions and Solution Mappings , 2009 .