Model-Predictive Control of Discrete Hybrid Stochastic Automata

This paper focuses on optimal and receding horizon control of a class of hybrid dynamical systems, called Discrete Hybrid Stochastic Automata (DHSA), whose discrete-state transitions depend on both deterministic and stochastic events. A finite-time optimal control approach “optimistically” determines the trajectory that provides the best tradeoff between tracking performance and the probability of the trajectory to actually execute, under possible chance constraints. The approach is also robustified, less optimistically, to ensure that the system satisfies a set of constraints for all possible realizations of the stochastic events, or alternatively for those having enough probability to realize. Sufficient conditions for asymptotic convergence in probability are given for the receding-horizon implementation of the optimal control solution. The effectiveness of the suggested stochastic hybrid control techniques is shown on a case study in supply chain management.

[1]  Karl Henrik Johansson,et al.  Dynamical properties of hybrid automata , 2003, IEEE Trans. Autom. Control..

[2]  Arjan van der Schaft,et al.  Communicating Piecewise Deterministic Markov Processes , 2003, ADHS.

[3]  J. Hooker,et al.  Logic-Based Methods for Optimization: Combining Optimization and Constraint Satisfaction , 2000 .

[4]  Ari Arapostathis,et al.  Controlled Switching Diffusions as Hybrid Processes , 1995, Hybrid Systems.

[5]  Manfred Morari,et al.  A tractable approximation of chance constrained stochastic MPC based on affine disturbance feedback , 2008, 2008 47th IEEE Conference on Decision and Control.

[6]  John Lygeros,et al.  Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems , 2008, Autom..

[7]  Eduardo Sontag.  Nonlinear regulation: The piecewise linear approach , 1981 .

[8]  T. Alamo,et al.  Stochastic Programming Applied to Model Predictive Control , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[9]  Basil Kouvaritakis,et al.  Stochastic MPC with inequality stability constraints , 2006, Autom..

[10]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[11]  M. Wendt,et al.  Robust model predictive control under chance constraints , 2000 .

[12]  Bart De Schutter,et al.  Equivalence of hybrid dynamical models , 2001, Autom..

[13]  Panos J. Antsaklis,et al.  Special issue on hybrid systems: theory and applications a brief introduction to the theory and applications of hybrid systems , 2000, Proc. IEEE.

[14]  James A. Primbs,et al.  Stochastic Receding Horizon Control of Constrained Linear Systems With State and Control Multiplicative Noise , 2007, IEEE Transactions on Automatic Control.

[15]  John Lygeros,et al.  On stochastic receding horizon control with bounded control inputs , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[16]  Alberto Bemporad,et al.  Observability and controllability of piecewise affine and hybrid systems , 2000, IEEE Trans. Autom. Control..

[17]  Debasish Chatterjee,et al.  On Stability of Randomly Switched Nonlinear Systems , 2007, IEEE Transactions on Automatic Control.

[18]  B. Schutter,et al.  On hybrid systems and closed-loop MPC systems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[19]  S. Sastry,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[20]  Alberto Bemporad,et al.  Stabilizing Model Predictive Control of Hybrid Systems , 2006, IEEE Transactions on Automatic Control.

[21]  El Kebir Boukas,et al.  Stability of discrete-time linear systems with Markovian jumping parameters , 1995, Math. Control. Signals Syst..

[22]  John Lygeros,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[23]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[24]  M. K. Ghosh,et al.  Optimal control of switching diffusions with application to flexible manufacturing systems , 1993 .

[25]  G. Nicolao,et al.  On almost sure stability of discrete-time Markov jump linear systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[26]  Richard C. Larson,et al.  Model Building in Mathematical Programming , 1979 .

[27]  C. Cassandras,et al.  Receding horizon optimal control for some stochastic hybrid systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[28]  S. Weiland,et al.  Optimal control of linear, stochastic systems with state and input constraints , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[29]  Alberto Bemporad,et al.  Dynamic programming for constrained optimal control of discrete-time linear hybrid systems , 2005, Autom..

[30]  J. Lygeros,et al.  Stochastic hybrid systems: Theory and applications , 2008, 2008 Chinese Control and Decision Conference.

[31]  John M. Wilson,et al.  Introduction to Stochastic Programming , 1998, J. Oper. Res. Soc..

[32]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[33]  Anders Rantzer,et al.  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1997, 1997 European Control Conference (ECC).

[34]  John Lygeros,et al.  Reachability Questions in Piecewise Deterministic Markov Processes , 2003, HSCC.

[35]  Daniel E. Rivera,et al.  Simulation-based optimization of process control policies for inventory management in supply chains , 2006, Autom..

[36]  Thomas A. Henzinger,et al.  The theory of hybrid automata , 1996, Proceedings 11th Annual IEEE Symposium on Logic in Computer Science.

[37]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[38]  Masahiro Ono,et al.  Robust, Optimal Predictive Control of Jump Markov Linear Systems Using Particles , 2007, HSCC.

[39]  Alberto Bemporad,et al.  HYSDEL-a tool for generating computational hybrid models for analysis and synthesis problems , 2004, IEEE Transactions on Control Systems Technology.

[40]  W. P. M. H. Heemels,et al.  Comparison of Four Procedures for the Identification of Hybrid Systems , 2005, HSCC.

[41]  Alberto Bemporad,et al.  Hybrid Toolbox for MATLAB - User's Guide , 2003 .

[42]  Alberto Bemporad,et al.  Piecewise linear optimal controllers for hybrid systems , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[43]  John Lygeros,et al.  Stochastic Hybrid Models: An Overview , 2003, ADHS.

[44]  O. Bosgra,et al.  A conic reformulation of Model Predictive Control including bounded and stochastic disturbances under state and input constraints , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[45]  John Lygeros,et al.  A probabilistic approach to aircraft conflict detection , 2000, IEEE Trans. Intell. Transp. Syst..

[46]  Michael Nikolaou,et al.  Chance‐constrained model predictive control , 1999 .

[47]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[48]  Alberto Bemporad,et al.  Scenario-based model predictive control of stochastic constrained linear systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.