Output Feedback Stable Stochastic Predictive Control With Hard Control Constraints

We present a stochastic predictive controller for discrete time linear time invariant systems under incomplete state information. Our approach is based on a suitable choice of control policies, stability constraints, and employment of a Kalman filter to estimate the states of the system from incomplete and corrupt observations. We demonstrate that this approach yields a computationally tractable problem that should be solved online periodically, and that the resulting closed loop system is mean-square bounded for any positive bound on the control actions. Our results allow one to tackle the largest class of linear time invariant systems known to be amenable to stochastic stabilization under bounded control actions via output feedback stochastic predictive control.

[1]  John Lygeros,et al.  Stochastic receding horizon control with output feedback and bounded controls , 2012, Autom..

[2]  Basil Kouvaritakis,et al.  Stochastic tube MPC with state estimation , 2012, Autom..

[3]  Dimitris Bertsimas,et al.  Constrained Stochastic LQC: A Tractable Approach , 2007, IEEE Transactions on Automatic Control.

[4]  Pablo A. Parrilo,et al.  Optimality of affine policies in multi-stage robust optimization , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[5]  R. Pemantle,et al.  Moment conditions for a sequence with negative drift to be uniformly bounded in Lr , 1999, math/0404093.

[6]  Pablo A. Parrilo,et al.  Optimality of Affine Policies in Multistage Robust Optimization , 2009, Math. Oper. Res..

[7]  John Lygeros,et al.  On Stability and Performance of Stochastic Predictive Control Techniques , 2013, IEEE Transactions on Automatic Control.

[8]  David Q. Mayne,et al.  Robust output feedback model predictive control of constrained linear systems , 2006, Autom..

[9]  John Lygeros,et al.  Stochastic Receding Horizon Control With Bounded Control Inputs: A Vector Space Approach , 2009, IEEE Transactions on Automatic Control.

[10]  A. Mesbah,et al.  Stochastic Model Predictive Control: An Overview and Perspectives for Future Research , 2016, IEEE Control Systems.

[11]  John Lygeros,et al.  On mean square boundedness of stochastic linear systems with bounded controls , 2012, Syst. Control. Lett..

[12]  Daniel E. Quevedo,et al.  Stabilizing Stochastic Predictive Control Under Bernoulli Dropouts , 2016, IEEE Transactions on Automatic Control.

[13]  Stephen P. Boyd,et al.  Design of Affine Controllers via Convex Optimization , 2010, IEEE Transactions on Automatic Control.

[14]  Marcello Farina,et al.  An approach to output-feedback MPC of stochastic linear discrete-time systems , 2015, Autom..

[15]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[16]  Kim-Chuan Toh,et al.  On the Implementation and Usage of SDPT3 – A Matlab Software Package for Semidefinite-Quadratic-Linear Programming, Version 4.0 , 2012 .

[17]  D. Bernstein.  Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[18]  D. Simon.  Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[19]  O. Bosgra,et al.  A full solution to the constrained stochastic closed-loop MPC problem via state and innovations feedback and its receding horizon implementation , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[20]  Jun Yan,et al.  Incorporating state estimation into model predictive control and its application to network traffic control , 2005, Autom..

[21]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[22]  J. Lygeros,et al.  Stable stochastic receding horizon control of linear systems with bounded control inputs , 2010 .

[23]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[24]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..