Linear controller design for chance constrained systems

This paper is concerned with the design of a linear control law for a linear system with stationary additive disturbances. The objective is to find a state feedback gain that minimizes a quadratic stage cost function, while observing chance constraints on the input and/or the state. Unlike most of the previous literature, the chance constraints (and the stage cost) are not considered on each input/state of the transient response. Instead, they refer to the input/state of the closed-loop system in its stationary mode of operation. Hence the control is optimized for the long-run, rather than for finite-horizon operation. The controller synthesis problem can be cast as a convex semi-definite program (SDP). The chance constraints appear as linear matrix inequalities. Both single chance constraints (SCCs) and joint chance constraints (JCCs) on the input and/or the state can be included. If the disturbance is Gaussian, this information can be used to improve the controller design. The presented approach can also be extended to the case of output feedback. The entire design procedure is flexible and easy to implement, as demonstrated on a short illustrative example.

[1]  I. Miller.  Probability, Random Variables, and Stochastic Processes , 1966 .

[2]  Diederich Hinrichsen,et al.  Control of Uncertain Systems , 1990 .

[3]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .

[4]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[5]  Stephen P. Boyd,et al.  The CVX Users' Guide , 2015 .

[6]  G. Calafiore,et al.  On Distributionally Robust Chance-Constrained Linear Programs , 2006 .

[7]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[8]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[9]  Manfred Morari,et al.  A unified framework for the study of anti-windup designs , 1994, Autom..

[10]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[11]  James A. Primbs.  A soft constraint approach to stochastic receding horizon control , 2007, 2007 46th IEEE Conference on Decision and Control.

[12]  Daniel Kuhn,et al.  Distributionally robust joint chance constraints with second-order moment information , 2011, Mathematical Programming.

[13]  Jianming Lian,et al.  Control of Uncertain Systems , 2009, Handbook of Automation.

[14]  Franco Blanchini,et al.  Set invariance in control , 1999, Autom..

[15]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[16]  Anton van den Hengel,et al.  Semidefinite Programming , 2014, Computer Vision, A Reference Guide.

[17]  Eli Upfal,et al.  Probability and Computing: Randomized Algorithms and Probabilistic Analysis , 2005 .

[18]  John Lygeros,et al.  Convexity and convex approximations of discrete-time stochastic control problems with constraints , 2011, Autom..

[19]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[20]  Gene F. Franklin,et al.  Feedback Control of Dynamic Systems , 1986 .

[21]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[22]  D. Mayne,et al.  On the discrete time matrix Riccati equation of optimal control , 1970 .

[23]  Dimitris Bertsimas,et al.  Constrained Stochastic LQC: A Tractable Approach , 2007, IEEE Transactions on Automatic Control.

[24]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[25]  Melvyn Sim,et al.  From CVaR to Uncertainty Set: Implications in Joint Chance-Constrained Optimization , 2010, Oper. Res..

[26]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[27]  Kemin Zhou,et al.  On the probabilistic characterization of model uncertainty and robustness , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[28]  B. R. Barmish,et al.  Distributionally Robust Monte Carlo Simulation: A Tutorial Survey , 2002 .

[29]  John B. Moore,et al.  Optimal State Estimation , 2006 .

[30]  Melvyn Sim,et al.  Tractable Approximations to Robust Conic Optimization Problems , 2006, Math. Program..

[31]  Daniel Kuhn,et al.  Distributionally Robust Control of Constrained Stochastic Systems , 2016, IEEE Transactions on Automatic Control.

[32]  Zhou Zhou,et al.  Reliable approximations of probability-constrained stochastic linear-quadratic control , 2013, Autom..