Infinite Horizon Performance Bounds for Uncertain Constrained Systems

We present a new method to bound the performance of controllers for uncertain linear systems with mixed state and input constraints and bounded disturbances. We take as a performance metric either an expected-value or minimax discounted cost over an infinite horizon, and provide a method for computing a lower bound on the achievable performance of any causal control policy in either case. Our lower bound is compared to an upper performance bound provided by restricting the choice of controller to one that is affine in the observed disturbances, and we show that the two bounds are closely related. In particular, the lower bounds have a natural interpretation in terms of affine control policies that are optimal for a problem with a restricted disturbance set. We show that our performance bounds can be computed via solution of a finite-dimensional convex optimization problem, and provide numerical examples to illustrate the efficacy of our method.

[1]  Daniel Kuhn,et al.  A scenario approach for estimating the suboptimality of linear decision rules in two-stage robust optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[2]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[3]  A. Shapiro.  ON DUALITY THEORY OF CONIC LINEAR PROBLEMS , 2001 .

[4]  Lisa A. Korf.  Approximating infinite horizon stochastic optimal control in discrete time with constraints , 2006, Ann. Oper. Res..

[5]  Franco Blanchini,et al.  Set invariance in control , 1999, Autom..

[6]  Eric C. Kerrigan,et al.  Input-to-state stability of robust receding horizon control with an expected value cost , 2008, Autom..

[7]  Dimitri P. Bertsekas,et al.  Universally Measurable Policies in Dynamic Programming , 1979, Math. Oper. Res..

[8]  Alberto Bemporad,et al.  A Decomposition Algorithm for Feedback Min-Max Model Predictive Control , 2005, CDC 2005.

[9]  H. Kiendl,et al.  Vector norms as Lyapunov functions for linear systems , 1992 .

[10]  A. Ben-Tal,et al.  Adjustable robust solutions of uncertain linear programs , 2004, Math. Program..

[11]  M Morari,et al.  Energy efficient building climate control using Stochastic Model Predictive Control and weather predictions , 2010, Proceedings of the 2010 American Control Conference.

[12]  Moritz Diehl,et al.  Approximate robust dynamic programming and robustly stable MPC , 2006, Autom..

[13]  Dimitris Bertsimas,et al.  On the power and limitations of affine policies in two-stage adaptive optimization , 2012, Math. Program..

[14]  Mark J. Damborg,et al.  Heuristically enhanced feedback control of constrained discrete-time linear systems , 1990, at - Automatisierungstechnik.

[15]  Pablo A. Parrilo,et al.  Optimality of Affine Policies in Multistage Robust Optimization , 2009, Math. Oper. Res..

[16]  Daniel Kuhn,et al.  Primal and dual linear decision rules in stochastic and robust optimization , 2011, Math. Program..

[17]  Stephen P. Boyd,et al.  Performance bounds and suboptimal policies for linear stochastic control via LMIs , 2011 .

[18]  David Q. Mayne,et al.  Robust model predictive control of constrained linear systems with bounded disturbances , 2005, Autom..

[19]  D. Chmielewski,et al.  On constrained infinite-time linear quadratic optimal control , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[20]  E. Kerrigan.  Robust Constraint Satisfaction: Invariant Sets and Predictive Control , 2000 .

[21]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[22]  E. Gilbert,et al.  Theory and computation of disturbance invariant sets for discrete-time linear systems , 1998 .

[23]  B. Kouvaritakis,et al.  Constrained receding horizon predictive control for systems with disturbances , 1999 .

[24]  Frank J. Christophersen,et al.  Further Results on “Infinity Norms as Lyapunov Functions for Linear Systems” , 2007, IEEE Transactions on Automatic Control.

[25]  J. Löfberg.  Minimax approaches to robust model predictive control , 2003 .

[26]  Manfred Morari,et al.  Policy-Based Reserves for Power Systems , 2012, IEEE Transactions on Power Systems.

[27]  Alberto Bemporad,et al.  Model predictive control based on linear programming - the explicit solution , 2002, IEEE Transactions on Automatic Control.

[28]  Eric C. Kerrigan,et al.  Optimization over state feedback policies for robust control with constraints , 2006, Autom..

[29]  Daniel Kuhn,et al.  An Efficient Method to Estimate the Suboptimality of Affine Controllers , 2011, IEEE Transactions on Automatic Control.

[30]  D. Bertsekas.  Infinite time reachability of state-space regions by using feedback control , 1972 .

[31]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[32]  M. SZNAIERt,et al.  Heuristically Enhanced Feedback Control of Constrained Discrete-time Linear Systems * , 2002 .

[33]  Benjamin Van Roy,et al.  The Linear Programming Approach to Approximate Dynamic Programming , 2003, Oper. Res..