On the sample size of random convex programs with structured dependence on the uncertainty

The "scenario approach" provides an intuitive method to address chance constrained problems arising in control design for uncertain systems. It addresses these problems by replacing the chance constraint with a finite number of sampled constraints (scenarios). The sample size critically depends on Helly's dimension, a quantity always upper bounded by the number of decision variables. However, this standard bound can lead to computationally expensive programs whose solutions are conservative in terms of cost and violation probability. We derive improved bounds of Helly's dimension for problems where the chance constraint has certain structural properties. The improved bounds lower the number of scenarios required for these problems, leading both to improved objective value and reduced computational complexity. Our results are generally applicable to Randomized Model Predictive Control of chance constrained linear systems with additive uncertainty and affine disturbance feedback. The efficacy of the proposed bound is demonstrated on an inventory management example.

[1]  Sergio Grammatico,et al.  A scenario approach to non-convex control design: Preliminary probabilistic guarantees , 2014, 2014 American Control Conference.

[2]  Roberto Tempo,et al.  The Sample Complexity of Randomized Methods for Analysis and Design of Uncertain Systems , 2013, ArXiv.

[3]  J. Lygeros,et al.  On the sample size of randomized MPC for chance-constrained systems with application to building climate control , 2014, European Control Conference.

[4]  Marco C. Campi,et al.  The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs , 2008, SIAM J. Optim..

[5]  Giuseppe Carlo Calafiore,et al.  Random Convex Programs , 2010, SIAM J. Optim..

[6]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[7]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[8]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[9]  Sergio Grammatico,et al.  A Scenario Approach for Non-Convex Control Design , 2014, IEEE Transactions on Automatic Control.

[10]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[11]  R. Tempo,et al.  Randomized Algorithms for Analysis and Control of Uncertain Systems , 2004 .

[12]  Eric C. Kerrigan,et al.  Optimization over state feedback policies for robust control with constraints , 2006, Autom..

[13]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[14]  Marco C. Campi,et al.  The exact feasibility of randomized solutions of robust convex programs , 2008 .

[15]  John Lygeros,et al.  Performance Bounds for the Scenario Approach and an Extension to a Class of Non-Convex Programs , 2013, IEEE Transactions on Automatic Control.

[16]  Eduardo F. Camacho,et al.  Randomized Strategies for Probabilistic Solutions of Uncertain Feasibility and Optimization Problems , 2009, IEEE Transactions on Automatic Control.

[17]  S. Garatti,et al.  Modulating robustness in control design: Principles and algorithms , 2013, IEEE Control Systems.

[18]  Mathukumalli Vidyasagar,et al.  A Theory of Learning and Generalization: With Applications to Neural Networks and Control Systems , 1997 .

[19]  Alexander Shapiro,et al.  Convex Approximations of Chance Constrained Programs , 2006, SIAM J. Optim..

[20]  Arkadi Nemirovski,et al.  Robust solutions of uncertain linear programs , 1999, Oper. Res. Lett..

[21]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[22]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[23]  Manfred Morari,et al.  Scenario-based MPC for energy-efficient building climate control under weather and occupancy uncertainty , 2013, 2013 European Control Conference (ECC).

[24]  Mathukumalli Vidyasagar,et al.  Randomized algorithms for robust controller synthesis using statistical learning theory , 2001, Autom..

[25]  Roberto Tempo,et al.  Randomized methods for design of uncertain systems: Sample complexity and sequential algorithms , 2013, Autom..

[26]  Yasumasa Fujisaki,et al.  Guaranteed cost regulator design: A probabilistic solution and a randomized algorithm , 2007, Autom..

[27]  Marco C. Campi,et al.  A Sampling-and-Discarding Approach to Chance-Constrained Optimization: Feasibility and Optimality , 2011, J. Optim. Theory Appl..

[28]  A. Ben-Tal,et al.  Adjustable robust solutions of uncertain linear programs , 2004, Math. Program..

[29]  Karl Henrik Johansson,et al.  Implementation of a Scenario-Based MPC for HVAC Systems: An Experimental Case Study , 2014 .

[30]  X. Zhang,et al.  Stochastic frequency reserve provision by chance-constrained control of commercial buildings , 2015, 2015 European Control Conference (ECC).

[31]  Martin Anthony,et al.  Computational Learning Theory , 1992 .

[32]  Garud Iyengar,et al.  Ambiguous chance constrained problems and robust optimization , 2006, Math. Program..

[33]  John Lygeros,et al.  Stochastic Model Predictive Control using a combination of randomized and robust optimization , 2013, 52nd IEEE Conference on Decision and Control.

[34]  J. Lygeros,et al.  Randomized Nonlinear MPC for Uncertain Control-Affine Systems with Bounded Closed-Loop Constraint Violations , 2014 .

[35]  Arkadi Nemirovski,et al.  Robust Convex Optimization , 1998, Math. Oper. Res..

[36]  Lorenzo Fagiano,et al.  The scenario approach for Stochastic Model Predictive Control with bounds on closed-loop constraint violations , 2013, Autom..

[37]  Giuseppe Carlo Calafiore,et al.  The scenario approach to robust control design , 2006, IEEE Transactions on Automatic Control.

[38]  Giuseppe Carlo Calafiore,et al.  Robust Model Predictive Control via Scenario Optimization , 2012, IEEE Transactions on Automatic Control.

[39]  Giuseppe Carlo Calafiore,et al.  Uncertain convex programs: randomized solutions and confidence levels , 2005, Math. Program..

[40]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[41]  Lorenzo Fagiano,et al.  Randomized Solutions to Convex Programs with Multiple Chance Constraints , 2012, SIAM J. Optim..

[42]  Maria Domenica Di Benedetto,et al.  Randomized sampling for large zero-sum games , 2010, 49th IEEE Conference on Decision and Control (CDC).

[43]  J Figueira,et al.  Stochastic Programming , 1998, J. Oper. Res. Soc..

[44]  John Lygeros,et al.  On the Road Between Robust Optimization and the Scenario Approach for Chance Constrained Optimization Problems , 2014, IEEE Transactions on Automatic Control.

[45]  John Lygeros,et al.  Convex approximation of chance-constrained MPC through piecewise affine policies using randomized and robust optimization , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[46]  Jan M. Maciejowski,et al.  Predictive control : with constraints , 2002 .

[47]  G. Calafiore,et al.  On mixed-integer random convex programs , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).