Stochastic gradient methods for stochastic model predictive control

We introduce a new stochastic gradient algorithm, SAAGA, and investigate its employment for solving Stochastic MPC problems and multi-stage stochastic optimization programs in general. The method is particularly attractive for scenario-based formulations that involve a large number of scenarios, for which “batch” formulations may become inefficient due to high computational costs. Benefits of the method include cheap computations per iteration and fast convergence due to the sparsity of the proposed problem decomposition.

[1]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[2]  Alfred O. Hero,et al.  A Convergent Incremental Gradient Method with a Constant Step Size , 2007, SIAM J. Optim..

[3]  Francis Bach,et al.  SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives , 2014, NIPS.

[4]  C. Scherer,et al.  LMI-based closed-loop economic optimization of stochastic process operation under state and input constraints , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[5]  S. Weiland,et al.  Optimal control of linear, stochastic systems with state and input constraints , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[6]  Angelia Nedic,et al.  Subgradient methods for convex minimization , 2002 .

[7]  Alberto Bemporad,et al.  MPC for power systems dispatch based on stochastic optimization , 2014 .

[8]  Masahiro Ono,et al.  Iterative Risk Allocation: A new approach to robust Model Predictive Control with a joint chance constraint , 2008, 2008 47th IEEE Conference on Decision and Control.

[9]  N. Growe-Kuska,et al.  Scenario reduction and scenario tree construction for power management problems , 2003, 2003 IEEE Bologna Power Tech Conference Proceedings,.

[10]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[11]  Claudio Gentile,et al.  On the generalization ability of on-line learning algorithms , 2001, IEEE Transactions on Information Theory.

[12]  James A. Primbs.  A soft constraint approach to stochastic receding horizon control , 2007, 2007 46th IEEE Conference on Decision and Control.

[13]  Alberto Bemporad,et al.  Stochastic MPC for real-time market-based optimal power dispatch , 2011, IEEE Conference on Decision and Control and European Control Conference.

[14]  Giuseppe Carlo Calafiore,et al.  Stochastic model predictive control of LPV systems via scenario optimization , 2013, Autom..

[15]  Paul Tseng,et al.  Incrementally Updated Gradient Methods for Constrained and Regularized Optimization , 2013, Journal of Optimization Theory and Applications.

[16]  Alberto Bemporad,et al.  Distributed solution of stochastic optimal control problems on GPUs , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[17]  Angelia NediÄ,et al.  Subgradient methods for convex minimization , 2002 .

[18]  Werner Römisch,et al.  Scenario tree reduction for multistage stochastic programs , 2009, Comput. Manag. Sci..

[19]  Mark W. Schmidt,et al.  Minimizing finite sums with the stochastic average gradient , 2013, Mathematical Programming.

[20]  Mark W. Schmidt,et al.  Non-Uniform Stochastic Average Gradient Method for Training Conditional Random Fields , 2015, AISTATS.