Distributed solution of stochastic optimal control problems on GPUs

Stochastic optimal control problems arise in many applications and are, in principle, large-scale involving up to millions of decision variables. Their applicability in control applications is often limited by the availability of algorithms that can solve them efficiently and within the sampling time of the controlled system. In this paper we propose a dual accelerated proximal gradient algorithm which is amenable to parallelization and demonstrate that its GPU implementation affords high speed-up values (with respect to a CPU implementation) and greatly outperforms well-established commercial optimizers such as Gurobi.

[1]  Pantelis Sopasakis,et al.  Stochastic Model Predictive Control for Constrained Networked Control Systems with Random Time Delay , 2011 .

[2]  Alberto Bemporad,et al.  Stochastic model predictive control for constrained discrete-time Markovian switching systems , 2014, Autom..

[3]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[4]  Stephen P. Boyd,et al.  Diagonal scaling in Douglas-Rachford splitting and ADMM , 2014, 53rd IEEE Conference on Decision and Control.

[5]  Mihai Anitescu,et al.  Real-Time Stochastic Optimization of Complex Energy Systems on High-Performance Computers , 2014, Computing in Science & Engineering.

[6]  Daniel Kuhn,et al.  Multistage stochastic portfolio optimisation in deregulated electricity markets using linear decision rules , 2012, Eur. J. Oper. Res..

[7]  Jonathan Rogers,et al.  Robust Parafoil Terminal Guidance Using Massively Parallel Processing , 2012 .

[8]  Kevin Skadron,et al.  Scalable parallel programming , 2008, 2008 IEEE Hot Chips 20 Symposium (HCS).

[9]  Nicolai Fog Gade-Nielsen Interior Point Methods on GPU with application to Model Predictive Control , 2014 .

[10]  Sartaj Sahni,et al.  Strassen's Matrix Multiplication on GPUs , 2011, 2011 IEEE 17th International Conference on Parallel and Distributed Systems.

[11]  Werner Römisch,et al.  Scenario Reduction Algorithms in Stochastic Programming , 2003, Comput. Optim. Appl..

[12]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[13]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[14]  Dong-Ping Song Optimal Control and Optimization of Stochastic Supply Chain Systems , 2012 .

[15]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[16]  Stephen P. Boyd,et al.  A Splitting Method for Optimal Control , 2013, IEEE Transactions on Control Systems Technology.

[17]  João M. F. Xavier,et al.  Distributed ADMM for model predictive control and congestion control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[18]  Alberto Bemporad,et al.  Water demand forecasting for the optimal operation of large-scale drinking water networks: The Barcelona Case Study. , 2014 .

[19]  Paul H. Zipkin,et al.  Foundations of Inventory Management , 2000 .

[20]  Helfried Peyrl,et al.  FPGA implementation of an interior point method for high-speed model predictive control , 2014, 2014 24th International Conference on Field Programmable Logic and Applications (FPL).

[21]  Alberto Bemporad,et al.  An Accelerated Dual Gradient-Projection Algorithm for Embedded Linear Model Predictive Control , 2014, IEEE Transactions on Automatic Control.

[22]  Christian Kirches,et al.  qpOASES: a parametric active-set algorithm for quadratic programming , 2014, Mathematical Programming Computation.

[23]  Marc Teboulle,et al.  A fast dual proximal gradient algorithm for convex minimization and applications , 2014, Oper. Res. Lett..

[24]  Stefano Di Cairano,et al.  Projection-free parallel quadratic programming for linear model predictive control , 2013, Int. J. Control.

[25]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[26]  George A. Constantinides,et al.  Tutorial paper: Parallel architectures for model predictive control , 2009, 2009 European Control Conference (ECC).