Constrained dynamic programming of mixed-integer linear problems by multi-parametric programming

Abstract This work addresses the topic of constrained dynamic programming for problems involving multi-stage mixed-integer linear formulations with a linear objective function. It is shown that such problems may be decomposed into a series of multi-parametric mixed-integer linear problems, of lower dimensionality, that are sequentially solved to obtain the globally optimal solution of the original problem. At each stage, the dynamic programming recursion is reformulated as a convex multi-parametric programming problem, therefore avoiding the need for global optimisation that usually arises in hard constrained problems. The proposed methodology is applied to a problem of mixed-integer linear nature that arises in the context of inventory scheduling. The example also highlights how the complexity of the original problem is reduced by using dynamic programming and multi-parametric programming.

[1]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[2]  Arun Gupta,et al.  A novel approach to multiparametric quadratic programming , 2011, Autom..

[3]  Efstratios N. Pistikopoulos,et al.  On the global solution of multi-parametric mixed integer linear programming problems , 2012, Journal of Global Optimization.

[4]  Arkadi Nemirovski,et al.  Robust Convex Optimization , 1998, Math. Oper. Res..

[5]  M. Sniedovich Dynamic programming : foundations and principles , 2011 .

[6]  G. McRae,et al.  Parametric optimization of MILP programs and a framework for the parametric optimization of MINLPs , 1998 .

[7]  Efstratios N. Pistikopoulos,et al.  An algorithm for robust explicit/multi-parametric model predictive control , 2013, Autom..

[8]  E. Pistikopoulos,et al.  A multiparametric programming approach for mixed-integer quadratic engineering problems , 2002 .

[9]  Anthony V. Fiacco,et al.  Introduction to Sensitivity and Stability Analysis in Nonlinear Programming , 2012 .

[10]  Berç Rustem,et al.  A multi-parametric programming approach for constrained dynamic programming problems , 2008, Optim. Lett..

[11]  E. Pistikopoulos,et al.  A multiparametric programming approach for linear process engineering problems under uncertainty , 1997 .

[12]  Alberto Bemporad,et al.  The explicit linear quadratic regulator for constrained systems , 2003, Autom..

[13]  Warren B. Powell,et al.  Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley Series in Probability and Statistics) , 2007 .

[14]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[15]  Laurent El Ghaoui,et al.  Robust Control of Markov Decision Processes with Uncertain Transition Matrices , 2005, Oper. Res..

[16]  Jay H. Lee,et al.  Dynamic programming in a heuristically confined state space: a stochastic resource-constrained project scheduling application , 2004, Comput. Chem. Eng..

[17]  Tor Arne Johansen,et al.  An improved algorithm for combinatorial multi-parametric quadratic programming , 2013, Autom..

[18]  Alberto Bemporad,et al.  Dynamic programming for constrained optimal control of discrete-time linear hybrid systems , 2005, Autom..

[19]  Willy Herroelen,et al.  Project scheduling under uncertainty: Survey and research potentials , 2005, Eur. J. Oper. Res..

[20]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[21]  S. A. Dadebo,et al.  Dynamic optimization of constrained chemical engineering problems using dynamic programming , 1995 .

[22]  Rüdiger U. Seydel Tools for Computational Finance , 2002 .

[23]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[24]  Stuart E. Dreyfus,et al.  Applied Dynamic Programming , 1965 .

[25]  Alberto Bemporad,et al.  An algorithm for multi-parametric quadratic programming and explicit MPC solutions , 2003, Autom..

[26]  R. Bellman Dynamic programming. , 1957, Science.

[27]  Marianthi G. Ierapetritou,et al.  Process scheduling under uncertainty using multiparametric programming , 2007 .

[28]  Efstratios N. Pistikopoulos,et al.  An Algorithm for the Solution of Multiparametric Mixed Integer Linear Programming Problems , 2000, Ann. Oper. Res..