Pattern-Based Modeling and Solution of Probabilistically Constrained Optimization Problems

We propose a new modeling and solution method for probabilistically constrained optimization problems. The methodology is based on the integration of the stochastic programming and combinatorial pattern recognition fields. It permits the fast solution of stochastic optimization problems in which the random variables are represented by an extremely large number of scenarios. The method involves the binarization of the probability distribution, and the generation of a consistent partially defined Boolean function (pdBf) representing the combination (F; p) of the binarized probability distribution F and the enforced probability level p. We show that the pdBf representing (F; p) can be compactly extended as a disjunctive normal form (DNF). The DNF is a collection of combinatorial p-patterns, each of which defining sufficient conditions for a probabilistic constraint to hold. We propose two linear programming formulations for the generation of p-patterns which can be subsequently used to derive a linear programming inner approximation of the original stochastic problem. A formulation allowing for the concurrent generation of a p-pattern and the solution of the deterministic equivalent of the stochastic problem is also proposed. Results show that large-scale stochastic problems, in which up to 50,000 scenarios are used to describe the stochastic variables, can be consistently solved to optimality within a few seconds.

[1]  José Francisco Martínez Trinidad,et al.  The logical combinatorial approach to pattern recognition, an overview through selected works , 2001, Pattern Recognit..

[2]  J. Hooker,et al.  Logic-Based Methods for Optimization: Combining Optimization and Constraint Satisfaction , 2000 .

[3]  John N. Hooker,et al.  Integrated methods for optimization , 2011, International series in operations research and management science.

[4]  Brian W. Kernighan,et al.  AMPL: A Modeling Language for Mathematical Programming , 1993 .

[5]  András Prékopa,et al.  Contributions to the theory of stochastic programming , 1973, Math. Program..

[6]  Peter L. Hammer,et al.  Modeling country risk ratings using partial orders , 2006, Eur. J. Oper. Res..

[7]  Peter L. Hammer,et al.  Boolean Functions - Theory, Algorithms, and Applications , 2011, Encyclopedia of mathematics and its applications.

[8]  Alexander Shapiro,et al.  Convex Approximations of Chance Constrained Programs , 2006, SIAM J. Optim..

[9]  Miguel A. Lejeune,et al.  MIP reformulations of the probabilistic set covering problem , 2010, Math. Program..

[10]  Rocco H. Urbano,et al.  A Topological Method for the Determination of the Minimal Forms of a Boolean Function , 1956, IRE Trans. Electron. Comput..

[11]  H. P. Williams,et al.  Logic-Based Decision Support: Mixed Integer Model Formulation , 1989 .

[12]  Toshihide Ibaraki,et al.  An Implementation of Logical Analysis of Data , 2000, IEEE Trans. Knowl. Data Eng..

[13]  Nilay Noyan,et al.  Mathematical programming approaches for generating p-efficient points , 2010, Eur. J. Oper. Res..

[14]  José Ruiz-Shulcloper,et al.  Logical Combinatorial Pattern Recognition: A Review , 2002 .

[15]  Myun-Seok Cheon,et al.  A branch-reduce-cut algorithm for the global optimization of probabilistically constrained linear programs , 2006, Math. Program..

[16]  Darinka Dentcheva,et al.  Concavity and efficient points of discrete distributions in probabilistic programming , 2000, Math. Program..

[17]  Patrizia Beraldi,et al.  A branch and bound method for stochastic integer problems under probabilistic constraints , 2002, Optim. Methods Softw..

[18]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[19]  Maria Gabriela Martinez,et al.  Augmented Lagrangian method for probabilistic optimization , 2012, Ann. Oper. Res..

[20]  Toshihide Ibaraki,et al.  Logical analysis of numerical data , 1997, Math. Program..

[21]  E. V. Djukova,et al.  Increasing the efficiency of combinatorial logical data analysis in recognition and classification problems , 2006, Pattern Recognition and Image Analysis.

[22]  Miguel A. Lejeune Pattern definition of the p-efficiency concept , 2012, Ann. Oper. Res..

[23]  A. Prékopa,et al.  Programming Under Probabilistic Constraint with Discrete Random Variable , 1998 .

[24]  Evangelos Triantaphyllou,et al.  Inference of Monotone Boolean Functions , 2009, Encyclopedia of Optimization.

[25]  Peter L. Hammer,et al.  Logical analysis of data—An overview: From combinatorial optimization to medical applications , 2006, Ann. Oper. Res..

[26]  James R. Luedtke,et al.  A Sample Approximation Approach for Optimization with Probabilistic Constraints , 2008, SIAM J. Optim..

[27]  Maria Polukarov,et al.  The minmax multidimensional knapsack problem with application to a chance‐constrained problem , 2007 .

[28]  Andrzej Ruszczynski,et al.  Probabilistic programming with discrete distributions and precedence constrained knapsack polyhedra , 2002, Math. Program..

[29]  Giuseppe Carlo Calafiore,et al.  Uncertain convex programs: randomized solutions and confidence levels , 2005, Math. Program..

[30]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[31]  R. Jagannathan,et al.  Chance-Constrained Programming with Joint Constraints , 1974, Oper. Res..

[32]  A. Charnes,et al.  Cost Horizons and Certainty Equivalents: An Approach to Stochastic Programming of Heating Oil , 1958 .

[33]  Suvrajeet Sen Relaxations for probabilistically constrained programs with discrete random variables , 1992, Oper. Res. Lett..

[34]  Peter L. Hammer,et al.  Spanned patterns for the logical analysis of data , 2006, Discret. Appl. Math..

[35]  Yu. I. Zhuravlev,et al.  DISCRETE ANALYSIS OF FEATURE DESCRIPTIONS IN RECOGNITION PROBLEMS OF HIGH DIMENSIONALITY , 2000 .

[36]  Evangelos Triantaphyllou,et al.  Data Mining and Knowledge Discovery Approaches Based on Rule Induction Techniques , 2009 .

[37]  Sergiu Rudeanu Boolean functions and equations , 1974 .

[38]  Toshihide Ibaraki,et al.  Decision lists and related Boolean functions , 2002, Theor. Comput. Sci..

[39]  Peter L. Hammer,et al.  Pareto-optimal patterns in logical analysis of data , 2004, Discret. Appl. Math..

[40]  George L. Nemhauser,et al.  An integer programming approach for linear programs with probabilistic constraints , 2007, Math. Program..

[41]  Michael I. Miller,et al.  Pattern Theory: From Representation to Inference , 2007 .

[42]  Lewis Ntaimo,et al.  IIS branch-and-cut for joint chance-constrained stochastic programs and application to optimal vaccine allocation , 2010, Eur. J. Oper. Res..

[43]  Ing-Marie Gren,et al.  Adaptation and mitigation strategies for controlling stochastic water pollution: An application to the Baltic Sea , 2008 .

[44]  Darinka Dentcheva,et al.  Dual methods for probabilistic optimization problems* , 2004, Math. Methods Oper. Res..