A mixed-integer simulation-based optimization approach with surrogate functions in water resources management

Efficient and powerful methods are needed to overcome the inherent difficulties in the numerical solution of many simulation-based engineering design problems. Typically, expensive simulation codes are included as black-box function generators; therefore, gradient information that is required by mathematical optimization methods is entirely unavailable. Furthermore, the simulation code may contain iterative or heuristic methods, low-order approximations of tabular data, or other numerical methods which contribute noise to the objective function. This further rules out the application of Newton-type or other gradient-based methods that use traditional finite difference approximations. In addition, if the optimization formulation includes integer variables the complexity grows even further. In this paper we consider three different modeling approaches for a mixed-integer nonlinear optimization problem taken from a set of water resources benchmarking problems. Within this context, we compare the performance of a genetic algorithm, the implicit filtering algorithm, and a branch-and-bound approach that uses sequential surrogate functions. We show that the surrogate approach can greatly improve computational efficiency while locating a comparable, sometimes better, design point than the other approaches.

[1]  O. V. Stryk,et al.  DERIVATIVE-FREE OPTIMIZATION METHODS FOR HANDLING FIXED COSTS IN OPTIMAL GROUNDWATER REMEDIATION DESIGN , 2006 .

[2]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[3]  Owen J. Eslinger,et al.  IFFCO: implicit filtering for constrained optimization, version 2 , 1999 .

[4]  John W. Nicklow Discrete-Time Optimal Control for Water Resources Engineering and Management , 2000 .

[5]  Larry W. Mays Optimal Control Of Hydrosystems , 1997 .

[6]  Cass T. Miller,et al.  Solution of a Groundwater Control Problem with Implicit Filtering , 2002 .

[7]  J. Eheart,et al.  Using Genetic Algorithms to Solve a Multiobjective Groundwater Monitoring Problem , 1995 .

[8]  Dimitri P. Solomatine,et al.  Groundwater Remediation Strategy Using Global Optimization Algorithms , 2002 .

[9]  Cass T. Miller,et al.  Solution of a Well-Field Design Problem with Implicit Filtering , 2004 .

[10]  L Shawn Matott,et al.  Application of heuristic optimization techniques and algorithm tuning to multilayered sorptive barrier design. , 2006, Environmental science & technology.

[11]  Christodoulos A. Floudas,et al.  Deterministic global optimization - theory, methods and applications , 2010, Nonconvex optimization and its applications.

[12]  Cass T. Miller,et al.  Optimal design for problems involving flow and transport phenomena in saturated subsurface systems , 2002 .

[13]  Charles Audet,et al.  Comparison of derivative-free optimization methods for groundwater supply and hydraulic capture community problems , 2008 .

[14]  Arlen W. Harbaugh,et al.  A modular three-dimensional finite-difference ground-water flow model , 1984 .

[15]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[16]  Christodoulos A. Floudas,et al.  Mixed Integer Nonlinear Programming , 2009, Encyclopedia of Optimization.

[17]  I. Grossmann Review of Nonlinear Mixed-Integer and Disjunctive Programming Techniques , 2002 .

[18]  D. McKinney,et al.  Decomposition methods for water resources optimization models with fixed costs , 1998 .

[19]  Owen J. Eslinger,et al.  Algorithms for Noisy Problems in Gas Transmission Pipeline Optimization , 2001 .

[20]  R. C. Peralta,et al.  Closure to discussion on Optimal in-situ bioremediation design by hybrid genetic algorithm-simulated annealing , 2005 .

[21]  Liang-Cheng Chang,et al.  Dynamic Optimal Groundwater Management with Inclusion of Fixed Costs , 2002 .

[22]  Michael A. Saunders,et al.  USER’S GUIDE FOR SNOPT 5.3: A FORTRAN PACKAGE FOR LARGE-SCALE NONLINEAR PROGRAMMING , 2002 .

[23]  David E. Goldberg,et al.  Adaptive Hybrid Genetic Algorithm for Groundwater Remediation Design , 2005 .

[24]  P. C. Gehlen,et al.  Computer Experiments , 1996 .

[25]  M. Sayeed,et al.  Efficient Parallel Implementation of Hybrid Optimization Approaches for Solving Groundwater Inverse Problems , 2005 .

[26]  Charles Audet,et al.  Pattern Search Algorithms for Mixed Variable Programming , 2000, SIAM J. Optim..

[27]  Kalyanmoy Deb,et al.  Controlled Elitist Non-dominated Sorting Genetic Algorithms for Better Convergence , 2001, EMO.

[28]  William G. Gray,et al.  Macroscale continuum mechanics for multiphase porous-media flow including phases, interfaces, common lines and common points , 1998 .

[29]  Upmanu Lall,et al.  An optimization model for unconfined stratified aquifer systems , 1989 .

[30]  S. Ranjithan,et al.  Using genetic algorithms to solve a multiple objective groundwater pollution containment problem , 1994 .

[31]  Christian Dehlendorff,et al.  Design of Computer Experiments , 2010 .

[32]  David E. Goldberg,et al.  Designing a competent simple genetic algorithm for search and optimization , 2000 .

[33]  Jerome Sacks,et al.  Designs for Computer Experiments , 1989 .

[34]  C. T. Kelley,et al.  An Implicit Filtering Algorithm for Optimization of Functions with Many Local Minima , 1995, SIAM J. Optim..

[35]  Art B. Owen,et al.  9 Computer experiments , 1996, Design and analysis of experiments.

[36]  William G. Gray,et al.  Computational methods in water resources, Vol. 1 , 2002 .

[37]  El-Ghazali Talbi,et al.  A Taxonomy of Hybrid Metaheuristics , 2002, J. Heuristics.

[38]  G. Pinder,et al.  Enhancement of the outer approximation method for the solution of concentration‐constrained optimal‐design groundwater‐remediation problems , 2003 .

[39]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[40]  D. McKinney,et al.  Approximate Mixed‐Integer Nonlinear Programming Methods for Optimal Aquifer Remediation Design , 1995 .

[41]  A. Mayer,et al.  Pump‐and‐treat optimization using well locations and pumping rates as decision variables , 1997 .

[42]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[43]  Maria da Conceição Cunha,et al.  On solving aquifer management problems with simulated annealing algorithms , 1999 .

[44]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[45]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox , 2002 .

[46]  Christopher E. Kees,et al.  A hydraulic capture application for optimal remediation design , 2004 .

[47]  Herbert De Gersem,et al.  Mixed-integer simulation-based optimization for a superconductive magnet design , 2006 .