Benchmarking and Field-Testing of the Distributed Quasi-Newton Derivative-Free Optimization Method for Field Development Optimization

Recently, a novel distributed quasi-Newton (DQN) derivative-free optimization (DFO) method was developed for generic reservoir performance optimization problems including well-location optimization (WLO) and well-control optimization (WCO). DQN is designed to effectively locate multiple local optima of highly nonlinear optimization problems. However, its performance has neither been validated by realistic applications nor compared to other DFO methods. We have integrated DQN into a versatile field-development optimization platform designed specifically for iterative workflows enabled through distributed-parallel flow simulations. DQN is benchmarked against alternative DFO techniques, namely, the Broyden–Fletcher–Goldfarb–Shanno (BFGS) method hybridized with Direct Pattern Search (BFGS-DPS), Mesh Adaptive Direct Search (MADS), Particle Swarm Optimization (PSO), and Genetic Algorithm (GA). DQN is a multi-thread optimization method that distributes an ensemble of optimization tasks among multiple high-performance-computing nodes. Thus, it can locate multiple optima of the objective function in parallel within a single run. Simulation results computed from one DQN optimization thread are shared with others by updating a unified set of training data points composed of responses (implicit variables) of all successful simulation jobs. The sensitivity matrix at the current best solution of each optimization thread is approximated by a linear-interpolation technique using all or a subset of training-data points. The gradient of the objective function is analytically computed using the estimated sensitivities of implicit variables with respect to explicit variables. The Hessian matrix is then updated using the quasi-Newton method. A new search point for each thread is solved from a trust-region subproblem for the next iteration. In contrast, other DFO methods rely on a single-thread optimization paradigm that can only locate a single optimum. To locate multiple optima, one must repeat the same optimization process multiple times starting from different initial guesses for such methods. Moreover, simulation results generated from a single-thread optimization task cannot be shared with other tasks. Benchmarking results are presented for synthetic yet challenging WLO and WCO problems. Finally, DQN method is field-tested on two realistic applications. DQN identifies the global optimum with the least number of simulations and the shortest run time on a synthetic problem with known solution. On other benchmarking problems without a known solution, DQN identified compatible local optima with reasonably smaller numbers of simulations compared to alternative techniques. Field-testing results reinforce the auspicious computational attributes of DQN. Overall, the results indicate that DQN is a novel and effective parallel algorithm for field-scale development optimization problems.

[1]  Guohua Gao,et al.  A Direct Overparameterize and Optimize Method for Stratigraphically Consistent Assisted History Matching of Object-Based Geomodels: Algorithm and Field Application , 2017 .

[2]  Dean S. Oliver,et al.  Ensemble-Based Closed-Loop Optimization Applied to Brugge Field , 2010 .

[3]  Hao Jiang,et al.  Performance enhancement of Gauss-Newton trust-region solver for distributed Gauss-Newton optimization method , 2019, Computational Geosciences.

[4]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[5]  Dominique Pelletier,et al.  On Sensitivity Analysis for Problems with Numerical Noise , 2002 .

[6]  Zhenyu Guo,et al.  Integration of Support Vector Regression With Distributed Gauss-Newton Optimization Method and Its Applications to the Uncertainty Assessment of Unconventional Assets , 2018, SPE Reservoir Evaluation & Engineering.

[7]  R. Gebart,et al.  Influence from numerical noise in the objective function for flow design optimisation , 2001 .

[8]  Jeroen C. Vink,et al.  Techniques for effective simulation, optimization, and uncertainty quantification of the in-situ upgrading process , 2013, ANSS 2013.

[9]  Dongxiao Zhang,et al.  Efficient Ensemble-Based Closed-Loop Production Optimization , 2009 .

[10]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[11]  Jeroen C. Vink,et al.  Global-Search Distributed-Gauss-Newton Optimization Method and Its Integration With the Randomized-Maximum-Likelihood Method for Uncertainty Quantification of Reservoir Performance , 2018 .

[12]  Benjamin Ramirez,et al.  Model-Based Well Location Optimization – A Robust Approach , 2017 .

[13]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[14]  J. Jansen,et al.  A Stochastic Simplex Approximate Gradient (StoSAG) for optimization under uncertainty , 2017 .

[15]  Dean S. Oliver,et al.  On conditional simulation to inaccurate data , 1996 .

[16]  Long Jin,et al.  Assisted History Matching Using Three Derivative-Free Optimization Algorithms , 2012 .

[17]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[18]  Pierre Hansen,et al.  Variable neighborhood search: Principles and applications , 1998, Eur. J. Oper. Res..

[19]  M. J. D. Powell,et al.  Least Frobenius norm updating of quadratic models that satisfy interpolation conditions , 2004, Math. Program..

[20]  Gijs van Essen,et al.  Robust Waterflooding Optimization of Multiple Geological Scenarios , 2009 .

[21]  Charles Audet,et al.  Analysis of Generalized Pattern Searches , 2000, SIAM J. Optim..

[22]  A. Reynolds,et al.  Theoretical connections between optimization algorithms based on an approximate gradient , 2013, Computational Geosciences.

[23]  Faruk O. Alpak,et al.  Adjoint method acceleration protocols for model maturation to update static models with time-lapse reservoir surveillance data , 2020 .

[24]  Stefan M. Wild,et al.  Estimating Computational Noise , 2011, SIAM J. Sci. Comput..

[25]  Dean S. Oliver,et al.  History Matching of Three-Phase Flow Production Data , 2003 .

[26]  Yu Wang,et al.  Distributed quasi-Newton derivative-free optimization method for optimization problems with multiple local optima , 2021, Computational Geosciences.

[27]  Jan Dirk Jansen,et al.  Adjoint-based optimization of multi-phase flow through porous media – A review , 2011 .

[28]  Antonia Azzini,et al.  Evolving neural networks for static single-position automated trading , 2008 .

[29]  Guohua Gao,et al.  Enhancing the Performance of the Distributed Gauss-Newton Optimization Method by Reducing the Effect of Numerical Noise and Truncation Error With Support-Vector Regression , 2018, SPE Journal.

[30]  A. Reynolds,et al.  Large-scale history matching with quadratic interpolation models , 2013, Computational Geosciences.

[31]  Hao Jiang,et al.  A Gauss-Newton Trust-Region Solver for Large-Scale History-Matching Problems , 2017 .

[32]  Christine A. Shoemaker,et al.  Derivative-free optimization algorithms for computationally expensive functions , 2009 .

[33]  Chaohui Chen,et al.  Gaussian mixture model fitting method for uncertainty quantification by conditioning to production data , 2019, Computational Geosciences.

[34]  A. Reynolds,et al.  A Two-Level MCMC Based On The Distributed Gauss-Newton Method For Uncertainty Quantification , 2018, ECMOR XVI - 16th European Conference on the Mathematics of Oil Recovery.

[35]  J. F. Martínez,et al.  The generalized PSO: a new door to PSO evolution , 2008 .

[36]  Jeroen C. Vink,et al.  A Parallelized and Hybrid Data-Integration Algorithm for History Matching of Geologically Complex Reservoirs , 2016 .

[37]  Charles Audet,et al.  Mesh Adaptive Direct Search Algorithms for Constrained Optimization , 2006, SIAM J. Optim..

[38]  Long Jin,et al.  Robust optimisation of well placement in geologically complex reservoirs , 2016 .

[39]  Charles Audet,et al.  Nonsmooth optimization through Mesh Adaptive Direct Search and Variable Neighborhood Search , 2006, J. Glob. Optim..

[40]  Louis J. Durlofsky,et al.  Implementation of Adjoint Solution for Optimal Control of Smart Wells , 2005 .

[41]  D. Voskov,et al.  Effect of time stepping strategy on adjoint-based production optimization , 2014, Computational Geosciences.

[42]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[43]  Chaohui Chen,et al.  Distributed Gauss-Newton optimization method for history matching problems with multiple best matches , 2017, Computational Geosciences.