Well Control Optimization using Derivative-Free Algorithms and a Multiscale Approach

In this paper, we use numerical optimization algorithms and a multiscale approach in order to find an optimal well management strategy over the life of the reservoir. The large number of well rates for each control step make the optimization problem more difficult and at a high risk of achieving a suboptimal solution. Moreover, the optimal number of adjustments is not known a priori. Adjusting well controls too frequently will increase unnecessary well management and operation cost, and an excessively low number of control adjustments may not be enough to obtain a good yield. We investigate three derivative-free optimization algorithms, chosen for their robust and parallel nature, to determine optimal well control strategies. The algorithms chosen include generalized pattern search (GPS), particle swarm optimization (PSO) and covariance matrix adaptation evolution strategy (CMA-ES). These three algorithms encompass the breadth of available black-box optimization strategies: deterministic local search, stochastic global search and stochastic local search. In addition, we hybridize the three derivative-free algorithms with a multiscale regularization approach. Starting with a reasonably small number of control steps, the control intervals are subsequently refined during the optimization. Results for experiments studied indicate that CMA-ES performs best among the three algorithms in solving both small and large scale problems. When hybridized with a multiscale regularization approach, the ability to find the optimal solution is further enhanced, with the performance of GPS improving the most. Topics affecting the performance of the multiscale approach are discussed in this paper, including the effect of control frequency on the well control problem. The parameter settings for GPS, PSO, and CMA-ES, within the multiscale approach are considered.

[1]  Tapan Mukerji,et al.  Derivative-Free Optimization for Oil Field Operations , 2011, Computational Optimization and Applications in Engineering and Industry.

[2]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.

[3]  Prashanth Siddhamshetty,et al.  Model order reduction of nonlinear parabolic PDE systems with moving boundaries using sparse proper orthogonal decomposition: Application to hydraulic fracturing , 2018, Comput. Chem. Eng..

[4]  Louis J. Durlofsky,et al.  Implementation of Adjoint Solution for Optimal Control of Smart Wells , 2005 .

[5]  Louis J. Durlofsky,et al.  Trajectory piecewise quadratic reduced-order model for subsurface flow, with application to PDE-constrained optimization , 2016, J. Comput. Phys..

[6]  M. Powell.  The BOBYQA algorithm for bound constrained optimization without derivatives , 2009 .

[7]  Peter Kampstra,et al.  Beanplot: A Boxplot Alternative for Visual Comparison of Distributions , 2008 .

[8]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[9]  Xiang Wang,et al.  A multilevel coordinate search algorithm for well placement, control and joint optimization , 2015, Comput. Chem. Eng..

[10]  A. Auger,et al.  Well placement optimization with the covariance matrix adaptation evolution strategy and meta-models , 2011, Computational Geosciences.

[11]  Ronald D. Haynes,et al.  Simultaneous and sequential approaches to joint optimization of well placement and control , 2014, Computational Geosciences.

[12]  M. L. Wasserman,et al.  A New Algorithm for Automatic History Matching , 1974 .

[13]  Albert C. Reynolds,et al.  Optimal control of ICV's and well operating conditions for the water-alternating-gas injection process , 2017 .

[14]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[15]  L. Durlofsky.  REAL-TIME OPTIMIZATION OF SMART WELLS A REPORT SUBMITTED TO THE DEPARTMENT OF PETROLEUM ENGINEERING OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE , 2004 .

[16]  Albert C. Reynolds,et al.  Hierarchical Multiscale Methods for Life-Cycle Production Optimization: A Field Case Study , 2015, ANSS 2015.

[17]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[18]  Louis J. Durlofsky,et al.  Generalized Field-Development Optimization With Derivative-Free Procedures , 2014 .

[19]  Geir Nævdal,et al.  Production Optimization Using Derivative Free Methods Applied to Brugge Field Case , 2014 .

[20]  G. Chavent.  Identification of functional parameters in partial differential equations , 1974 .

[21]  Bagus Sudaryanto.  Optimization of displacement efficiency of oil recovery in porous media using optimal control theory , 1999 .

[22]  Louis J. Durlofsky,et al.  Development and Application of a New Well Pattern Optimization Algorithm for Optimizing Large Scale Field Development , 2009 .

[23]  Chunhong Wang,et al.  Production Optimization in Closed-Loop Reservoir Management , 2009 .

[24]  Markus Krosche,et al.  Multiple-Objective Optimization Applied to Well Path Design under Geological Uncertainty , 2011, ANSS 2011.

[25]  Joseph Sang-Il Kwon,et al.  Development of local dynamic mode decomposition with control: Application to model predictive control of hydraulic fracturing , 2017, Comput. Chem. Eng..

[26]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[27]  Jan Dirk Jansen,et al.  Multiscale Regularization of Flooding Optimization for Smart-Field Management , 2006 .

[28]  Luís N. Vicente,et al.  A particle swarm pattern search method for bound constrained global optimization , 2007, J. Glob. Optim..

[29]  Dirk V. Arnold,et al.  Optimal Weighted Recombination , 2005, FOGA.

[30]  Lianlin Li,et al.  A variable-control well placement optimization for improved reservoir development , 2012, Computational Geosciences.

[31]  Jan Dirk Jansen,et al.  Dynamic Optimization of Waterflooding With Smart Wells Using Optimal Control Theory , 2004 .

[32]  B. Jafarpour,et al.  A simultaneous perturbation stochastic approximation algorithm for coupled well placement and control optimization under geologic uncertainty , 2013, Computational Geosciences.

[33]  Louis J. Durlofsky,et al.  A New Well-Pattern-Optimization Procedure for Large-Scale Field Development , 2011 .

[34]  Gijs van Essen,et al.  Hierarchical Long-Term and Short-Term Production Optimization , 2011 .

[35]  Kang Zhou,et al.  Optimal control of polymer flooding based on simultaneous perturbation stochastic approximation method guided by finite difference gradient , 2013, Comput. Chem. Eng..

[36]  Albert C. Reynolds,et al.  An Adaptive Hierarchical Multiscale Algorithm for Estimation of Optimal Well Controls , 2014 .

[37]  Bjarne A. Foss,et al.  Designing shale-well proxy models for field development and production optimization problems , 2015 .

[38]  Albert C. Reynolds,et al.  Quantifying Uncertainty for the PUNQ-S3 Problem in a Bayesian Setting With RML and EnKF , 2005 .

[39]  Shahab Mohaghegh,et al.  A data-driven smart proxy model for a comprehensive reservoir simulation , 2016, 2016 4th Saudi International Conference on Information Technology (Big Data Analysis) (KACSTIT).

[40]  A. Reynolds,et al.  Theoretical connections between optimization algorithms based on an approximate gradient , 2013, Computational Geosciences.

[41]  Charles Audet,et al.  Analysis of Generalized Pattern Searches , 2000, SIAM J. Optim..

[42]  Bjarne A. Foss,et al.  Flow control of fluids through porous media , 2012, Appl. Math. Comput..

[43]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[44]  Geoffrey I. Webb,et al.  Encyclopedia of Machine Learning , 2011, Encyclopedia of Machine Learning.

[45]  Bjarne Grimstad,et al.  Global optimization of multiphase flow networks using spline surrogate models , 2016, Comput. Chem. Eng..

[46]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[47]  Q. Feng,et al.  Optimizing well placement in a coalbed methane reservoir using the particle swarm optimization algorithm , 2012 .

[48]  Prashanth Siddhamshetty,et al.  Temporal clustering for order reduction of nonlinear parabolic PDE systems with time-dependent spatial domains: Application to a hydraulic fracturing process , 2017 .

[49]  Raymond Ros,et al.  Benchmarking a weighted negative covariance matrix update on the BBOB-2010 noiseless testbed , 2010, GECCO '10.

[50]  Frank Neumann,et al.  Particle Swarm Optimization with Velocity Adaptation , 2009, 2009 International Conference on Adaptive and Intelligent Systems.

[51]  Ronald D. Haynes,et al.  Joint optimization of well placement and control for nonconventional well types , 2015 .

[52]  Louis J. Durlofsky,et al.  Application of derivative-free methodologies to generally constrained oil production optimisation problems , 2011, Int. J. Math. Model. Numer. Optimisation.

[53]  Dean S. Oliver,et al.  Ensemble-Based Closed-Loop Optimization Applied to Brugge Field , 2010 .

[54]  I. Zakirov,et al.  Optimizing Reservoir Performance by Automatic Allocation of Well Rates , 1996 .

[55]  Harald Asheim,et al.  Maximization of Water Sweep Efficiency by Controlling Production and Injection Rates , 1988 .

[56]  Prashanth Siddhamshetty,et al.  Model-based feedback control of oil production in oil-rim reservoirs under gas coning conditions , 2018, 2018 Annual American Control Conference (ACC).

[57]  L. Durlofsky,et al.  A derivative-free methodology with local and global search for the constrained joint optimization of well locations and controls , 2014, Computational Geosciences.

[58]  Bjarne A. Foss,et al.  Embedding structural information in simulation-based optimization , 2013, Comput. Chem. Eng..

[59]  Shiyuan Yang,et al.  Stagnation Analysis in Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[60]  Albert C. Reynolds,et al.  Ensemble-Based Optimization of the Water-Alternating-Gas-Injection Process , 2016 .

[61]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[62]  T. Kolda,et al.  A generating set direct search augmented Lagrangian algorithm for optimization with a combination of general and linear constraints , 2006 .

[63]  G. A. Virnovsky.  Waterflooding strategy design using optimal control theory , 1991 .

[64]  Markus Krosche,et al.  Ensemble-Based Water Flooding Optimization Applied to Mature Fields , 2011 .

[65]  J. Cagan,et al.  An Extended Pattern Search Algorithm for Three-Dimensional Component Layout , 2000 .

[66]  Marley M. B. R. Vellasco,et al.  Evolutionary Optimization of Smart-Wells Control Under Technical Uncertainties , 2007 .

[67]  D. Maguire.  The raster GIS design model: a profile of ERDAS , 1992 .

[68]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[69]  Roddy V. Amenta.  An interactive FORTRAN program for cross-correlation of signals on a PC with CGA graphics: an application in marine geoacoustics , 1990 .

[70]  S. Baskar,et al.  Covariance matrix adaptation evolution strategy based design of centralized PID controller , 2010, Expert Syst. Appl..

[71]  Petros Koumoutsakos,et al.  A Method for Handling Uncertainty in Evolutionary Optimization With an Application to Feedback Control of Combustion , 2009, IEEE Transactions on Evolutionary Computation.

[72]  Albert C. Reynolds,et al.  A Covariance Matrix Adaptation Algorithm for Simultaneous Estimation of Optimal Placement and Control of Production and Water Injection Wells , 2015, ANSS 2015.

[73]  Virginia Torczon,et al.  On the Convergence of Pattern Search Algorithms , 1997, SIAM J. Optim..

[74]  Ronald D. Haynes,et al.  A Closer Look At Differential Evolution For The Optimal Well Placement Problem , 2015, GECCO.

[75]  L. Durlofsky.  CONSTRAINED PRODUCTION OPTIMIZATION WITH AN EMPHASIS ON DERIVATIVE-FREE METHODS , 2009 .

[76]  Ting Sun,et al.  Using Multiscale Regularization to Obtain Realistic Optimal Control Strategies , 2011, ANSS 2011.

[77]  Charles Audet,et al.  Generalized pattern searches with derivative information , 2002, Math. Program..

[78]  Kamran Behdinan,et al.  Particle swarm approach for structural design optimization , 2007 .

[79]  Ilya Loshchilov,et al.  CMA-ES with restarts for solving CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.