NSGA-II-trained neural network approach to the estimation of prediction intervals of scale deposition rate in oil & gas equipment

Scale deposition can damage equipment in the oil & gas production industry. Hence, the reliable and accurate prediction of the scale deposition rate is critical for production availability. In this study, we consider the problem of predicting the scale deposition rate, providing an indication of the associated prediction uncertainty. We tackle the problem using an empirical modeling approach, based on experimental data. Specifically, we implement a multi-objective genetic algorithm (namely, non-dominated sorting genetic algorithm-II (NSGA-II)) to train a neural network (NN) (i.e. to find its parameters, that is its weights and biases) to provide the prediction intervals (PIs) of the scale deposition rate. The PIs are optimized both in terms of accuracy (coverage probability) and dimension (width). We perform k-fold cross-validation to guide the choice of the NN structure (i.e. the number of hidden neurons). We use hypervolume indicator metric to evaluate the Pareto fronts in the validation step. A case study is considered, with regards to a set of experimental observations: the NSGA-II-trained neural network is shown capable of providing PIs with both high coverage and small width.

[1]  Yuan,et al.  Prediction of sulfate scaling tendency in oilfield operations , 1991 .

[2]  Isis Didier Lins,et al.  Predictive maintenance policy for oil well equipment in case of scaling through support vector machines , 2011 .

[3]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[4]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[5]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[6]  Saeid Nahavandi,et al.  A prediction interval-based approach to determine optimal structures of neural network metamodels , 2010, Expert Syst. Appl..

[7]  Mitsuo Kawato,et al.  A new information criterion combined with cross-validation method to estimate generalization capability , 1992, Systems and Computers in Japan.

[8]  E. Zio,et al.  A study of the bootstrap method for estimating the accuracy of artificial neural networks in predicting nuclear transient processes , 2006, IEEE Transactions on Nuclear Science.

[9]  Preben Randhol,et al.  Kinetics of CaCO3 Scale Formation During Core Flooding , 2008 .

[10]  I. Ozkol,et al.  Determination of the Optimum Geometry of the Heat Exchanger Body Via A Genetic Algorithm , 2005 .

[11]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[12]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[13]  Tadayoshi Fushiki,et al.  Estimation of prediction error by using K-fold cross-validation , 2011, Stat. Comput..

[14]  Enrico Zio,et al.  ESTIMATION OF PREDICTION INTERVALS OF NEURAL NETWORK MODELS BY A MULTI-OBJECTIVE GENETIC ALGORITHM , 2012 .

[15]  Amir F. Atiya,et al.  Comprehensive Review of Neural Network-Based Prediction Intervals and New Advances , 2011, IEEE Transactions on Neural Networks.

[16]  Jonathan E. Fieldsend,et al.  Full Elite Sets for Multi-Objective Optimisation , 2002 .

[17]  Seymour Geisser,et al.  8. Predictive Inference: An Introduction , 1995 .

[18]  E. Stamatakis,et al.  Scale prediction in liquid flow through porous media: A geochemical model for the simulation of CaCO , 2011 .

[19]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[20]  Rolf Nyborg,et al.  Overview of CO2 Corrosion Models for Wells and Pipelines , 2002 .

[21]  David W. Coit,et al.  Multi-objective optimization using genetic algorithms: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[22]  Louis Gosselin,et al.  Review of utilization of genetic algorithms in heat transfer problems , 2009 .

[23]  Snehamoy Chatterjee,et al.  Reliability estimation using a genetic algorithm-based artificial neural network: An application to a load-haul-dump machine , 2012, Expert Syst. Appl..

[24]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[25]  valeria vitelli Estimation of wind speed prediction intervals by multi-objective genetic algorithms and neural networks , 2012 .

[26]  Hirotaka Nakayama,et al.  Theory of Multiobjective Optimization , 1985 .

[27]  Tobias Friedrich,et al.  Don't be greedy when calculating hypervolume contributions , 2009, FOGA '09.

[28]  Luren Yang,et al.  An Evaluation of Confidence Bound Estimation Methods for Neural Networks , 2002, Advances in Computational Intelligence and Learning.

[29]  James T. Kwok,et al.  Efficient cross-validation for feedforward neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[30]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[31]  Rudy Setiono,et al.  Feedforward Neural Network Construction Using Cross Validation , 2001, Neural Computation.

[32]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[33]  Enrico Zio,et al.  Reliability prediction of oil wells by support vector machine with particle swarm optimization for variable selection and hyperparameter tuning , 2011 .

[34]  安藤 寛,et al.  Cross-Validation , 1952, Encyclopedia of Machine Learning and Data Mining.

[35]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[36]  Robert A. Cottis,et al.  Prediction of the Corrosion Rate of Steel in Seawater Using Neural Network Methods , 2000 .

[37]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.