A hybrid particle swarm optimization and support vector regression model for modelling permeability prediction of hydrocarbon reservoir

Abstract The significance of accurate permeability prediction cannot be over-emphasized in oil and gas reservoir characterization. Support vector machine regression (SVR), a computational intelligence technique, has been very successful in the estimation of permeability and has been widely deployed due to its unique features. However, careful selection of SVR hyper-parameters is highly essential to its optimum performance and this task is traditionally done using trial and error approach (TE-SVR) which takes a lot of time and do not guarantee optimal selection of the hyper-parameters. In this work, the performance of particle swarm optimization (PSO) technique, a heuristic optimization technique, is investigated for the optimal selection of SVR hyper-parameters for the first time in modelling and characterization of hydrocarbon reservoir. The technique is capable of automatic selection of the optimum combination of SVR hyper-parameters resulting in higher predictive accuracy and generalization ability of the developed model. The resulting PSO-SVR model is compared to SVR models whose parameters are obtained through random search (RAND-SVR) and trial and error approach (TE-SVR). The comparison is done using real-life industrial datasets obtained during petroleum exploration from four distinct oil wells located in a Middle Eastern oil and gas field. Simulation results indicate that the PSO-SVR model outperforms all the other models. Error reduction of 15.1%, 26.15%, 12.32% and 7.1% are recorded for PSO-SVR model compared to ordinary SVR (TE-SVR) in well-A, well-B, well-C and well-D, respectively. Also, reduction of 12.8%, 23.97%, 2.51% and 0.11 are recorded when PSO-SVR and RAND-SVR results are compared in the respective wells. Furthermore, the results show the potential of the application of heuristics algorithms, such as PSO, in the optimization of computational intelligence techniques employed in hydrocarbon reservoir characterizations. Therefore, PSO technique is proposed for the optimization of SVR hyper-parameters in permeability prediction and reservoir characterization based on its superior performance over the commonly employed optimization techniques.

[1]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[2]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[3]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[4]  Dmitry Zelenko,et al.  Kernel methods for relation extraction , 2003 .

[5]  Michael D. Tusiani,et al.  LNG: A Nontechnical Guide , 2007 .

[6]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[7]  Yoshua Bengio,et al.  An empirical evaluation of deep architectures on problems with many factors of variation , 2007, ICML '07.

[8]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[9]  M. A. Abido,et al.  Optimal power flow using particle swarm optimization , 2002 .

[10]  Sunday Olusanya Olatunji,et al.  Estimation of average surface energies of transition metal nitrides using computational intelligence technique , 2017, Soft Comput..

[11]  L. Buydens,et al.  Comparing support vector machines to PLS for spectral regression applications , 2004 .

[12]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[13]  Sunday O. Olatunji,et al.  Investigating the effect of correlation-based feature selection on the performance of support vector machines in reservoir characterization , 2015 .

[14]  Ali Selamat,et al.  Modeling the permeability of carbonate reservoir using type-2 fuzzy logic systems , 2011, Comput. Ind..

[15]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[16]  Lennart Ljung,et al.  Kernel methods in system identification, machine learning and function estimation: A survey , 2014, Autom..

[17]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[18]  Ali Selamat,et al.  Predicting correlations properties of crude oil systems using type-2 fuzzy logic systems , 2011, Expert Syst. Appl..

[19]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[20]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[21]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[22]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[23]  Ali Selamat,et al.  Improved sensitivity based linear learning method for permeability prediction of carbonate reservoir using interval type-2 fuzzy logic system , 2014, Appl. Soft Comput..

[24]  Sunday Olusanya Olatunji,et al.  A Novel Homogenous Hybridization Scheme for Performance Improvement of Support Vector Machines Regression in Reservoir Characterization , 2016, Appl. Comput. Intell. Soft Comput..

[25]  Alex Smola,et al.  Kernel methods in machine learning , 2007, math/0701907.

[26]  Moustafa Elshafei,et al.  Saudi Arabia stock prices forecasting using artificial neural networks , 2011, Fourth International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2011).

[27]  Sunday Olusanya Olatunji,et al.  Estimation of physical, mechanical and hydrological properties of permeable concrete using computational intelligence approach , 2016, Appl. Soft Comput..

[28]  Ian H. Robertson,et al.  fMRI activation during response inhibition and error processing: The role of the DAT1 gene in typically developing adolescents and those diagnosed with ADHD , 2011, Neuropsychologia.

[29]  Bernhard Schölkopf,et al.  On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion , 1998, Algorithmica.

[30]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[31]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[32]  Sunday Olusanya Olatunji,et al.  Application of computational intelligence technique for estimating superconducting transition temperature of YBCO superconductors , 2016, Appl. Soft Comput..

[33]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..