Non-linear Heterogeneous Ensemble Model for Permeability Prediction of Oil Reservoirs

The ensemble computational model, which uses machine learning techniques to learn partial solutions of a given problem and combines the solutions to obtain a complete solution to the original problem, is increasingly used in both classification and regression problems. Typically the ensemble model performs better than the individual models and ensures better reliability of the model. The investigations of literature reveal that support vector machine (SVM), artificial neural network (ANN) and adaptive neuro-fuzzy inference system (ANFIS) are adopted individually to characterize oil reservoirs. In this paper, an ensemble of SVM, ANN and ANFIS is proposed to predict the permeability of oil reservoirs by using real-life well logs. An ANN model is used to implement a non-linear ensemble strategy. The individual models in the ensemble approach are trained with the datasets obtained by using bagging sampling principle. In this sampling approach, partial datasets for training each model are selected randomly. The simulation results reveal that the proposed ensemble of heterogeneous models outperforms the individual models with respect to correlation coefficient, root mean square error, and execution time. The proposed ensemble model exploits the expertise of each model and increases the generalization capability which is highly desirable for reservoir characterization that requires accurate predictions for maintaining efficient exploration and management of oil resources.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[3]  Michel Pasquier,et al.  POP-TRAFFIC: a novel fuzzy neural approach to road traffic analysis and prediction , 2006, IEEE Transactions on Intelligent Transportation Systems.

[4]  Johannes R. Sveinsson,et al.  Parallel consensual neural networks , 1997, IEEE Trans. Neural Networks.

[5]  Chang-Hsu Chen,et al.  A committee machine with empirical formulas for permeability prediction , 2006, Comput. Geosci..

[6]  Christoph Clauser,et al.  Permeability prediction based on fractal pore‐space geometry , 1999 .

[7]  Haibo He,et al.  Bootstrap Methods for Foreign Currency Exchange Rates Prediction , 2007, 2007 International Joint Conference on Neural Networks.

[8]  Djebbar Tiab,et al.  Application of artificial intelligence to characterize naturally fractured zones in Hassi Messaoud Oil Field, Algeria , 2005 .

[9]  Nathan Intrator,et al.  Optimal ensemble averaging of neural networks , 1997 .

[10]  Amir Kavousi,et al.  3D fracture modeling in Parsi oil field using artificial intelligence tools , 2010 .

[11]  A. Sadek,et al.  Decision Support System for Predicting Benefits of Left-Turn Lanes at Unsignalized Intersections , 2007 .

[12]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[13]  H. C. Chen,et al.  FUZZY MODELLING AND THE PREDICTION OF POROSITY AND PERMEABILITY FROM THE COMPOSITIONAL AND TEXTURAL ATTRIBUTES OF SANDSTONE , 1997 .

[14]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[15]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[16]  Luís Torgo,et al.  Regression error characteristic surfaces , 2005, KDD '05.

[17]  Weiguo Fan,et al.  Tapping the power of text mining , 2006, CACM.

[18]  David W. Opitz,et al.  Feature Selection for Ensembles , 1999, AAAI/IAAI.

[19]  Pat Langley,et al.  Editorial: On Machine Learning , 1986, Machine Learning.

[20]  Tarek Helmy,et al.  Hybrid computational models for the characterization of oil and gas reservoirs , 2010, Expert Syst. Appl..

[21]  Kin Keung Lai,et al.  Estimating VaR in crude oil market: A novel multi-scale non-linear ensemble approach incorporating wavelet analysis and neural network , 2009, Neurocomputing.

[22]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[23]  Morteza Ahmadi,et al.  Design of neural networks using genetic algorithm for the permeability estimation of the reservoir , 2007 .

[24]  Tsuhan Chen,et al.  Pose invariant face recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[25]  Tarek Helmy,et al.  Hybrid Computational Intelligence Models for Porosity and Permeability Prediction of Petroleum reservoirs , 2010, Int. J. Comput. Intell. Appl..

[26]  Hossain Rahimpour-Bonab,et al.  A committee neural network for prediction of normalized oil content from well log data: An example from South Pars Gas Field, Persian Gulf , 2009 .

[27]  Sultan Aljahdali,et al.  Genetic Algorithms for Optimizing Ensemble of Models in Software Reliability Prediction , 2008 .

[28]  Leon N. Cooper,et al.  Learning System Architectures Composed of Multiple Learning Modules , 2009 .

[29]  Jian Hou,et al.  Novel Approach to Predict Potentiality of Enhanced Oil Recovery , 2006 .

[30]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Radford M. Neal Probabilistic Inference Using Markov Chain Monte Carlo Methods , 2011 .

[32]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[33]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[34]  Leo Breiman,et al.  Pasting Small Votes for Classification in Large Databases and On-Line , 1999, Machine Learning.

[35]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[36]  Giorgio Valentini,et al.  Bias-Variance Analysis of Support Vector Machines for the Development of SVM-Based Ensemble Methods , 2004, J. Mach. Learn. Res..

[37]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[38]  Reza Ebrahimpour,et al.  Face Detection Using Mixture of MLP Experts , 2007, Neural Processing Letters.

[39]  Jinbo Bi,et al.  Regression Error Characteristic Curves , 2003, ICML.

[40]  Ding Chang,et al.  Optimizing reservoir features in oil exploration management based on fusion of soft computing , 2011 .

[41]  Seyed Ali Moallemi,et al.  A fuzzy logic approach for estimation of permeability and rock type from conventional well log data: an example from the Kangan reservoir in the Iran Offshore Gas Field , 2006 .

[42]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[43]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[44]  Fakhri Karray,et al.  Soft Computing and Tools of Intelligent Systems Design: Theory and Applications , 2004 .

[45]  Robert O. Gjerdingen Learning syntactically significant temporal patterns of chords: A masking field embedded in an ART 3 architecture , 1992, Neural Networks.

[46]  Ian D. Gates,et al.  Innovative Data-Driven Permeability Prediction in a Heterogeneous Reservoir , 2009 .

[47]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Jalil Kianfar,et al.  A HYBRID NEURO-GENETIC APPROACH TO SHORT-TERM TRAFFIC VOLUME PREDICTION , 2009 .

[49]  John L. Rhodes,et al.  Algebraic Principles for the Analysis of a Biochemical System , 1967, J. Comput. Syst. Sci..

[50]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Data Mining Researchers , 2003 .

[51]  Mohamad T. Musavi,et al.  On the Generalization Ability of Neural Network Classifiers , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Hui Li,et al.  Quadratically gated mixture of experts for incomplete data classification , 2007, ICML '07.

[53]  Khaled Rasheed,et al.  Stock market prediction with multiple classifiers , 2007, Applied Intelligence.

[54]  Dongjoo Park,et al.  Forecasting Freeway Link Travel Times with a Multilayer Feedforward Neural Network , 1999 .

[55]  James C. Bezdek,et al.  Fuzzy Kohonen clustering networks , 1994, Pattern Recognit..

[56]  Jong-Se Lim,et al.  Reservoir properties determination using fuzzy logic and neural networks from well data in offshore Korea , 2005 .

[57]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[58]  Grigorios Tsoumakas,et al.  Greedy regression ensemble selection: Theory and an application to water quality prediction , 2008, Inf. Sci..

[59]  Dao-Qiang Zhang,et al.  A novel kernelized fuzzy C-means algorithm with application in medical image segmentation , 2004, Artif. Intell. Medicine.

[60]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[61]  Kin Keung Lai,et al.  Credit Risk Analysis Using a Reliability-Based Neural Network Ensemble Model , 2006, ICANN.

[62]  Abdulazeez Abdulraheem,et al.  Prediction of Porosity and Permeability of Oil and Gas Reservoirs using Hybrid Computational Intelligence Models , 2010 .

[63]  Maqsood Ali,et al.  Using artificial intelligence to predict permeability from petrographic data , 2000 .

[64]  Sukhdev Khebbal,et al.  Intelligent Hybrid Systems , 1994 .

[65]  Fakhreddine O. Karray,et al.  Soft Computing and Intelligent Systems Design, Theory, Tools and Applications , 2006, IEEE Transactions on Neural Networks.

[66]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[67]  S. Uma,et al.  An Ensemble Model of Multiple Classifiers for Time Series Prediction , 2010 .

[68]  Shahab D. Mohaghegh,et al.  Development of Surrogate Reservoir Model (SRM) for fast track analysis of a complex reservoir , 2009 .

[69]  Milagrosa Aldana,et al.  Comparison between neuro-fuzzy and fractal models for permeability prediction , 2009 .

[70]  Yunlong Zhang,et al.  Forecasting of Short-Term Freeway Volume with v-Support Vector Machines , 2007 .

[71]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[72]  Ian D. Gates,et al.  A support vector machine algorithm to classify lithofacies and model permeability in heterogeneous reservoirs , 2010 .

[73]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[74]  Jose Finol,et al.  Permeability prediction in shaly formations: The fuzzy modeling approach , 2002 .