Confidence bounds of petrophysical predictions from conventional neural networks

Neural networks are powerful tools for solving the complex regression problems which abound in geosciences. Estimation of prediction confidence from neural networks is an important area. Many procedures are available to date, but it is often tedious for practitioners to implement such procedures without significant modification of the existing learning algorithms. In many cases, the procedures are also computationally intensive. This paper presents a practical solution using conventional backpropagation networks with simple data pre-processing and post-processing algorithms. The methodology involves conversion of the target outputs into linguistic variables (classes) prior to learning. When the classification network converges, minimum and maximum predictions are derived from the output activations using a simple averaging algorithm. Two examples from petroleum reservoirs are used to demonstrate the proposed methodology. The results show that the confidence bounds of the petrophysical predictions are realistic in both cases. The proposed methodology is generally useful, and can be implemented in simple spreadsheets without altering any existing neural network code.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[3]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[4]  Fuzzy Models-What Are They , and Why ? , 2004 .

[5]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[6]  Padraig Cunningham,et al.  Confidence and prediction intervals for neural network ensembles , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[7]  Sungzoon Cho,et al.  Multiple permeability predictions using an observational learning algorithm , 2000 .

[8]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[9]  M. Nikravesh,et al.  Soft Computing for Intelligent Reservoir Characterization , 2000 .

[10]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[11]  Pawan Lingras,et al.  Fuzzy-rough and rough-fuzzy serial combinations in neurocomputing , 2001, Neurocomputing.

[12]  Luren Yang,et al.  An Evaluation of Confidence Bound Estimation Methods for Neural Networks , 2002, Advances in Computational Intelligence and Learning.

[13]  James C. Bezdek,et al.  Fuzzy models—What are they, and why? [Editorial] , 1993, IEEE Transactions on Fuzzy Systems.

[14]  George Chryssolouris,et al.  Confidence interval prediction for neural network models , 1996, IEEE Trans. Neural Networks.