A deep gated recurrent neural network for petroleum production forecasting

Abstract Forecasting of oil production plays a vital role in petroleum engineering and contributes to supporting engineers in the management of petroleum reservoirs. However, reliable production forecasting is difficult to achieve, particularly in view of the increase in digital oil big data. Although a significant amount of work has been reported in the literature in relation to the use of machine learning in the oil and gas domain, traditional forecasting approaches have limited potential in terms of representing the complex features of time series data. More specifically, in a high-dimensional nonlinear multivariate time series dataset, a shallow machine is incapable of inferring the dependencies between past and future values. In this context, a novel forecasting model for petroleum production is proposed in this work. The model is a deep-gated recurrent neural network consisting of multiple hidden layers, where each layer has a number of nodes. The proposed model has a low-complexity architecture and the capacity to track long-interval time-series datasets. To evaluate the robustness of our model, the proposed technique was benchmarked with various standard approaches. The extensive empirical results demonstrate that the proposed model outperforms existing approaches.

[1]  Ah Chung Tsoi,et al.  Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[2]  Iakov S. Korovin Use of Recurrent and Convolutional Neural Networks for the Problem of Long Term Condition Prediction for Equipment of an Oil-and-gas Production Enterprise , 2017 .

[3]  Shahrokh Valaee,et al.  Recent Advances in Recurrent Neural Networks , 2017, ArXiv.

[4]  Brian Crockett,et al.  "Smart Decision Making Needs Automated Analysis" Making sense out of big data in real-time , 2014 .

[5]  Shahab D. Mohaghegh,et al.  Recent Developments in Application of Artificial Intelligence in Petroleum Engineering , 2005 .

[6]  Shafiq R. Joty,et al.  DeepER - Deep Entity Resolution , 2017, ArXiv.

[7]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[8]  Joseph H. Frantz,et al.  Integrating Big Data Analytics Into Development Planning Optimization , 2018 .

[9]  Chen Wang,et al.  Prediction of Corrosion Rate of Submarine Oil and Gas Pipelines Based on IA-SVM Model , 2019, IOP Conference Series: Earth and Environmental Science.

[10]  Farag Azzedin,et al.  Towards an Architecture for Handling Big Data in Oil and Gas Industries: Service-Oriented Approach , 2019, International Journal of Advanced Computer Science and Applications.

[11]  Leonid Sheremetov,et al.  Forecasting Oil Production Time Series with a Population-Based Simulated Annealing Method , 2015 .

[12]  Pedram Masoudi,et al.  Net pay determination by artificial neural network: Case study on Iranian offshore oil fields , 2014 .

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Walter Daelemans,et al.  Introduction to Special Issue on Machine Learning Approaches to Shallow Parsing , 2002, J. Mach. Learn. Res..

[15]  Les E. Atlas,et al.  Recurrent neural networks and robust time series prediction , 1994, IEEE Trans. Neural Networks.

[16]  Jill Feblowitz,et al.  Analytics in Oil and Gas: The Big Deal About Big Data , 2013 .

[17]  Roger N. Anderson 'Petroleum Analytics Learning Machine' for optimizing the Internet of Things of today's digital oil field-to-refinery petroleum system , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[18]  Gentry Braswell,et al.  Artificial Intelligence Comes of Age in Oil and Gas , 2013 .

[19]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[20]  Li Pan,et al.  Predicting Short-Term Traffic Flow by Long Short-Term Memory Recurrent Neural Network , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[21]  A. Mikhaylov,et al.  OIL PRICE PREDICTORS: MACHINE LEARNING APPROACH , 2019, International Journal of Energy Economics and Policy.

[22]  Mollaiy Berneti Shahram,et al.  An Imperialist Competitive Algorithm Artificial Neural Network Method to Predict Oil Flow Rate of the Wells , 2011 .

[23]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[24]  EbraheemMuhammad,et al.  Distributed representations of tuples for entity resolution , 2018, VLDB 2018.

[25]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[26]  Ling Tang,et al.  A novel decomposition ensemble model with extended extreme learning machine for crude oil price forecasting , 2016, Eng. Appl. Artif. Intell..

[27]  U. G. Kiesow,et al.  Decline Curve Analysis Using Type Curves: Case Histories , 1987 .

[28]  Björn W. Schuller,et al.  Introducing CURRENNT: the munich open-source CUDA recurrent neural network toolkit , 2015, J. Mach. Learn. Res..

[29]  Igor N. Aizenberg,et al.  Multilayer Neural Network with Multi-Valued Neurons in time series forecasting of oil production , 2014, Neurocomputing.

[30]  Johannes Jäschke,et al.  Oil Production Monitoring using Gradient Boosting Machine Learning Algorithm , 2019, IFAC-PapersOnLine.

[31]  Xin Ma,et al.  Predicting the oil production using the novel multivariate nonlinear model based on Arps decline model and kernel method , 2016, Neural Computing and Applications.

[32]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[33]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[35]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[36]  Iraj Ershaghi,et al.  A New Approach to Reservoir Characterization Using Deep Learning Neural Networks , 2016 .

[37]  Farshid Torabi,et al.  Big Data analytics in oil and gas industry: An emerging trend , 2018 .

[38]  Alaa El. Sagheer,et al.  Time series forecasting of petroleum production using deep LSTM recurrent networks , 2019, Neurocomputing.

[39]  Lu-Tao Zhao,et al.  Forecasting Oil Price Using Web-based Sentiment Analysis , 2019, Energies.

[40]  Madan M. Gupta,et al.  Production Forecasting of Petroleum Reservoir applying Higher-Order Neural Networks (HONN) with Limited Reservoir Data , 2013 .

[41]  Z. Irani,et al.  Critical analysis of Big Data challenges and analytical methods , 2017 .

[42]  Chun-Ping Chang,et al.  New evidence on the convergence of per capita carbon dioxide emissions from panel seemingly unrelated regressions augmented Dickey–Fuller tests , 2008 .

[43]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.