Soft sensor modeling for fraction yield of crude oil based on ensemble deep learning

Abstract Soft sensor modeling of crude oil physicochemical properties, especially fraction yield, is very important for refinery. Traditional method of properties evaluation in the laboratory is time-consuming and the near-infrared spectrum technology has shortcoming of low accuracy and strict application conditions. To solve these problems, the nuclear magnetic resonance (NMR) is introduced to properties evaluation of crude oil for refining process, where soft sensor modeling between the 1H NMR spectral data and the fraction yield plays an important role. This paper presents an ensemble deep learning based soft sensor modeling approach for fraction yield evaluation of crude oil. In this approach, a pre-processing method of spectral data is proposed by changing data structure, increasing data redundancy and generating virtual samples. Then, the model structure and its implementation are presented, which consists of a deep learning network, a near neighbor learning part and a random vector functional-link (RVFL) network based ensemble strategy. To avoid over-fitting, the training algorithm using k-fold cross-validation of ensemble deep learning model is also given. The experimental results show that the proposed model can learn the 1H NMR spectral data features well and improve accuracy for crude oil fraction yield evaluation.

[1]  Rodrigo Bagueira de Vasconcellos Azeredo,et al.  1H NMR spectroscopy and low-field relaxometry for predicting viscosity and API gravity of Brazilian crude oils – A comparative study , 2014 .

[2]  Feng Qian,et al.  A novel adaptive algorithm with near-infrared spectroscopy and its application in online gasoline blending processes , 2015 .

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ulf Leser,et al.  Relation Extraction for Drug-Drug Interactions using Ensemble Learning , 2011 .

[5]  W. Fred McClure,et al.  Near infrared spectroscopy : the giant is running strong , 1994 .

[6]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[7]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[8]  Fuli Wang,et al.  A Robust Calibration Modeling Strategy for Analysis of Interference-Subject Spectral Data , 2009 .

[9]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[10]  Zhiqiang Ge,et al.  Soft Sensor Modeling of Nonlinear Industrial Processes Based on Weighted Probabilistic Projection Regression , 2017, IEEE Transactions on Instrumentation and Measurement.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[13]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[15]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[16]  L. Breiman.  Stacked Regressions , 1996, Machine Learning.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Ke Chen,et al.  Semi-Supervised Learning via Regularized Boosting Working on Multiple Semi-Supervised Assumptions , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Naishan Li,et al.  Application of SVM to the Prediction of Water Content in Crude Oil , 2011, 2011 International Conference on Control, Automation and Systems Engineering (CASE).

[20]  Yehuda Koren,et al.  The BellKor Solution to the Netflix Grand Prize , 2009 .

[21]  Der-Chiang Li,et al.  Using virtual sample generation to build up management knowledge in the early manufacturing stages , 2006, Eur. J. Oper. Res..

[22]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Vijayan K. Asari,et al.  The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches , 2018, ArXiv.

[25]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.

[26]  Dexian Huang,et al.  Data-driven soft sensor development based on deep learning technique , 2014 .

[27]  Lorenzo Sassu,et al.  Prediction of physical–chemical properties of crude oils by 1H NMR analysis of neat samples and chemometrics , 2012, Magnetic resonance in chemistry : MRC.

[28]  Yi Liu,et al.  SemiBoost: Boosting for Semi-Supervised Learning , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[30]  Brian J. Marquardt,et al.  Characterization of Crude Oil Products Using Data Fusion of Process Raman, Infrared, and Nuclear Magnetic Resonance (NMR) Spectra , 2011 .

[31]  Chunhui Zhao,et al.  Broad Convolutional Neural Network Based Industrial Process Fault Diagnosis With Incremental Learning Capability , 2020, IEEE Transactions on Industrial Electronics.

[32]  Joseph Sill,et al.  Feature-Weighted Linear Stacking , 2009, ArXiv.

[33]  Zhiqiang Ge,et al.  Deep Learning for Industrial KPI Prediction: When Ensemble Learning Meets Semi-Supervised Data , 2021, IEEE Transactions on Industrial Informatics.

[34]  OpitzDavid,et al.  Popular ensemble methods , 1999 .

[35]  Bernhard Schölkopf,et al.  Prior Knowledge in Support Vector Kernels , 1997, NIPS.

[36]  Daniel Molina,et al.  Correlations between SARA fractions and physicochemical properties with 1H NMR spectra of vacuum residues from Colombian crude oils , 2010 .

[37]  Jiye Liang,et al.  An efficient instance selection algorithm for k nearest neighbor regression , 2017, Neurocomputing.

[38]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[39]  Ronei J. Poppi,et al.  Determination of Saturates, Aromatics, and Polars in Crude Oil by 13C NMR and Support Vector Regression with Variable Selection by Genetic Algorithm , 2016 .

[40]  Chunhui Zhao,et al.  Spectra data analysis and calibration modeling method using spectra subspace separation and multiblock independent component regression strategy , 2011 .

[41]  Dong Yu,et al.  Scalable stacking and learning for building deep architectures , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  Roman M. Balabin,et al.  Neural network (ANN) approach to biodiesel analysis: Analysis of biodiesel density, kinematic viscosity, methanol and water contents using near infrared (NIR) spectroscopy , 2011 .

[43]  Juan Murgich,et al.  Partial Least-Squares (PLS) Correlation between Refined Product Yields and Physicochemical Properties with the 1H Nuclear Magnetic Resonance (NMR) Spectra of Colombian Crude Oils , 2007 .

[44]  Chao Yang,et al.  Ensemble deep kernel learning with application to quality prediction in industrial polymerization processes , 2018 .

[45]  Christopher M. Bishop,et al.  Current address: Microsoft Research, , 2022 .

[46]  Zhanpeng Zhang,et al.  A deep belief network based fault diagnosis model for complex chemical processes , 2017, Comput. Chem. Eng..

[47]  Marco F. Ferrão,et al.  Characterization of Gasoline by 1H Nuclear Magnetic Resonance and Chemometrics , 2017 .

[48]  Paulo R. Filgueiras,et al.  FTIR, 1H and 13C NMR data fusion to predict crude oils properties , 2020 .

[49]  Zhiqiang Ge,et al.  Deep Learning of Semisupervised Process Data With Hierarchical Extreme Learning Machine and Soft Sensor Application , 2018, IEEE Transactions on Industrial Electronics.

[50]  Chunhui Zhao,et al.  A new soft-sensor algorithm with concurrent consideration of slowness and quality interpretation for dynamic chemical process , 2019, Chemical Engineering Science.

[51]  Chunhui Zhao,et al.  Spectra calibration modeling and statistical analysis for cumulative quality interpretation and prediction , 2012 .

[52]  N. Nielsen,et al.  Quantitative Analysis of Constituents in Heavy Fuel Oil by 1H Nuclear Magnetic Resonance (NMR) Spectroscopy and Multivariate Data Analysis , 2008 .

[53]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[54]  Zhi-Hua Zhou,et al.  Medical diagnosis with C4.5 rule preceded by artificial neural network ensemble , 2003, IEEE Transactions on Information Technology in Biomedicine.

[55]  Milind Deo,et al.  Estimation of Properties of Crude Oil Residual Fractions Using Chemometrics , 2007 .

[56]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[57]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[58]  A. P. Singh,et al.  Determination of aromatics and naphthenes in straight run gasoline by 1H NMR spectroscopy. Part I , 2000 .

[59]  Tomaso Poggio,et al.  Incorporating prior information in machine learning by creating virtual examples , 1998, Proc. IEEE.

[60]  Anil Prabhakar,et al.  Automatic identification of bird calls using Spectral Ensemble Average Voice Prints , 2006, 2006 14th European Signal Processing Conference.

[61]  Qingbo He,et al.  Energy-Fluctuated Multiscale Feature Learning With Deep ConvNet for Intelligent Spindle Bearing Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.