Discrimination and correction of abnormal data for condition monitoring of drilling process

Abstract During the drilling process, the data quality influences the reliability of condition monitoring results. However, the actual drilling data may encounter various kinds of abnormal data, and different kinds of them need to be handled differently. The abnormal data caused by external factors such as sensor failure, storage errors, etc., should be corrected, while the abnormal data caused by drilling accidents should be protected. Therefore, not only the anomaly detection is needed, but the causes of anomalies should be further discriminated. This paper proposes a method for discrimination and correction of abnormal data in the drilling process. First, the local outlier factor anomaly detection algorithm is developed to detect all kinds of the abnormal data. Then, the dynamic time warping and fuzzy c-means are combined for the discrimination of causes of anomalies. Finally, the discriminated abnormal data caused by external factors are corrected with the k nearest neighbor interpolation. Simulation results involving actual data illustrate that the causes of anomalies can be discriminated effectively, and the monitoring results of monitoring models based on neural network improve after using the proposed method, which verify the necessity of anomaly discrimination.

[1]  Shuzhi Sam Ge,et al.  Data-Defect Inspection With Kernel-Neighbor-Density-Change Outlier Factor , 2018, IEEE Transactions on Automation Science and Engineering.

[2]  Thierry Chateau,et al.  Learning of binocular fixations using anomaly detection with deep reinforcement learning , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[3]  Rubiyah Yusof,et al.  FINNIM: Iterative Imputation of Missing Values in Dissolved Gas Analysis Dataset , 2014, IEEE Transactions on Industrial Informatics.

[4]  Prashant Mhaskar,et al.  Data-Based Modeling and Control of Nylon-6, 6 Batch Polymerization , 2013, IEEE Transactions on Control Systems Technology.

[5]  W. John Lee,et al.  Detecting and Removing Outliers in Production Data to Enhance Production Forecasting , 2016 .

[6]  Bokyoung Kang,et al.  Real-time business process monitoring method for prediction of abnormal termination using KNNI-based LOF prediction , 2012, Expert Syst. Appl..

[7]  Pan Zhang,et al.  A Multilevel Prediction Model of Carbon Efficiency Based on the Differential Evolution Algorithm for the Iron Ore Sintering Process , 2018, IEEE Transactions on Industrial Electronics.

[8]  Haibo He,et al.  A local density-based approach for outlier detection , 2017, Neurocomputing.

[9]  Donghua Zhou,et al.  Batch Process Modeling and Monitoring With Local Outlier Factor , 2019, IEEE Transactions on Control Systems Technology.

[10]  F. Khan,et al.  Dynamic data driven sonic well log model for formation evaluation , 2019, Journal of Petroleum Science and Engineering.

[11]  Alexandros Nanopoulos,et al.  Reverse Nearest Neighbors in Unsupervised Distance-Based Outlier Detection , 2015, IEEE Transactions on Knowledge and Data Engineering.

[12]  Zidong Wang,et al.  Image-Based Quantitative Analysis of Gold Immunochromatographic Strip via Cellular Neural Network Approach , 2014, IEEE Transactions on Medical Imaging.

[13]  Junping Du,et al.  Anomaly Detection Using Local Kernel Density Estimation and Context-Based Regression , 2020, IEEE Transactions on Knowledge and Data Engineering.

[14]  Mogens Blanke,et al.  Fault diagnosis of downhole drilling incidents using adaptive observers and statistical change detection , 2015 .

[15]  Sandeep Kumar,et al.  Parameter Estimation of Heavy-Tailed AR Model With Missing Data Via Stochastic EM , 2018, IEEE Transactions on Signal Processing.

[16]  Miguel Angel Ferrer-Ballester,et al.  SM-DTW: Stability Modulated Dynamic Time Warping for signature verification , 2019, Pattern Recognit. Lett..

[17]  Ashish Ghosh,et al.  Integration of deep feature extraction and ensemble learning for outlier detection , 2019, Pattern Recognit..

[18]  Leanne Lai Hang Chan,et al.  A fast LSH-based similarity search method for multivariate time series , 2019, Inf. Sci..

[19]  Esther-Lydia Silva-Ramírez,et al.  Single imputation with multilayer perceptron and multiple imputation combining multilayer perceptron and k-nearest neighbours for monotone patterns , 2015, Appl. Soft Comput..

[20]  Biao Wang,et al.  Outlier detection based on Gaussian process with application to industrial processes , 2019, Appl. Soft Comput..

[21]  Suresh Venugopal,et al.  Time series data analysis for automatic flow influx detection during drilling , 2019, Journal of Petroleum Science and Engineering.

[22]  Kee-Eung Kim,et al.  An Improved Particle Filter With a Novel Hybrid Proposal Distribution for Quantitative Analysis of Gold Immunochromatographic Strips , 2019, IEEE Transactions on Nanotechnology.

[23]  Yaguo Lei,et al.  An Incorrect Data Detection Method for Big Data Cleaning of Machinery Condition Monitoring , 2020, IEEE Transactions on Industrial Electronics.

[24]  Sonajharia Minz,et al.  Binarizing Change for Fast Trend Similarity Based Clustering of Time Series Data , 2015, PReMI.

[25]  Min Wu,et al.  Diagnosis of downhole incidents for geological drilling processes using multi-time scale feature extraction and probabilistic neural networks , 2020 .

[26]  Hua-Liang Wei,et al.  Handling missing data in multivariate time series using a vector autoregressive model-imputation (VAR-IM) algorithm , 2018, Neurocomputing.

[27]  Shiliang Sun,et al.  Online Anomaly Detection with Sparse Gaussian Processes , 2019, Neurocomputing.

[28]  Javier Del Ser,et al.  On-line Elastic Similarity Measures for time series , 2019, Pattern Recognit..

[29]  Hao Ye,et al.  A data imputation method for multivariate time series based on generative adversarial network , 2019, Neurocomputing.

[30]  Jian Bin Wang,et al.  Job Safety Analysis Model of Great Wall Drilling Company Mud Logging Operation , 2013 .

[31]  Chonghui Guo,et al.  Similarity measure based on piecewise linear approximation and derivative dynamic time warping for time series mining , 2011, Expert Syst. Appl..