Review of Concept Drift Detection Method for Industrial Process Modeling

With the advent of big data era in industry, data-driven modeling methods have been applied widely. The concept drift problem in industrial process modeling has also attracted widespread attention. However, the current research on concept drift focuses on classification tasks and computer fields, with less work on regression modeling of industrial processes. Aiming at the above problems, this paper summarizes the concept drift detection methods for industrial process modeling, and guide for solving this problem. First, the general definition of concept drift and its existence in industrial processes are introduced. Then, the existing drift detection technologies based on process variables, based on prediction error of difficulty-to-measure parameter and based on combine multiple factors are addressed. Thirdly, these methods are discussed, and some research difficulties are given out. Finally, the conclusion and the future research directions for the existing concept detection difficulties are presented.

[1]  Tang Jian,et al.  On-line KPLS Algorithm with Application to Ensemble Modeling Parameters of Mill Load , 2013 .

[2]  Ning Lu,et al.  Concept drift detection via competence models , 2014, Artif. Intell..

[3]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[4]  Feng Huang,et al.  Robust Prototype-Based Learning on Data Streams , 2018, IEEE Transactions on Knowledge and Data Engineering.

[5]  S. Joe Qin,et al.  Reconstruction-Based Fault Identification Using a Combined Index , 2001 .

[6]  Jie Lu,et al.  Regional Concept Drift Detection and Density Synchronized Drift Adaptation , 2017, IJCAI.

[7]  Ping Li,et al.  Selective recursive kernel learning for online identification of nonlinear systems with NARX form , 2010 .

[8]  João Mendes-Moreira,et al.  Concept Neurons - Handling Drift Issues for Real-Time Industrial Data Mining , 2016, ECML/PKDD.

[9]  Abdelmalek Kouadri,et al.  Fault detection and diagnosis in a cement rotary kiln using PCA with EWMA-based adaptive threshold monitoring scheme , 2017 .

[10]  Grigorios Tsoumakas,et al.  Tracking recurring contexts using ensemble classifiers: an application to email filtering , 2009, Knowledge and Information Systems.

[11]  Wang Feng,et al.  Online Learning Algorithms for Big Data Analytics: A Survey , 2015 .

[12]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[13]  Ludmila I. Kuncheva,et al.  A framework for generating data to simulate changing environments , 2007, Artificial Intelligence and Applications.

[14]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..

[15]  Tianyou Chai,et al.  On-line principal component analysis with application to process modeling , 2012, Neurocomputing.

[16]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[17]  J. C. Schlimmer,et al.  Incremental learning from noisy data , 2004, Machine Learning.

[18]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[19]  Wei Sun,et al.  PCA-SDG Based Process Monitoring and Fault Diagnosis: Application to an Industrial Pyrolysis Furnace , 2018 .

[20]  Abraham Bernstein,et al.  Entropy-based Concept Shift Detection , 2006, Sixth International Conference on Data Mining (ICDM'06).

[21]  Francisco Herrera,et al.  Data Preprocessing in Data Mining , 2014, Intelligent Systems Reference Library.

[22]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[23]  Shai Ben-David,et al.  Detecting Change in Data Streams , 2004, VLDB.

[24]  Cesare Alippi,et al.  Just-in-Time Adaptive Classifiers—Part I: Detecting Nonstationary Changes , 2008, IEEE Transactions on Neural Networks.

[25]  Wolfgang Lehner,et al.  Drift-Aware Ensemble Regression , 2009, MLDM.

[26]  Xuegang Hu,et al.  Learning from concept drifting data streams with unlabeled data , 2012, Neurocomputing.

[27]  Mykola Pechenizkiy,et al.  Handling outliers and concept drift in online mass flow prediction in CFB boilers , 2009, SensorKDD '09.

[28]  Dongbin Zhao,et al.  A pdf-Free Change Detection Test Based on Density Difference Estimation , 2018, IEEE Trans. Neural Networks Learn. Syst..

[29]  Gerhard Widmer,et al.  Effective Learning in Dynamic Environments by Explicit Context Tracking , 1993, ECML.

[30]  Zhang Ying.  Fast Detection of Concept Drifts Based on Confident Majority Voting , 2010 .

[31]  Gary M. Weiss,et al.  Quantification and semi-supervised classification methods for handling changes in class distribution , 2009, KDD.

[32]  Fan Zhigang,et al.  A survey of the classification of data streams with concept drift , 2013 .

[33]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[34]  Fei Yu,et al.  Efficient and Accelerated Online Learning for Sparse Group Lasso , 2014, 2014 IEEE International Conference on Data Mining Workshop.

[35]  Lin Xiao,et al.  Dual Averaging Methods for Regularized Stochastic Learning and Online Optimization , 2009, J. Mach. Learn. Res..

[36]  Guangquan Zhang,et al.  Learning under Concept Drift: A Review , 2019, IEEE Transactions on Knowledge and Data Engineering.

[37]  Michael Affenzeller,et al.  Machine learning based concept drift detection for predictive maintenance , 2019, Comput. Ind. Eng..

[38]  Marco E. Sanjuan,et al.  An improved weighted recursive PCA algorithm for adaptive fault detection , 2016 .

[39]  Yu Fei,et al.  Efficient and Accelerated Online Learning for Sparse Group Lasso , 2014, ICDM 2014.

[40]  João Gama,et al.  Learning with Drift Detection , 2004, SBIA.

[41]  Wen Yu Liu,et al.  Adaptive ensemble modelling approach based on updating sample intelligent identification , 2016 .

[42]  Philip S. Yu,et al.  Classifying Data Streams with Skewed Class Distributions and Concept Drifts , 2008, IEEE Internet Computing.

[43]  Gerhard Widmer,et al.  Learning in the Presence of Concept Drift and Hidden Contexts , 1996, Machine Learning.