Improved nonlinear process monitoring based on ensemble KPCA with local structure analysis

Abstract A new nonlinear process monitoring algorithm called ensemble local kernel principal component analysis (ELKPCA) is proposed. Conventionally, the performance of kernel-based model depends on the width parameter selected empirically in Gaussian kernel function, which means a single parameter corresponds to a single model. Once a poor width parameter is decided, a single kernel-based model may be only effective for part faults. As a typical kernel-based method, the local kernel principal component analysis (LKPCA), considering both global and local structure information of the original data, faces the problem of width parameter selection as well. Since a single model is one-sided, an available way is to combine different single models and take advantage of them. The ensemble kernel principal component analysis (EKPCA) uses single KPCA models as its sub-models and ensemble learning approach is used to combine them. Due to inherit drawbacks from KPCA models, EKPCA only preserves global structure information of data, but ignores important local structure information. In this paper, to solve the above issues, both LKPCA and EKPCA is unified in the proposed framework. First, single LKPCA models are chosen instead and combined by using ensemble learning strategy. Then two monitoring statistics are turned into fault probabilities through Bayesian inference approach and weighted combination strategy, which makes the monitoring behavior easier and more clear. The result shows that ELKPCA model can not only take advantage of sub-LKPCA models effectively, allowing it selecting width parameter more easily and stably, but also retain both global and local structure information from input data by introducing the local structure analysis in the EKPCA model. Case studies on synthetic example and Tennessee Eastman process demonstrate the proposed method outperforms LKPCA and EKPCA and enhances monitoring performance significantly.

[1]  Jianbo Yu,et al.  Local and global principal component analysis for process monitoring , 2012 .

[2]  In-Beum Lee,et al.  Nonlinear dynamic process monitoring based on dynamic kernel PCA , 2004 .

[3]  C. Yoo,et al.  Nonlinear process monitoring using kernel principal component analysis , 2004 .

[4]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[5]  Junhong Li,et al.  Improved kernel principal component analysis for fault detection , 2008, Expert Syst. Appl..

[6]  Peter Cawley,et al.  Independent Component Analysis for Improved Defect Detection in Guided Wave Monitoring , 2016, Proceedings of the IEEE.

[7]  ChangKyoo Yoo,et al.  On-line batch process monitoring using a consecutively updated multiway principal component analysis model , 2003, Comput. Chem. Eng..

[8]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[9]  David J. Sandoz,et al.  The application of principal component analysis and kernel density estimation to enhance process monitoring , 2000 .

[10]  Xue-feng Yan,et al.  Fault Detection and Diagnosis in Chemical Processes Using Sensitive Principal Component Analysis , 2013 .

[11]  R. Mininni,et al.  A nonlinear principal component analysis to study archeometric data , 2016 .

[12]  Mia Hubert,et al.  Sparse PCA for High-Dimensional Data With Outliers , 2016, Technometrics.

[13]  Michael Baldea,et al.  A geometric method for batch data visualization, process monitoring and fault detection , 2017, Journal of Process Control.

[14]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[15]  Han Mi Fault detection and diagnosis method based on modified kernel principal component analysis , 2015 .

[16]  이장명,et al.  전신주의 종류 판별을 위한 동적 PCA 알고리즘 , 2010 .

[17]  In-Beum Lee,et al.  Fault identification for process monitoring using kernel principal component analysis , 2005 .

[18]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[19]  Grigorios Dimitriadis,et al.  Diagnosis of Process Faults in Chemical Systems Using a Local Partial Least Squares Approach , 2008 .

[20]  U. Kruger,et al.  Block adaptive kernel principal component analysis for nonlinear process monitoring , 2016 .

[21]  Xu Yongmao,et al.  Multivariate Statistical Process Monitoring Using Robust Nonlinear Principal Component Analysis , 2005 .

[22]  J. Golinval,et al.  Fault detection based on Kernel Principal Component Analysis , 2010 .

[23]  Marco E. Sanjuan,et al.  An improved weighted recursive PCA algorithm for adaptive fault detection , 2016 .

[24]  Chudong Tong,et al.  Fault detection and diagnosis of dynamic processes using weighted dynamic decentralized PCA approach , 2017 .

[25]  Xiaogang Deng,et al.  Modified kernel principal component analysis based on local structure analysis and its application to nonlinear process fault diagnosis , 2013 .

[26]  Manabu Kano,et al.  Comparison of statistical process monitoring methods: application to the Eastman challenge problem , 2000 .

[27]  Jianfeng Mao,et al.  Nonlocal and local structure preserving projection and its application to fault detection , 2016 .

[28]  Furong Gao,et al.  Review of Recent Research on Data-Based Process Monitoring , 2013 .

[29]  Nan Li,et al.  Ensemble Kernel Principal Component Analysis for Improved Nonlinear Process Monitoring , 2015 .

[30]  M. Hazelton Variable kernel density estimation , 2003 .

[31]  Weihua Li,et al.  Recursive PCA for adaptive process monitoring , 1999 .

[32]  Steven X. Ding,et al.  A Review on Basic Data-Driven Approaches for Industrial Process Monitoring , 2014, IEEE Transactions on Industrial Electronics.

[33]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[34]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[35]  Min-Sen Chiu,et al.  Nonlinear process monitoring using JITL-PCA , 2005 .

[36]  In-Beum Lee,et al.  Fault detection and diagnosis based on modified independent component analysis , 2006 .

[37]  Seongkyu Yoon,et al.  Fault diagnosis with multivariate statistical models part I: using steady state fault signatures , 2001 .

[38]  Xuefeng Yan,et al.  Multivariate Statistical Process Monitoring Using Modified Factor Analysis and Its Application , 2012 .

[39]  J. Macgregor,et al.  Monitoring batch processes using multiway principal component analysis , 1994 .

[40]  Hsiao-Ping Huang,et al.  Fault detection and isolation for dynamic processes using recursive principal component analysis (PCA) based on filtering of signals , 2007 .

[41]  L. Luo,et al.  Process Monitoring with Global–Local Preserving Projections , 2014 .

[42]  Li Peng,et al.  Process Monitoring Based on Recursive Probabilistic PCA for Multi-mode Process∗ , 2015 .

[43]  Zhi-huan Song,et al.  Global–Local Structure Analysis Model and Its Application for Fault Detection and Identification , 2011 .

[44]  ChangKyoo Yoo,et al.  Fault detection of batch processes using multiway kernel principal component analysis , 2004, Comput. Chem. Eng..

[45]  Zhu Xi-hu Sensor Fault Detection for EHA System Based on Adaptive Kernel Principal Component Analysis , 2014 .

[46]  Abdel Razzaq Mugdadi,et al.  A bandwidth selection for kernel density estimation of functions of random variables , 2004, Comput. Stat. Data Anal..

[47]  Manabu Kano,et al.  Comparison of multivariate statistical process monitoring methods with applications to the Eastman challenge problem , 2002 .

[48]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[49]  ChangKyoo Yoo,et al.  Statistical process monitoring with independent component analysis , 2004 .