A Robust and Sparse Process Fault Detection Method Based on RSPCA

As a method widely used in fault detection, principal component analysis (PCA) still has challenges in applicability due to its sensitivity to outliers and its difficulty in principal components (PCs) interpretation. In this paper, a robust sparse PCA (RSPCA) model is proposed to improve the robustness and interpretability of the PCA-based fault detection methods. Specifically, better robustness is achieved through capturing the maximal L1-norm variance while the sparse non-zero loadings are given for the PCs to achieve improved interpretability. A fault detection method is developed based on the RSPCA model, which uses the Genetic Algorithm (GA) to determine the number of non-zero loadings in each PC via the variance-sparsity tradeoff and defines $T^{2}$ and SPE statistics based on the selected PCs. In addition, an outlier removing strategy is proposed based on the SPE statistic, which can achieve further improvement to the robustness of the proposed method. The effectiveness and efficacy of the proposed method is evaluated by applying it to both two numerical simulation examples and the Tennessee Eastman (TE) process.

[1]  Gert R. G. Lanckriet,et al.  Sparse eigen methods by D.C. programming , 2007, ICML '07.

[2]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[3]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[4]  Kusum Deep,et al.  A real coded genetic algorithm for solving integer and mixed integer optimization problems , 2009, Appl. Math. Comput..

[5]  Arpan Kumar Kar,et al.  Bio inspired computing - A review of algorithms and scope of applications , 2016, Expert Syst. Appl..

[6]  Deyu Meng,et al.  Improve robustness of sparse PCA by L1-norm maximization , 2012, Pattern Recognit..

[7]  Steven X. Ding,et al.  Comparison of Two Basic Statistics for Fault Detection and Process Monitoring , 2017 .

[8]  T. Kanade,et al.  Robust subspace computation using L1 norm , 2003 .

[9]  Richard D. Braatz,et al.  Perspectives on process monitoring of industrial systems , 2016, Annu. Rev. Control..

[10]  Antoine Geissbühler,et al.  Novelty Detection using One-class Parzen Density Estimator. An Application to Surveillance of Nosocomial Infections , 2008, MIE.

[11]  Christos Georgakis,et al.  Plant-wide control of the Tennessee Eastman problem , 1995 .

[12]  Deepti Mehrotra,et al.  Comparative review of selection techniques in genetic algorithm , 2015, 2015 International Conference on Futuristic Trends on Computational Analysis and Knowledge Management (ABLAZE).

[13]  R. Powell,et al.  An Evaluation of the Accuracy of Kernel Density Estimators for Home Range Analysis , 1996 .

[14]  Vikram Garaniya,et al.  A sparse PCA for nonlinear fault diagnosis and robust feature discovery of industrial processes , 2016 .

[15]  Philippe C. Besse,et al.  A L 1-norm PCA and a Heuristic Approach , 1996 .

[16]  Biao Huang,et al.  Performance-Driven Distributed PCA Process Monitoring Based on Fault-Relevant Variable Selection and Bayesian Inference , 2016, IEEE Transactions on Industrial Electronics.

[17]  Namrata Vaswani,et al.  Static and Dynamic Robust PCA and Matrix Completion: A Review , 2018, Proceedings of the IEEE.

[18]  Padmavathi Kora,et al.  Crossover Operators in Genetic Algorithms: A Review , 2017 .

[19]  Satoshi Nakamura,et al.  Improved novelty detection for online GMM based speaker diarization , 2008, INTERSPEECH.

[20]  M. C. Jones,et al.  A reliable data-based bandwidth selection method for kernel density estimation , 1991 .

[21]  Shai Avidan,et al.  Spectral Bounds for Sparse PCA: Exact and Greedy Algorithms , 2005, NIPS.

[22]  Sam Kwong,et al.  Genetic algorithms: concepts and applications [in engineering design] , 1996, IEEE Trans. Ind. Electron..

[23]  David A. Clifton,et al.  A review of novelty detection , 2014, Signal Process..

[24]  Shehroz S. Khan,et al.  Review of Fall Detection Techniques: A Data Availability Perspective , 2016, Medical engineering & physics.

[25]  Enrico Zio,et al.  Novelty detection by multivariate kernel density estimation and growing neural gas algorithm , 2015 .

[26]  Sylvain Verron,et al.  Bridging data-driven and model-based approaches for process fault diagnosis and health monitoring: A review of researches and future challenges , 2016, Annu. Rev. Control..

[27]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[28]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[29]  Zhiqiang Ge,et al.  Review on data-driven modeling and monitoring for plant-wide industrial processes , 2017 .

[30]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[31]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[32]  Nojun Kwak,et al.  Principal Component Analysis Based on L1-Norm Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  S. Qin,et al.  Selection of the Number of Principal Components: The Variance of the Reconstruction Error Criterion with a Comparison to Other Methods† , 1999 .

[34]  Michael I. Jordan,et al.  A Direct Formulation for Sparse Pca Using Semidefinite Programming , 2004, NIPS 2004.

[35]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[36]  Chao He,et al.  Novelty detection employing an L2 optimal non-parametric density estimator , 2004, Pattern Recognit. Lett..

[37]  Hongyuan Zha,et al.  {\it R}$_{\mbox{1}}$-PCA: rotational invariant {\it L}$_{\mbox{1}}$-norm principal component analysis for robust subspace factorization , 2006, ICML 2006.