Local and Global Randomized Principal Component Analysis for Nonlinear Process Monitoring

Kernel principal component analysis (KPCA) has been widely used in nonlinear process monitoring since it can capture the nonlinear process characteristics. However, it suffers from high computational complexity and poor scalability while dealing with real-time process monitoring and large-scale process monitoring. In this paper, a novel dimension reduction technique, local and global randomized principal component analysis (LGRPCA), is proposed for nonlinear process monitoring. The proposed LGRPCA method first maps the input space onto a feature space to reveal nonlinear patterns through random Fourier features. With the aid of random Fourier features, the proposed LGRPCA method is scalable and with much lower computational and storage costs. To exploit the underlying local and global structure information in the feature space, local structure analysis is integrated into the framework of global variance information extraction. The resulting LGRPCA can provide an improved representation of input data than the traditional KPCA. Thus, the proposed LGRPCA method is quite suitable for real-time process monitoring and large-scale process monitoring. <inline-formula> <tex-math notation="LaTeX">$T^{2}$ </tex-math></inline-formula> and squared prediction error (SPE) statistic control charts are built for fault detection using the proposed LGRPCA method. Furthermore, contribution plots to LGRPCA-based <inline-formula> <tex-math notation="LaTeX">$T^{2}$ </tex-math></inline-formula> and SPE (<inline-formula> <tex-math notation="LaTeX">$Q$ </tex-math></inline-formula>) statistics are established to identify the root cause variables through a sensitivity analysis principle. The superior performance of the proposed LGRPCA-based nonlinear process monitoring method is demonstrated through a numerical example and the comparative study of the Tennessee Eastman benchmark process.

[1]  Majdi Mansouri,et al.  Online reduced kernel principal component analysis for process monitoring , 2018 .

[2]  Qiang Liu,et al.  Multiblock Concurrent PLS for Decentralized Monitoring of Continuous Annealing Processes , 2014, IEEE Transactions on Industrial Electronics.

[3]  Carlos F. Alcala,et al.  Reconstruction-based contribution for process monitoring with kernel principal component analysis , 2010, Proceedings of the 2010 American Control Conference.

[4]  Shengtai Li,et al.  Sensitivity analysis of differential-algebraic equations and partial differential equations , 2005, Comput. Chem. Eng..

[5]  Xiaogang Deng,et al.  Modified kernel principal component analysis based on local structure analysis and its application to nonlinear process fault diagnosis , 2013 .

[6]  Daoqiang Zhang,et al.  A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction , 2013, Neural Processing Letters.

[7]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[8]  S. Joe Qin,et al.  A novel dynamic PCA algorithm for dynamic data modeling and process monitoring , 2017 .

[9]  Yi Cao,et al.  Nonlinear Dynamic Process Monitoring Using Canonical Variate Analysis and Kernel Density Estimations , 2010, IEEE Transactions on Industrial Informatics.

[10]  Frédéric Kratz,et al.  On the application of interval PCA to process monitoring: A robust strategy for sensor FDI with new efficient control statistics , 2018 .

[11]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[12]  Richard D. Braatz,et al.  Data-driven Methods for Fault Detection and Diagnosis in Chemical Processes , 2000 .

[13]  Hassani Messaoud,et al.  Kernel principal component analysis with reduced complexity for nonlinear dynamic process monitoring , 2017 .

[14]  Ma Yao,et al.  On-line monitoring of batch processes using generalized additive kernel principal component analysis , 2015 .

[15]  Zhi-huan Song,et al.  Global–Local Structure Analysis Model and Its Application for Fault Detection and Identification , 2011 .

[16]  Benjamin Recht,et al.  Random Features for Large-Scale Kernel Machines , 2007, NIPS.

[17]  C. Yoo,et al.  Nonlinear process monitoring using kernel principal component analysis , 2004 .

[18]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[19]  Nan Li,et al.  Ensemble Kernel Principal Component Analysis for Improved Nonlinear Process Monitoring , 2015 .

[20]  Xuefeng Yan,et al.  Nonlinear plant-wide process monitoring using MI-spectral clustering and Bayesian inference-based multiblock KPCA , 2015 .

[21]  Zhiqiang Ge,et al.  Improved kernel PCA-based monitoring approach for nonlinear processes , 2009 .

[22]  Huijun Gao,et al.  Data-Driven Control and Process Monitoring for Industrial Applications—Part I , 2014, IEEE Transactions on Industrial Electronics.

[23]  U. Kruger,et al.  Block adaptive kernel principal component analysis for nonlinear process monitoring , 2016 .

[24]  Yi Cao,et al.  Nonlinear Dynamic Process Monitoring Using Canonical Variate Analysis and Kernel Density Estimations , 2009 .

[25]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[26]  Andrés Marino Álvarez-Meza,et al.  Global and local choice of the number of nearest neighbors in locally linear embedding , 2011, Pattern Recognit. Lett..

[27]  Jianfeng Mao,et al.  Nonlinear process monitoring based on kernel global–local preserving projections , 2016 .

[28]  Jeff G. Schneider,et al.  On the Error of Random Fourier Features , 2015, UAI.

[29]  Richard D. Braatz,et al.  Perspectives on process monitoring of industrial systems , 2016, Annu. Rev. Control..

[30]  Zhiqiang Ge,et al.  Data Mining and Analytics in the Process Industry: The Role of Machine Learning , 2017, IEEE Access.

[31]  Benjamin Recht,et al.  Weighted Sums of Random Kitchen Sinks: Replacing minimization with randomization in learning , 2008, NIPS.

[32]  Steven X. Ding,et al.  A Review on Basic Data-Driven Approaches for Industrial Process Monitoring , 2014, IEEE Transactions on Industrial Electronics.

[33]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[34]  Bernhard Schölkopf,et al.  Randomized Nonlinear Component Analysis , 2014, ICML.

[35]  Jianbo Yu,et al.  Local and global principal component analysis for process monitoring , 2012 .

[36]  Yi Cao,et al.  Nonlinear process fault detection and identification using kernel PCA and kernel density estimation , 2016 .

[37]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[38]  Bo Zhou,et al.  Process monitoring of iron-making process in a blast furnace with PCA-based methods , 2016 .

[39]  In-Beum Lee,et al.  Fault identification for process monitoring using kernel principal component analysis , 2005 .